vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #297
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13worker1: QEMU running (pid 52)14worker1 # Disk image does not exist, creating the virtualisation disk image...15lb # Disk image does not exist, creating the virtualisation disk image...16lb: QEMU running (pid 50)17worker2 # Disk image does not exist, creating the virtualisation disk image...18worker2: QEMU running (pid 51)19lb # Formatting '/build/vm-state-lb/tmp.5QyiB2H4NV', fmt=raw size=107374182420worker1 # Formatting '/build/vm-state-worker1/tmp.ep2dnC81IA', fmt=raw size=107374182421client: QEMU running (pid 49)22lb # mke2fs 1.47.4 (6-Mar-2025)23worker1 # mke2fs 1.47.4 (6-Mar-2025)24worker2 # Formatting '/build/vm-state-worker2/tmp.yPUvHZOd3C', fmt=raw size=107374182425client # Formatting '/build/vm-state-client/tmp.JqqmEBoHYn', fmt=raw size=107374182426lb # Discarding device blocks: 0/262144 done27worker1 # Discarding device blocks: 0/262144 done28client # mke2fs 1.47.4 (6-Mar-2025)29lb # Creating filesystem with 262144 4k blocks and 65536 inodes30worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes31client # Discarding device blocks: 0/262144 done32lb # Filesystem UUID: 0ece4790-1829-4030-a958-feadc778443e33worker1 # Filesystem UUID: 01ef2076-cc88-454b-be4c-1fb66170444934client # Creating filesystem with 262144 4k blocks and 65536 inodes35lb # Superblock backups stored on blocks:36worker1 # Superblock backups stored on blocks:37client # Filesystem UUID: a8f41018-e136-4a79-83c7-1b7683d0857038lb # 32768, 98304, 163840, 22937639worker1 # 32768, 98304, 163840, 22937640client # Superblock backups stored on blocks:41lb # 42worker1 # 43client # 32768, 98304, 163840, 22937644lb # Allocating group tables: 0/8 done45worker1 # Allocating group tables: 0/8 done46client # 47lb # Writing inode tables: 0/8 done48worker1 # Writing inode tables: 0/8 done49client # Allocating group tables: 0/8 done50lb # Creating journal (8192 blocks): done51worker1 # Creating journal (8192 blocks): done52client # Writing inode tables: 0/8 done53lb # Writing superblocks and filesystem accounting information: 0/8 done54worker1 # Writing superblocks and filesystem accounting information: 0/8 done55client # Creating journal (8192 blocks): done56lb # 57worker1 # 58client # Writing superblocks and filesystem accounting information: 0/8 done59lb # Virtualisation disk image created.60worker1 # Virtualisation disk image created.61client # 62worker2 # mke2fs 1.47.4 (6-Mar-2025)63client # Virtualisation disk image created.64worker2 # Discarding device blocks: 0/262144 done65(finished: start all VMs, in 0.23 seconds)66worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes67client: waiting for unit network-addresses-eth1.service68worker2 # Filesystem UUID: 1c0abea5-602b-42d2-b5b3-4c6045f1988269client: waiting for the VM to finish booting70worker2 # Superblock backups stored on blocks:71worker2 # 32768, 98304, 163840, 22937672worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85lb # 86lb # 87worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0088lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089client # 90client # 91client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0092worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...93worker1 # 94worker1 # 95worker1 # 96worker1 # 97lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...98lb # 99lb # 100lb # 101lb # 102worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103worker2 # 104worker2 # 105lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00106client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...107client # 108client # 109client # 110client # 111worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00112client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00113worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114worker1 # 115worker1 # 116worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...117worker2 # 118worker2 # 119worker2 # 120worker2 # 121lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...122lb # 123lb # 124client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...125client # 126client # 127worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker2 # 130worker2 # 131client # Booting from ROM...132worker1 # Booting from ROM...133lb # Booting from ROM...134worker2 # Booting from ROM...135client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test/init regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration console=ttyS0,115200n8 console=tty0137client # [ 0.000000] BIOS-provided physical RAM map:138client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026141client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved142client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable143client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved144lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026145client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved146worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0kr1n537dvgjwic16706vlk6jg70cr08-nixos-system-worker1-test/init regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration console=ttyS0,115200n8 console=tty0147client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved148worker1 # [ 0.000000] BIOS-provided physical RAM map:149client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved150worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable151client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved152lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xzrwmx591i25vlijx1m7lk76hjmbxra6-nixos-system-lb-test/init regInfo=/nix/store/5b1jdrkcd54zycf7j131lh8wai3gzg44-closure-info/registration console=ttyS0,115200n8 console=tty0153worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved154client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved155lb # [ 0.000000] BIOS-provided physical RAM map:156worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved157client # [ 0.000000] NX (Execute Disable) protection: active158lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable159client # [ 0.000000] APIC: Static calls initialized160worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable161client # [ 0.000000] SMBIOS 2.8 present.162lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved163worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved164lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved165client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014166worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved167client # [ 0.000000] DMI: Memory slots populated: 1/1168lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable169client # [ 0.000000] Hypervisor detected: KVM170worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved171worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026172lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved173client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000174worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved175client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00176lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved177worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved178client # [ 0.000000] kvm-clock: using sched offset of 466122221 cycles179lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved180worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved181lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved182worker1 # [ 0.000000] NX (Execute Disable) protection: active183client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns184worker1 # [ 0.000000] APIC: Static calls initialized185client # [ 0.000004] tsc: Detected 2400.012 MHz processor186lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved187worker1 # [ 0.000000] SMBIOS 2.8 present.188worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0awpqwy2d5xzs80mb1c2bwcn4cfyr0qj-nixos-system-worker2-test/init regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration console=ttyS0,115200n8 console=tty0189client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000190worker2 # [ 0.000000] BIOS-provided physical RAM map:191lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved192worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014193lb # [ 0.000000] NX (Execute Disable) protection: active194client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs195worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable196lb # [ 0.000000] APIC: Static calls initialized197worker1 # [ 0.000000] DMI: Memory slots populated: 1/1198worker1 # [ 0.000000] Hypervisor detected: KVM199lb # [ 0.000000] SMBIOS 2.8 present.200client # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT201worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved202worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000203client # [ 0.002767] found SMP MP-table at [mem 0x000f5450-0x000f545f]204worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved205lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014206client # [ 0.002778] Using GB pages for direct mapping207worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00208lb # [ 0.000000] DMI: Memory slots populated: 1/1209client # [ 0.002863] RAMDISK: [mem 0x5e366000-0x5ffcffff]210worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable211worker1 # [ 0.000000] kvm-clock: using sched offset of 473491023 cycles212lb # [ 0.000000] Hypervisor detected: KVM213client # [ 0.002872] ACPI: Early table checksum verification disabled214worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved215lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000216client # [ 0.002875] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )217worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns218worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved219lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00220worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor221client # [ 0.002879] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)222lb # [ 0.000001] kvm-clock: using sched offset of 475485364 cycles223worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved224worker1 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000225worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved226client # [ 0.002883] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)227lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns228worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs229lb # [ 0.000005] tsc: Detected 2400.012 MHz processor230worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved231client # [ 0.002890] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)232worker1 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT233client # [ 0.002892] ACPI: FACS 0x000000005FFE0000 000040234lb # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000235worker1 # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f]236worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved237worker1 # [ 0.002753] Using GB pages for direct mapping238worker2 # [ 0.000000] NX (Execute Disable) protection: active239lb # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs240client # [ 0.002894] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)241worker1 # [ 0.002837] RAMDISK: [mem 0x5e367000-0x5ffcffff]242worker2 # [ 0.000000] APIC: Static calls initialized243worker2 # [ 0.000000] SMBIOS 2.8 present.244lb # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT245worker1 # [ 0.002846] ACPI: Early table checksum verification disabled246client # [ 0.002895] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)247lb # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f]248worker1 # [ 0.002850] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )249worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014250lb # [ 0.002740] Using GB pages for direct mapping251client # [ 0.002897] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)252worker2 # [ 0.000000] DMI: Memory slots populated: 1/1253lb # [ 0.002844] RAMDISK: [mem 0x5e367000-0x5ffcffff]254worker1 # [ 0.002854] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)255worker2 # [ 0.000000] Hypervisor detected: KVM256client # [ 0.002898] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)257lb # [ 0.002852] ACPI: Early table checksum verification disabled258worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000259worker1 # [ 0.002859] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)260lb # [ 0.002855] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )261client # [ 0.002900] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]262worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00263worker1 # [ 0.002868] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)264client # [ 0.002901] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]265worker2 # [ 0.000000] kvm-clock: using sched offset of 484268449 cycles266lb # [ 0.002859] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)267worker1 # [ 0.002870] ACPI: FACS 0x000000005FFE0000 000040268client # [ 0.002901] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]269lb # [ 0.002864] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)270worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns271worker1 # [ 0.002872] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)272client # [ 0.002902] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]273worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor274lb # [ 0.002871] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)275worker1 # [ 0.002873] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)276client # [ 0.002902] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]277worker2 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000278lb # [ 0.002873] ACPI: FACS 0x000000005FFE0000 000040279client # [ 0.002903] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]280worker2 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs281worker1 # [ 0.002875] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)282lb # [ 0.002874] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)283client # [ 0.002903] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]284worker2 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT285worker1 # [ 0.002876] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)286client # [ 0.003127] No NUMA configuration found287lb # [ 0.002876] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)288worker2 # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]289worker1 # [ 0.002877] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]290client # [ 0.003128] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]291worker2 # [ 0.002749] Using GB pages for direct mapping292lb # [ 0.002877] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)293worker2 # [ 0.002908] RAMDISK: [mem 0x5e367000-0x5ffcffff]294client # [ 0.003130] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]295worker1 # [ 0.002879] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]296client # [ 0.005542] Zone ranges:297lb # [ 0.002879] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)298worker2 # [ 0.002918] ACPI: Early table checksum verification disabled299worker1 # [ 0.002879] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]300client # [ 0.005543] DMA [mem 0x0000000000001000-0x0000000000ffffff]301worker2 # [ 0.002921] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )302lb # [ 0.002880] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]303worker1 # [ 0.002880] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]304client # [ 0.005544] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]305client # [ 0.005545] Normal empty306lb # [ 0.002881] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]307worker2 # [ 0.002924] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)308client # [ 0.005546] Device empty309worker1 # [ 0.002880] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]310client # [ 0.005547] Movable zone start for each node311lb # [ 0.002882] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]312worker2 # [ 0.002928] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)313worker1 # [ 0.002881] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]314client # [ 0.005547] Early memory node ranges315lb # [ 0.002882] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]316client # [ 0.005548] node 0: [mem 0x0000000000001000-0x000000000009efff]317worker1 # [ 0.002881] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]318worker2 # [ 0.002936] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)319worker1 # [ 0.003108] No NUMA configuration found320lb # [ 0.002883] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]321client # [ 0.005549] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]322worker2 # [ 0.002938] ACPI: FACS 0x000000005FFE0000 000040323worker1 # [ 0.003109] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]324lb # [ 0.002883] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]325client # [ 0.005550] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]326worker2 # [ 0.002939] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)327worker1 # [ 0.003112] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]328client # [ 0.005568] On node 0, zone DMA: 1 pages in unavailable ranges329lb # [ 0.002884] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]330worker1 # [ 0.005637] Zone ranges:331lb # [ 0.003114] No NUMA configuration found332worker2 # [ 0.002941] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)333client # [ 0.005826] On node 0, zone DMA: 97 pages in unavailable ranges334worker1 # [ 0.005638] DMA [mem 0x0000000000001000-0x0000000000ffffff]335lb # [ 0.003115] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]336client # [ 0.031340] On node 0, zone DMA32: 40 pages in unavailable ranges337worker1 # [ 0.005640] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]338worker2 # [ 0.002942] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)339client # [ 0.031798] ACPI: PM-Timer IO Port: 0x608340lb # [ 0.003118] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]341worker1 # [ 0.005641] Normal empty342lb # [ 0.005346] Zone ranges:343worker1 # [ 0.005641] Device empty344client # [ 0.031808] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])345worker2 # [ 0.002944] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)346worker1 # [ 0.005642] Movable zone start for each node347lb # [ 0.005347] DMA [mem 0x0000000000001000-0x0000000000ffffff]348worker1 # [ 0.005643] Early memory node ranges349client # [ 0.031834] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23350worker2 # [ 0.002945] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]351lb # [ 0.005349] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]352worker1 # [ 0.005643] node 0: [mem 0x0000000000001000-0x000000000009efff]353lb # [ 0.005350] Normal empty354client # [ 0.031837] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)355worker2 # [ 0.002946] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]356lb # [ 0.005351] Device empty357worker1 # [ 0.005644] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]358lb # [ 0.005351] Movable zone start for each node359client # [ 0.031838] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)360worker2 # [ 0.002947] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]361lb # [ 0.005352] Early memory node ranges362worker1 # [ 0.005645] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]363client # [ 0.031839] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)364worker2 # [ 0.002947] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]365lb # [ 0.005353] node 0: [mem 0x0000000000001000-0x000000000009efff]366worker1 # [ 0.005666] On node 0, zone DMA: 1 pages in unavailable ranges367client # [ 0.031840] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)368lb # [ 0.005354] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]369worker2 # [ 0.002948] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]370worker1 # [ 0.005924] On node 0, zone DMA: 97 pages in unavailable ranges371client # [ 0.031841] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)372lb # [ 0.005355] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]373worker2 # [ 0.002948] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]374worker1 # [ 0.032104] On node 0, zone DMA32: 40 pages in unavailable ranges375worker1 # [ 0.032572] ACPI: PM-Timer IO Port: 0x608376client # [ 0.031843] ACPI: Using ACPI (MADT) for SMP configuration information377lb # [ 0.005375] On node 0, zone DMA: 1 pages in unavailable ranges378worker2 # [ 0.002949] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]379client # [ 0.031844] ACPI: HPET id: 0x8086a201 base: 0xfed00000380worker1 # [ 0.032585] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])381worker2 # [ 0.003184] No NUMA configuration found382lb # [ 0.005635] On node 0, zone DMA: 97 pages in unavailable ranges383client # [ 0.031847] TSC deadline timer available384worker1 # [ 0.032611] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23385client # [ 0.031851] CPU topo: Max. logical packages: 1386worker2 # [ 0.003184] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]387lb # [ 0.031861] On node 0, zone DMA32: 40 pages in unavailable ranges388client # [ 0.031851] CPU topo: Max. logical dies: 1389lb # [ 0.032329] ACPI: PM-Timer IO Port: 0x608390worker1 # [ 0.032614] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)391worker2 # [ 0.003187] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]392worker2 # [ 0.005724] Zone ranges:393client # [ 0.031852] CPU topo: Max. dies per package: 1394lb # [ 0.032342] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])395worker1 # [ 0.032616] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)396client # [ 0.031855] CPU topo: Max. threads per core: 1397worker2 # [ 0.005725] DMA [mem 0x0000000000001000-0x0000000000ffffff]398lb # [ 0.032368] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23399worker1 # [ 0.032617] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)400client # [ 0.031856] CPU topo: Num. cores per package: 1401worker2 # [ 0.005727] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]402client # [ 0.031856] CPU topo: Num. threads per package: 1403lb # [ 0.032371] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)404worker1 # [ 0.032618] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)405worker2 # [ 0.005728] Normal empty406worker2 # [ 0.005729] Device empty407client # [ 0.031856] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs408lb # [ 0.032372] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)409worker2 # [ 0.005729] Movable zone start for each node410worker1 # [ 0.032619] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)411worker2 # [ 0.005730] Early memory node ranges412client # [ 0.031873] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()413lb # [ 0.032373] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)414worker1 # [ 0.032621] ACPI: Using ACPI (MADT) for SMP configuration information415worker2 # [ 0.005730] node 0: [mem 0x0000000000001000-0x000000000009efff]416worker1 # [ 0.032622] ACPI: HPET id: 0x8086a201 base: 0xfed00000417lb # [ 0.032374] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)418client # [ 0.031902] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]419worker1 # [ 0.032626] TSC deadline timer available420worker2 # [ 0.005732] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]421lb # [ 0.032375] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)422client # [ 0.031903] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]423worker1 # [ 0.032631] CPU topo: Max. logical packages: 1424worker2 # [ 0.005733] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]425worker1 # [ 0.032631] CPU topo: Max. logical dies: 1426lb # [ 0.032378] ACPI: Using ACPI (MADT) for SMP configuration information427client # [ 0.031905] [mem 0x60000000-0xafffffff] available for PCI devices428worker2 # [ 0.005752] On node 0, zone DMA: 1 pages in unavailable ranges429worker1 # [ 0.032632] CPU topo: Max. dies per package: 1430lb # [ 0.032379] ACPI: HPET id: 0x8086a201 base: 0xfed00000431client # [ 0.031906] Booting paravirtualized kernel on KVM432lb # [ 0.032383] TSC deadline timer available433worker2 # [ 0.006012] On node 0, zone DMA: 97 pages in unavailable ranges434worker1 # [ 0.032635] CPU topo: Max. threads per core: 1435worker1 # [ 0.032636] CPU topo: Num. cores per package: 1436lb # [ 0.032387] CPU topo: Max. logical packages: 1437client # [ 0.031909] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns438worker2 # [ 0.032287] On node 0, zone DMA32: 40 pages in unavailable ranges439worker1 # [ 0.032636] CPU topo: Num. threads per package: 1440lb # [ 0.032388] CPU topo: Max. logical dies: 1441worker2 # [ 0.032745] ACPI: PM-Timer IO Port: 0x608442lb # [ 0.032389] CPU topo: Max. dies per package: 1443client # [ 0.036346] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1444worker1 # [ 0.032636] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs445worker2 # [ 0.032757] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])446lb # [ 0.032392] CPU topo: Max. threads per core: 1447client # [ 0.038442] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152448worker1 # [ 0.032657] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()449lb # [ 0.032393] CPU topo: Num. cores per package: 1450worker2 # [ 0.032786] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23451client # [ 0.038485] kvm-guest: PV spinlocks disabled, single CPU452lb # [ 0.032393] CPU topo: Num. threads per package: 1453worker1 # [ 0.032692] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]454worker2 # [ 0.032789] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)455lb # [ 0.032393] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs456worker2 # [ 0.032791] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)457worker1 # [ 0.032694] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]458lb # [ 0.032416] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()459worker1 # [ 0.032695] [mem 0x60000000-0xafffffff] available for PCI devices460worker2 # [ 0.032792] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)461worker1 # [ 0.032697] Booting paravirtualized kernel on KVM462lb # [ 0.032450] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]463worker2 # [ 0.032793] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)464lb # [ 0.032451] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]465worker2 # [ 0.032793] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)466client # [ 0.038487] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test/init regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration console=ttyS0,115200n8 console=tty0467worker1 # [ 0.032701] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns468lb # [ 0.032453] [mem 0x60000000-0xafffffff] available for PCI devices469worker2 # [ 0.032796] ACPI: Using ACPI (MADT) for SMP configuration information470worker1 # [ 0.037141] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1471lb # [ 0.032455] Booting paravirtualized kernel on KVM472worker2 # [ 0.032797] ACPI: HPET id: 0x8086a201 base: 0xfed00000473client # [ 0.038576] Unknown kernel command line parameters "regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration", will be passed to user space.474worker2 # [ 0.032800] TSC deadline timer available475worker1 # [ 0.039284] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152476client # [ 0.038589] random: crng init done477worker2 # [ 0.032804] CPU topo: Max. logical packages: 1478lb # [ 0.032459] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns479worker1 # [ 0.039327] kvm-guest: PV spinlocks disabled, single CPU480worker2 # [ 0.032805] CPU topo: Max. logical dies: 1481client # [ 0.038590] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes482lb # [ 0.036916] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1483worker2 # [ 0.032806] CPU topo: Max. dies per package: 1484client # [ 0.040652] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)485lb # [ 0.039073] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152486worker2 # [ 0.032809] CPU topo: Max. threads per core: 1487worker2 # [ 0.032810] CPU topo: Num. cores per package: 1488lb # [ 0.039123] kvm-guest: PV spinlocks disabled, single CPU489client # [ 0.041678] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)490worker2 # [ 0.032810] CPU topo: Num. threads per package: 1491client # [ 0.041708] Fallback order for Node 0: 0492worker2 # [ 0.032811] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs493worker1 # [ 0.039329] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0kr1n537dvgjwic16706vlk6jg70cr08-nixos-system-worker1-test/init regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration console=ttyS0,115200n8 console=tty0494client # [ 0.041711] Built 1 zonelists, mobility grouping on. Total pages: 393078495client # [ 0.041712] Policy zone: DMA32496worker2 # [ 0.032828] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()497client # [ 0.044303] mem auto-init: stack:all(zero), heap alloc:on, heap free:off498worker2 # [ 0.032859] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]499worker1 # [ 0.039428] Unknown kernel command line parameters "regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration", will be passed to user space.500client # [ 0.047237] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1501worker1 # [ 0.039441] random: crng init done502lb # [ 0.039124] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xzrwmx591i25vlijx1m7lk76hjmbxra6-nixos-system-lb-test/init regInfo=/nix/store/5b1jdrkcd54zycf7j131lh8wai3gzg44-closure-info/registration console=ttyS0,115200n8 console=tty0503client # [ 0.050446] allocated 3145728 bytes of page_ext504worker2 # [ 0.032860] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]505worker1 # [ 0.039441] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes506client # [ 0.059944] ftrace: allocating 48731 entries in 192 pages507worker2 # [ 0.032862] [mem 0x60000000-0xafffffff] available for PCI devices508client # [ 0.059946] ftrace: allocated 192 pages with 2 groups509worker2 # [ 0.032863] Booting paravirtualized kernel on KVM510lb # [ 0.039224] Unknown kernel command line parameters "regInfo=/nix/store/5b1jdrkcd54zycf7j131lh8wai3gzg44-closure-info/registration", will be passed to user space.511worker1 # [ 0.041598] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)512client # [ 0.060759] Dynamic Preempt: lazy513lb # [ 0.039237] random: crng init done514client # [ 0.060901] rcu: Preemptible hierarchical RCU implementation.515worker1 # [ 0.042650] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)516worker2 # [ 0.032866] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns517lb # [ 0.039238] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes518client # [ 0.060901] rcu: RCU event tracing is enabled.519worker1 # [ 0.042682] Fallback order for Node 0: 0520worker2 # [ 0.037534] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1521client # [ 0.060902] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.522lb # [ 0.041344] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)523worker1 # [ 0.042686] Built 1 zonelists, mobility grouping on. Total pages: 393078524worker1 # [ 0.042687] Policy zone: DMA32525worker2 # [ 0.039702] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152526client # [ 0.060903] Trampoline variant of Tasks RCU enabled.527lb # [ 0.042574] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)528client # [ 0.060904] Rude variant of Tasks RCU enabled.529worker2 # [ 0.039750] kvm-guest: PV spinlocks disabled, single CPU530worker1 # [ 0.045356] mem auto-init: stack:all(zero), heap alloc:on, heap free:off531lb # [ 0.042604] Fallback order for Node 0: 0532client # [ 0.060904] Tracing variant of Tasks RCU enabled.533worker1 # [ 0.048645] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1534lb # [ 0.042607] Built 1 zonelists, mobility grouping on. Total pages: 393078535client # [ 0.060905] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.536lb # [ 0.042609] Policy zone: DMA32537worker1 # [ 0.051974] allocated 3145728 bytes of page_ext538worker1 # [ 0.061996] ftrace: allocating 48731 entries in 192 pages539client # [ 0.060906] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1540lb # [ 0.045132] mem auto-init: stack:all(zero), heap alloc:on, heap free:off541worker1 # [ 0.061998] ftrace: allocated 192 pages with 2 groups542lb # [ 0.048480] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1543worker1 # [ 0.062848] Dynamic Preempt: lazy544client # [ 0.060926] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.545lb # [ 0.051792] allocated 3145728 bytes of page_ext546worker1 # [ 0.063013] rcu: Preemptible hierarchical RCU implementation.547worker2 # [ 0.039752] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0awpqwy2d5xzs80mb1c2bwcn4cfyr0qj-nixos-system-worker2-test/init regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration console=ttyS0,115200n8 console=tty0548lb # [ 0.061828] ftrace: allocating 48731 entries in 192 pages549worker1 # [ 0.063013] rcu: RCU event tracing is enabled.550client # [ 0.060928] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.551lb # [ 0.061830] ftrace: allocated 192 pages with 2 groups552worker1 # [ 0.063014] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.553lb # [ 0.062667] Dynamic Preempt: lazy554client # [ 0.060929] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.555worker2 # [ 0.039846] Unknown kernel command line parameters "regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration", will be passed to user space.556worker1 # [ 0.063015] Trampoline variant of Tasks RCU enabled.557lb # [ 0.062812] rcu: Preemptible hierarchical RCU implementation.558worker2 # [ 0.039858] random: crng init done559client # [ 0.065257] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16560worker1 # [ 0.063016] Rude variant of Tasks RCU enabled.561lb # [ 0.062813] rcu: RCU event tracing is enabled.562worker1 # [ 0.063016] Tracing variant of Tasks RCU enabled.563worker2 # [ 0.039859] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes564client # [ 0.065520] rcu: srcu_init: Setting srcu_struct sizes based on contention.565lb # [ 0.062813] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.566worker1 # [ 0.063017] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.567worker2 # [ 0.041991] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)568lb # [ 0.062815] Trampoline variant of Tasks RCU enabled.569client # [ 0.065526] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns570lb # [ 0.062815] Rude variant of Tasks RCU enabled.571worker1 # [ 0.063017] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1572worker2 # [ 0.043050] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)573lb # [ 0.062815] Tracing variant of Tasks RCU enabled.574worker2 # [ 0.043081] Fallback order for Node 0: 0575client # [ 0.065631] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)576worker1 # [ 0.063032] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.577client # [ 0.069144] Console: colour VGA+ 80x25578lb # [ 0.062816] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.579worker2 # [ 0.043084] Built 1 zonelists, mobility grouping on. Total pages: 393078580client # [ 0.069147] printk: legacy console [tty0] enabled581worker2 # [ 0.043084] Policy zone: DMA32582worker1 # [ 0.063034] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.583lb # [ 0.062817] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1584client # [ 0.098476] printk: legacy console [ttyS0] enabled585worker2 # [ 0.045732] mem auto-init: stack:all(zero), heap alloc:on, heap free:off586client # [ 0.194280] ACPI: Core revision 20250807587lb # [ 0.062827] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.588worker1 # [ 0.063035] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.589worker2 # [ 0.048802] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1590worker1 # [ 0.067416] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16591worker2 # [ 0.052094] allocated 3145728 bytes of page_ext592lb # [ 0.062829] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.593worker2 # [ 0.061894] ftrace: allocating 48731 entries in 192 pages594worker1 # [ 0.067693] rcu: srcu_init: Setting srcu_struct sizes based on contention.595client # [ 0.195191] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns596worker2 # [ 0.061896] ftrace: allocated 192 pages with 2 groups597lb # [ 0.062830] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.598client # [ 0.196677] APIC: Switch to symmetric I/O mode setup599worker2 # [ 0.062756] Dynamic Preempt: lazy600worker1 # [ 0.067700] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns601lb # [ 0.067412] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16602client # [ 0.197599] x2apic enabled603worker2 # [ 0.062893] rcu: Preemptible hierarchical RCU implementation.604lb # [ 0.067694] rcu: srcu_init: Setting srcu_struct sizes based on contention.605worker2 # [ 0.062894] rcu: RCU event tracing is enabled.606worker1 # [ 0.067807] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)607client # [ 0.198333] APIC: Switched APIC routing to: physical x2apic608worker1 # [ 0.071357] Console: colour VGA+ 80x25609worker2 # [ 0.062895] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.610lb # [ 0.067700] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns611worker1 # [ 0.071360] printk: legacy console [tty0] enabled612worker2 # [ 0.062896] Trampoline variant of Tasks RCU enabled.613worker1 # [ 0.100724] printk: legacy console [ttyS0] enabled614worker2 # [ 0.062897] Rude variant of Tasks RCU enabled.615lb # [ 0.067808] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)616client # [ 0.200098] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1617worker2 # [ 0.062897] Tracing variant of Tasks RCU enabled.618worker1 # [ 0.196127] ACPI: Core revision 20250807619lb # [ 0.071327] Console: colour VGA+ 80x25620lb # [ 0.071330] printk: legacy console [tty0] enabled621worker2 # [ 0.062898] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.622lb # [ 0.100771] printk: legacy console [ttyS0] enabled623client # [ 0.201045] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns624worker2 # [ 0.062898] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1625worker1 # [ 0.197058] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns626lb # [ 0.196069] ACPI: Core revision 20250807627worker1 # [ 0.198605] APIC: Switch to symmetric I/O mode setup628worker2 # [ 0.062957] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.629client # [ 0.202619] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)630worker1 # [ 0.199548] x2apic enabled631lb # [ 0.196938] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns632worker2 # [ 0.062958] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.633client # [ 0.204703] x86/cpu: User Mode Instruction Prevention (UMIP) activated634worker1 # [ 0.200292] APIC: Switched APIC routing to: physical x2apic635lb # [ 0.198436] APIC: Switch to symmetric I/O mode setup636worker2 # [ 0.062959] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.637client # [ 0.205747] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127638lb # [ 0.199410] x2apic enabled639worker2 # [ 0.067385] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16640client # [ 0.206617] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0641worker1 # [ 0.202098] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1642worker2 # [ 0.067647] rcu: srcu_init: Setting srcu_struct sizes based on contention.643lb # [ 0.200193] APIC: Switched APIC routing to: physical x2apic644worker2 # [ 0.067653] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns645client # [ 0.207620] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto646worker1 # [ 0.203071] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns647lb # [ 0.202020] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1648worker2 # [ 0.067758] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)649client # [ 0.208616] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl650worker2 # [ 0.071301] Console: colour VGA+ 80x25651worker1 # [ 0.204745] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)652worker2 # [ 0.071304] printk: legacy console [tty0] enabled653client # [ 0.209617] Transient Scheduler Attacks: Vulnerable: No microcode654lb # [ 0.202989] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns655worker2 # [ 0.100790] printk: legacy console [ttyS0] enabled656worker1 # [ 0.205829] x86/cpu: User Mode Instruction Prevention (UMIP) activated657client # [ 0.210616] Spectre V2 : Mitigation: Enhanced / Automatic IBRS658worker2 # [ 0.197090] ACPI: Core revision 20250807659lb # [ 0.204619] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)660worker1 # [ 0.206882] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127661client # [ 0.211616] Speculative Return Stack Overflow: Mitigation: Safe RET662lb # [ 0.205705] x86/cpu: User Mode Instruction Prevention (UMIP) activated663worker1 # [ 0.207742] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0664worker2 # [ 0.197969] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns665lb # [ 0.206756] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127666worker2 # [ 0.199489] APIC: Switch to symmetric I/O mode setup667worker1 # [ 0.208745] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto668worker2 # [ 0.200441] x2apic enabled669lb # [ 0.207616] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0670worker2 # [ 0.201189] APIC: Switched APIC routing to: physical x2apic671worker1 # [ 0.210742] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl672client # [ 0.212616] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization673lb # [ 0.208619] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto674client # [ 0.214623] Spectre V2 : Enabling IBPB for BPF675worker1 # [ 0.211742] Transient Scheduler Attacks: Vulnerable: No microcode676worker2 # [ 0.202998] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1677worker1 # [ 0.212742] Spectre V2 : Mitigation: Enhanced / Automatic IBRS678lb # [ 0.210616] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl679client # [ 0.215333] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier680worker1 # [ 0.213742] Speculative Return Stack Overflow: Mitigation: Safe RET681client # [ 0.216617] active return thunk: srso_alias_return_thunk682lb # [ 0.211616] Transient Scheduler Attacks: Vulnerable: No microcode683worker2 # [ 0.203980] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns684lb # [ 0.213317] Spectre V2 : Mitigation: Enhanced / Automatic IBRS685client # [ 0.217457] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'686worker2 # [ 0.205683] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)687lb # [ 0.213615] Speculative Return Stack Overflow: Mitigation: Safe RET688client # [ 0.218616] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'689worker2 # [ 0.206769] x86/cpu: User Mode Instruction Prevention (UMIP) activated690client # [ 0.219616] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'691worker1 # [ 0.214742] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization692worker2 # [ 0.207842] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127693client # [ 0.220616] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'694worker1 # [ 0.216751] Spectre V2 : Enabling IBPB for BPF695worker2 # [ 0.209384] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0696client # [ 0.221616] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'697lb # [ 0.214615] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization698worker1 # [ 0.217743] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier699client # [ 0.222616] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'700lb # [ 0.216624] Spectre V2 : Enabling IBPB for BPF701worker1 # [ 0.218742] active return thunk: srso_alias_return_thunk702worker2 # [ 0.210454] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto703client # [ 0.223616] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'704lb # [ 0.217617] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier705worker1 # [ 0.219764] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'706worker2 # [ 0.211681] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl707client # [ 0.224616] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256708worker1 # [ 0.220742] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'709worker2 # [ 0.212681] Transient Scheduler Attacks: Vulnerable: No microcode710client # [ 0.225616] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64711lb # [ 0.218617] active return thunk: srso_alias_return_thunk712worker1 # [ 0.221742] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'713worker2 # [ 0.214402] Spectre V2 : Mitigation: Enhanced / Automatic IBRS714client # [ 0.226616] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512715lb # [ 0.220645] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'716worker1 # [ 0.222742] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'717client # [ 0.227616] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024718worker2 # [ 0.215353] Speculative Return Stack Overflow: Mitigation: Safe RET719lb # [ 0.221615] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'720worker1 # [ 0.223742] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'721client # [ 0.228616] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8722lb # [ 0.222615] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'723worker1 # [ 0.224742] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'724client # [ 0.229616] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.725lb # [ 0.223615] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'726worker1 # [ 0.225742] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'727lb # [ 0.224615] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'728worker2 # [ 0.215680] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization729worker1 # [ 0.227648] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256730worker2 # [ 0.217688] Spectre V2 : Enabling IBPB for BPF731lb # [ 0.225615] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'732worker1 # [ 0.228462] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64733worker2 # [ 0.218681] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier734worker1 # [ 0.229465] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512735lb # [ 0.226616] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'736worker2 # [ 0.219681] active return thunk: srso_alias_return_thunk737worker1 # [ 0.230453] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024738lb # [ 0.227616] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256739worker1 # [ 0.230742] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8740lb # [ 0.229325] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64741worker2 # [ 0.220702] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'742lb # [ 0.229615] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512743worker2 # [ 0.221680] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'744worker1 # [ 0.231742] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.745lb # [ 0.230616] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024746worker2 # [ 0.223415] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'747lb # [ 0.231615] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8748worker2 # [ 0.224431] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'749worker2 # [ 0.225468] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'750lb # [ 0.232615] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.751worker2 # [ 0.226455] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752worker2 # [ 0.227500] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753worker2 # [ 0.228680] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754worker2 # [ 0.229680] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755worker2 # [ 0.230680] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756worker2 # [ 0.231680] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757worker2 # [ 0.232680] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758worker2 # [ 0.233680] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759client # [ 0.263626] Freeing SMP alternatives memory: 44K760client # [ 0.264413] pid_max: default: 32768 minimum: 301761client # [ 0.264712] LSM: initializing lsm=capability,landlock,yama,bpf,ima762client # [ 0.265708] landlock: Up and running.763client # [ 0.266617] Yama: becoming mindful.764client # [ 0.267832] LSM support for eBPF active765client # [ 0.268724] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766client # [ 0.269658] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker1 # [ 0.266408] Freeing SMP alternatives memory: 44K768worker1 # [ 0.266745] pid_max: default: 32768 minimum: 301769worker1 # [ 0.267839] LSM: initializing lsm=capability,landlock,yama,bpf,ima770client # [ 0.272314] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)771worker1 # [ 0.268844] landlock: Up and running.772worker1 # [ 0.269743] Yama: becoming mindful.773lb # [ 0.267841] Freeing SMP alternatives memory: 44K774client # [ 0.273111] Performance Events: Fam17h+ core perfctr, AMD PMU driver.775worker1 # [ 0.270536] LSM support for eBPF active776lb # [ 0.268618] pid_max: default: 32768 minimum: 301777client # [ 0.273621] ... version: 2778client # [ 0.274341] ... bit width: 48779worker1 # [ 0.271309] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)780lb # [ 0.269448] LSM: initializing lsm=capability,landlock,yama,bpf,ima781client # [ 0.274618] ... generic counters: 6782lb # [ 0.270638] landlock: Up and running.783lb # [ 0.271228] Yama: becoming mindful.784worker1 # [ 0.272639] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)785client # [ 0.275308] ... generic bitmap: 000000000000003f786lb # [ 0.271827] LSM support for eBPF active787client # [ 0.275663] ... fixed-purpose counters: 0788client # [ 0.276385] ... fixed-purpose bitmap: 0000000000000000789lb # [ 0.272731] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)790worker1 # [ 0.274982] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)791client # [ 0.276619] ... value mask: 0000ffffffffffff792lb # [ 0.273654] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)793client # [ 0.277482] ... max period: 00007fffffffffff794worker1 # [ 0.276358] Performance Events: Fam17h+ core perfctr, AMD PMU driver.795client # [ 0.278285] ... global_ctrl mask: 000000000000003f796worker1 # [ 0.276750] ... version: 2797worker2 # [ 0.268129] Freeing SMP alternatives memory: 44K798client # [ 0.278728] signal: max sigframe size: 3376799worker1 # [ 0.277471] ... bit width: 48800worker2 # [ 0.268683] pid_max: default: 32768 minimum: 301801lb # [ 0.276394] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)802client # [ 0.279521] rcu: Hierarchical SRCU implementation.803worker1 # [ 0.277744] ... generic counters: 6804client # [ 0.280155] rcu: Max phase no-delay instances is 400.805worker2 # [ 0.269779] LSM: initializing lsm=capability,landlock,yama,bpf,ima806worker1 # [ 0.278444] ... generic bitmap: 000000000000003f807lb # [ 0.277206] Performance Events: Fam17h+ core perfctr, AMD PMU driver.808worker2 # [ 0.270798] landlock: Up and running.809worker1 # [ 0.278744] ... fixed-purpose counters: 0810lb # [ 0.277620] ... version: 2811worker2 # [ 0.271415] Yama: becoming mindful.812worker1 # [ 0.279449] ... fixed-purpose bitmap: 0000000000000000813lb # [ 0.278329] ... bit width: 48814worker2 # [ 0.272314] LSM support for eBPF active815worker1 # [ 0.279744] ... value mask: 0000ffffffffffff816lb # [ 0.278618] ... generic counters: 6817worker1 # [ 0.280610] ... max period: 00007fffffffffff818worker2 # [ 0.272804] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)819lb # [ 0.279314] ... generic bitmap: 000000000000003f820lb # [ 0.279629] ... fixed-purpose counters: 0821worker1 # [ 0.281393] ... global_ctrl mask: 000000000000003f822worker2 # [ 0.273726] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)823worker1 # [ 0.281859] signal: max sigframe size: 3376824lb # [ 0.280307] ... fixed-purpose bitmap: 0000000000000000825client # [ 0.285339] smp: Bringing up secondary CPUs ...826client # [ 0.285632] smp: Brought up 1 node, 1 CPU827worker1 # [ 0.282643] rcu: Hierarchical SRCU implementation.828lb # [ 0.280618] ... value mask: 0000ffffffffffff829worker1 # [ 0.283324] rcu: Max phase no-delay instances is 400.830lb # [ 0.281507] ... max period: 00007fffffffffff831client # [ 0.286284] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)832worker2 # [ 0.277065] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)833lb # [ 0.282270] ... global_ctrl mask: 000000000000003f834lb # [ 0.282742] signal: max sigframe size: 3376835worker2 # [ 0.278258] Performance Events: Fam17h+ core perfctr, AMD PMU driver.836client # [ 0.286775] Memory: 1454592K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)837lb # [ 0.283504] rcu: Hierarchical SRCU implementation.838worker2 # [ 0.278692] ... version: 2839client # [ 0.287863] devtmpfs: initialized840lb # [ 0.284183] rcu: Max phase no-delay instances is 400.841worker2 # [ 0.279416] ... bit width: 48842client # [ 0.288643] x86/mm: Memory block size: 128MB843worker2 # [ 0.279683] ... generic counters: 6844worker1 # [ 0.288355] smp: Bringing up secondary CPUs ...845worker2 # [ 0.280418] ... generic bitmap: 000000000000003f846worker1 # [ 0.288758] smp: Brought up 1 node, 1 CPU847worker2 # [ 0.280682] ... fixed-purpose counters: 0848client # [ 0.290370] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)849worker1 # [ 0.289437] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)850worker2 # [ 0.281398] ... fixed-purpose bitmap: 0000000000000000851client # [ 0.291507] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).852worker2 # [ 0.281682] ... value mask: 0000ffffffffffff853client # [ 0.292716] pinctrl core: initialized pinctrl subsystem854lb # [ 0.289125] smp: Bringing up secondary CPUs ...855worker2 # [ 0.282591] ... max period: 00007fffffffffff856lb # [ 0.289630] smp: Brought up 1 node, 1 CPU857worker1 # [ 0.289991] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)858client # [ 0.293812] PM: RTC time: 10:50:29, date: 2026-09-20859worker2 # [ 0.283339] ... global_ctrl mask: 000000000000003f860worker1 # [ 0.291013] devtmpfs: initialized861lb # [ 0.290282] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)862worker2 # [ 0.283800] signal: max sigframe size: 3376863worker1 # [ 0.291838] x86/mm: Memory block size: 128MB864worker2 # [ 0.284596] rcu: Hierarchical SRCU implementation.865worker2 # [ 0.285245] rcu: Max phase no-delay instances is 400.866lb # [ 0.290853] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)867lb # [ 0.291863] devtmpfs: initialized868client # [ 0.297429] NET: Registered PF_NETLINK/PF_ROUTE protocol family869worker1 # [ 0.293661] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)870lb # [ 0.292592] x86/mm: Memory block size: 128MB871worker1 # [ 0.294643] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).872client # [ 0.298982] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations873worker1 # [ 0.295823] pinctrl core: initialized pinctrl subsystem874client # [ 0.299644] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations875lb # [ 0.294193] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)876worker1 # [ 0.296937] PM: RTC time: 10:50:29, date: 2026-09-20877worker2 # [ 0.290254] smp: Bringing up secondary CPUs ...878lb # [ 0.294642] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).879client # [ 0.300891] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations880worker2 # [ 0.290697] smp: Brought up 1 node, 1 CPU881lb # [ 0.295713] pinctrl core: initialized pinctrl subsystem882client # [ 0.301629] audit: initializing netlink subsys (disabled)883worker2 # [ 0.291363] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)884lb # [ 0.296809] PM: RTC time: 10:50:29, date: 2026-09-20885client # [ 0.302901] thermal_sys: Registered thermal governor 'fair_share'886worker1 # [ 0.300444] NET: Registered PF_NETLINK/PF_ROUTE protocol family887client # [ 0.302904] thermal_sys: Registered thermal governor 'bang_bang'888worker2 # [ 0.291883] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)889worker1 # [ 0.301230] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations890worker2 # [ 0.292937] devtmpfs: initialized891client # [ 0.303623] audit: type=2000 audit(1789901429.895:1): state=initialized audit_enabled=0 res=1892worker2 # [ 0.293715] x86/mm: Memory block size: 128MB893worker1 # [ 0.301768] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations894client # [ 0.305620] thermal_sys: Registered thermal governor 'step_wise'895lb # [ 0.300519] NET: Registered PF_NETLINK/PF_ROUTE protocol family896client # [ 0.305621] thermal_sys: Registered thermal governor 'user_space'897worker1 # [ 0.303017] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations898lb # [ 0.301836] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations899worker2 # [ 0.295467] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)900client # [ 0.306550] thermal_sys: Registered thermal governor 'power_allocator'901worker1 # [ 0.303754] audit: initializing netlink subsys (disabled)902client # [ 0.307390] cpuidle: using governor menu903lb # [ 0.302640] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations904worker2 # [ 0.296544] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).905worker1 # [ 0.304874] thermal_sys: Registered thermal governor 'fair_share'906client # [ 0.308821] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5907worker2 # [ 0.297766] pinctrl core: initialized pinctrl subsystem908worker1 # [ 0.304876] thermal_sys: Registered thermal governor 'bang_bang'909lb # [ 0.303894] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations910worker2 # [ 0.298816] PM: RTC time: 10:50:29, date: 2026-09-20911worker1 # [ 0.305745] thermal_sys: Registered thermal governor 'step_wise'912lb # [ 0.304632] audit: initializing netlink subsys (disabled)913client # [ 0.309875] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]914worker1 # [ 0.306708] thermal_sys: Registered thermal governor 'user_space'915lb # [ 0.305764] thermal_sys: Registered thermal governor 'fair_share'916client # [ 0.310621] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry917client # [ 0.311631] PCI: Using configuration type 1 for base access918lb # [ 0.305767] thermal_sys: Registered thermal governor 'bang_bang'919worker1 # [ 0.307457] audit: type=2000 audit(1789901429.900:1): state=initialized audit_enabled=0 res=1920lb # [ 0.306619] thermal_sys: Registered thermal governor 'step_wise'921worker2 # [ 0.302332] NET: Registered PF_NETLINK/PF_ROUTE protocol family922worker1 # [ 0.308748] thermal_sys: Registered thermal governor 'power_allocator'923client # [ 0.312662] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.924worker1 # [ 0.308779] cpuidle: using governor menu925lb # [ 0.307576] thermal_sys: Registered thermal governor 'user_space'926worker2 # [ 0.303165] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations927lb # [ 0.308326] audit: type=2000 audit(1789901429.904:1): state=initialized audit_enabled=0 res=1928worker1 # [ 0.310953] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5929worker2 # [ 0.303706] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations930lb # [ 0.309621] thermal_sys: Registered thermal governor 'power_allocator'931worker1 # [ 0.311968] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]932lb # [ 0.309634] cpuidle: using governor menu933worker2 # [ 0.304969] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations934worker1 # [ 0.312747] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry935worker2 # [ 0.305694] audit: initializing netlink subsys (disabled)936lb # [ 0.311820] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5937client # [ 0.317879] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages938worker1 # [ 0.313756] PCI: Using configuration type 1 for base access939worker2 # [ 0.306839] thermal_sys: Registered thermal governor 'fair_share'940client # [ 0.318620] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page941lb # [ 0.312881] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]942worker1 # [ 0.314865] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.943worker2 # [ 0.306841] thermal_sys: Registered thermal governor 'bang_bang'944lb # [ 0.313620] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry945worker2 # [ 0.307684] thermal_sys: Registered thermal governor 'step_wise'946lb # [ 0.314629] PCI: Using configuration type 1 for base access947worker2 # [ 0.308592] thermal_sys: Registered thermal governor 'user_space'948worker2 # [ 0.309424] audit: type=2000 audit(1789901429.912:1): state=initialized audit_enabled=0 res=1949lb # [ 0.315790] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.950worker2 # [ 0.310686] thermal_sys: Registered thermal governor 'power_allocator'951client # [ 0.323620] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages952worker2 # [ 0.310700] cpuidle: using governor menu953worker1 # [ 0.319840] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages954client # [ 0.324618] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page955worker1 # [ 0.320746] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page956worker2 # [ 0.312881] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5957worker2 # [ 0.313931] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]958worker2 # [ 0.314685] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry959worker2 # [ 0.315695] PCI: Using configuration type 1 for base access960lb # [ 0.322888] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages961worker1 # [ 0.325746] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages962lb # [ 0.323619] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page963worker2 # [ 0.316827] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.964worker1 # [ 0.326744] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page965client # [ 0.335047] ACPI: Added _OSI(Module Device)966client # [ 0.335620] ACPI: Added _OSI(Processor Device)967lb # [ 0.324612] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages968client # [ 0.336357] ACPI: Added _OSI(Processor Aggregator Device)969worker2 # [ 0.321914] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages970lb # [ 0.329619] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page971worker2 # [ 0.322684] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page972worker1 # [ 0.337099] ACPI: Added _OSI(Module Device)973worker1 # [ 0.337746] ACPI: Added _OSI(Processor Device)974worker2 # [ 0.327683] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages975worker1 # [ 0.338495] ACPI: Added _OSI(Processor Aggregator Device)976worker2 # [ 0.328682] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page977client # [ 0.344136] ACPI: 1 ACPI AML tables successfully acquired and loaded978lb # [ 0.338219] ACPI: Added _OSI(Module Device)979lb # [ 0.338620] ACPI: Added _OSI(Processor Device)980lb # [ 0.339407] ACPI: Added _OSI(Processor Aggregator Device)981client # [ 0.348019] ACPI: Interpreter enabled982client # [ 0.348634] ACPI: PM: (supports S0 S3 S4 S5)983client # [ 0.349394] ACPI: Using IOAPIC for interrupt routing984worker1 # [ 0.347033] ACPI: 1 ACPI AML tables successfully acquired and loaded985worker2 # [ 0.338959] ACPI: Added _OSI(Module Device)986client # [ 0.351687] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug987worker2 # [ 0.339667] ACPI: Added _OSI(Processor Device)988lb # [ 0.346202] ACPI: 1 ACPI AML tables successfully acquired and loaded989client # [ 0.352620] PCI: Using E820 reservations for host bridge windows990worker2 # [ 0.340239] ACPI: Added _OSI(Processor Aggregator Device)991worker1 # [ 0.351158] ACPI: Interpreter enabled992worker1 # [ 0.351760] ACPI: PM: (supports S0 S3 S4 S5)993worker1 # [ 0.352492] ACPI: Using IOAPIC for interrupt routing994client # [ 0.355684] ACPI: Enabled 2 GPEs in block 00 to 3F995lb # [ 0.349570] ACPI: Interpreter enabled996lb # [ 0.350243] ACPI: PM: (supports S0 S3 S4 S5)997lb # [ 0.350618] ACPI: Using IOAPIC for interrupt routing998lb # [ 0.351505] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug999worker1 # [ 0.354817] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1000worker1 # [ 0.355745] PCI: Using E820 reservations for host bridge windows1001worker2 # [ 0.349255] ACPI: 1 ACPI AML tables successfully acquired and loaded1002worker1 # [ 0.358844] ACPI: Enabled 2 GPEs in block 00 to 3F1003worker2 # [ 0.350612] ACPI: Interpreter enabled1004client # [ 0.363741] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1005lb # [ 0.356619] PCI: Using E820 reservations for host bridge windows1006worker2 # [ 0.351118] ACPI: PM: (supports S0 S3 S4 S5)1007lb # [ 0.357721] ACPI: Enabled 2 GPEs in block 00 to 3F1008client # [ 0.364624] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1009worker2 # [ 0.351684] ACPI: Using IOAPIC for interrupt routing1010client # [ 0.365697] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1011worker2 # [ 0.352565] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1012client # [ 0.366742] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1013client # [ 0.367992] PCI host bridge to bus 0000:001014client # [ 0.368624] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1015worker1 # [ 0.366476] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1016client # [ 0.369619] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1017worker2 # [ 0.357683] PCI: Using E820 reservations for host bridge windows1018client # [ 0.370619] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1019worker1 # [ 0.366751] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1020worker2 # [ 0.358780] ACPI: Enabled 2 GPEs in block 00 to 3F1021client # [ 0.371619] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1022worker1 # [ 0.367824] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1023lb # [ 0.366343] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1024client # [ 0.372619] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1025worker1 # [ 0.368868] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1026lb # [ 0.367176] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1027worker1 # [ 0.370125] PCI host bridge to bus 0000:001028client # [ 0.373619] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1029worker1 # [ 0.370749] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1030lb # [ 0.367710] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1031client # [ 0.374626] pci_bus 0000:00: root bus resource [bus 00-ff]1032worker1 # [ 0.371744] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1033lb # [ 0.368750] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1034client # [ 0.375690] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1035worker1 # [ 0.372745] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1036lb # [ 0.369952] PCI host bridge to bus 0000:001037lb # [ 0.370622] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1038worker1 # [ 0.373745] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1039client # [ 0.377097] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1040lb # [ 0.371618] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1041worker1 # [ 0.374744] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1042worker2 # [ 0.367404] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1043lb # [ 0.372618] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1044worker1 # [ 0.375745] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1045worker1 # [ 0.376751] pci_bus 0000:00: root bus resource [bus 00-ff]1046lb # [ 0.373618] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1047worker2 # [ 0.368795] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1048lb # [ 0.374619] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1049worker1 # [ 0.377693] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1050worker2 # [ 0.369782] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1051lb # [ 0.375618] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1052worker2 # [ 0.370808] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1053worker1 # [ 0.379250] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1054lb # [ 0.376619] pci_bus 0000:00: root bus resource [bus 00-ff]1055worker2 # [ 0.372060] PCI host bridge to bus 0000:001056lb # [ 0.377548] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1057client # [ 0.379699] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1058worker2 # [ 0.372687] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1059client # [ 0.380631] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1060worker2 # [ 0.373683] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1061lb # [ 0.379046] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1062client # [ 0.381603] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1063worker2 # [ 0.374683] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1064client # [ 0.382589] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1065worker2 # [ 0.375683] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1066worker2 # [ 0.376683] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1067client # [ 0.384321] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1068worker1 # [ 0.381823] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1069worker2 # [ 0.377683] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1070worker1 # [ 0.382757] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1071worker2 # [ 0.378684] pci_bus 0000:00: root bus resource [bus 00-ff]1072worker1 # [ 0.383744] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1073worker2 # [ 0.379712] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1074client # [ 0.386653] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1075lb # [ 0.381704] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1076client # [ 0.387530] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1077worker1 # [ 0.384975] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1078lb # [ 0.382632] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1079worker2 # [ 0.381123] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1080client # [ 0.388362] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1081lb # [ 0.383555] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1082client # [ 0.388625] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1083worker1 # [ 0.386511] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1084lb # [ 0.384588] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1085client # [ 0.390329] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1086worker1 # [ 0.388779] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1087lb # [ 0.386565] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1088worker1 # [ 0.389672] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1089client # [ 0.392656] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1090worker1 # [ 0.390510] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1091client # [ 0.393527] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1092worker1 # [ 0.390751] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1093worker2 # [ 0.383779] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1094client # [ 0.394387] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1095lb # [ 0.389652] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1096worker2 # [ 0.384695] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1097lb # [ 0.390507] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1098worker1 # [ 0.392295] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1099worker2 # [ 0.385646] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1100client # [ 0.396048] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1101lb # [ 0.391388] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1102lb # [ 0.392460] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1103worker2 # [ 0.386746] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1104worker1 # [ 0.393775] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1105worker1 # [ 0.394699] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1106lb # [ 0.393951] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1107worker2 # [ 0.388557] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1108client # [ 0.398701] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1109worker1 # [ 0.395539] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1110client # [ 0.399625] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1111client # [ 0.400634] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1112worker1 # [ 0.397185] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1113lb # [ 0.396648] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1114worker2 # [ 0.390716] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1115lb # [ 0.397467] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1116worker2 # [ 0.391711] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1117client # [ 0.402195] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118lb # [ 0.398381] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1119worker2 # [ 0.392624] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1120worker2 # [ 0.393563] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1121worker1 # [ 0.399777] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1122client # [ 0.403626] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1123lb # [ 0.399233] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1124worker1 # [ 0.400751] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1125client # [ 0.404462] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1126worker1 # [ 0.401697] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1127worker2 # [ 0.395053] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1128client # [ 0.405382] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1129worker1 # [ 0.403129] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1130worker2 # [ 0.397691] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1131client # [ 0.406212] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1132lb # [ 0.401625] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1133worker2 # [ 0.398530] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1134lb # [ 0.403286] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1135worker1 # [ 0.404777] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1136worker2 # [ 0.399477] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1137client # [ 0.407654] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1138worker1 # [ 0.405626] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1139lb # [ 0.403640] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1140client # [ 0.408498] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1141worker1 # [ 0.406488] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1142worker2 # [ 0.401122] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143client # [ 0.409372] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1144lb # [ 0.405170] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1145worker1 # [ 0.407324] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1146client # [ 0.410170] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1147lb # [ 0.407528] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1148worker2 # [ 0.403861] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1149worker1 # [ 0.408786] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1150lb # [ 0.408292] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1151worker2 # [ 0.404689] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1152client # [ 0.411664] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1153worker1 # [ 0.409678] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1154lb # [ 0.408641] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1155worker2 # [ 0.405603] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1156worker1 # [ 0.410430] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1157client # [ 0.412501] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1158client # [ 0.413641] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1159worker2 # [ 0.407094] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1160worker1 # [ 0.411305] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1161lb # [ 0.410157] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1162client # [ 0.415248] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1163worker2 # [ 0.408714] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1164lb # [ 0.412647] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1165worker1 # [ 0.413658] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1166worker2 # [ 0.409606] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1167client # [ 0.416626] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1168lb # [ 0.413524] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1169worker2 # [ 0.410425] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1170worker1 # [ 0.414372] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1171client # [ 0.417458] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1172lb # [ 0.414350] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1173worker1 # [ 0.414768] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1174client # [ 0.418337] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1175worker2 # [ 0.411223] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1176client # [ 0.418625] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1177lb # [ 0.415228] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1178worker1 # [ 0.416327] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1179worker2 # [ 0.412716] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1180client # [ 0.420148] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1181worker1 # [ 0.417778] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1182worker2 # [ 0.413653] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1183worker1 # [ 0.418655] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1184worker2 # [ 0.414443] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1185lb # [ 0.417653] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1186client # [ 0.421411] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1187worker1 # [ 0.419514] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1188lb # [ 0.419272] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1189client # [ 0.422305] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1190worker1 # [ 0.420549] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1191worker2 # [ 0.415291] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1192lb # [ 0.419640] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1193client # [ 0.423181] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1194lb # [ 0.421162] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1195worker1 # [ 0.422034] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1196worker2 # [ 0.417533] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1197client # [ 0.424665] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1198worker1 # [ 0.423613] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1199worker2 # [ 0.418683] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1200client # [ 0.425544] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1201lb # [ 0.423338] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1202worker1 # [ 0.424507] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1203worker2 # [ 0.419593] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1204lb # [ 0.423625] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1205client # [ 0.426355] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1206lb # [ 0.424563] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1207worker1 # [ 0.425283] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1208worker2 # [ 0.421059] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1209client # [ 0.427603] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1210lb # [ 0.425474] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1211worker1 # [ 0.426753] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1212worker2 # [ 0.422713] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1213client # [ 0.429627] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1214worker1 # [ 0.427635] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1215worker2 # [ 0.423574] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1216lb # [ 0.427161] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1217client # [ 0.430461] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1218worker1 # [ 0.428458] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1219worker2 # [ 0.424377] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1220client # [ 0.431349] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1221worker2 # [ 0.424688] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1222lb # [ 0.428656] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1223worker1 # [ 0.429305] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1224lb # [ 0.429640] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1225client # [ 0.432209] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1226worker2 # [ 0.426233] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1227client # [ 0.433319] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1228worker1 # [ 0.430777] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1229lb # [ 0.431161] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1230worker1 # [ 0.431616] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1231worker2 # [ 0.427453] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1232client # [ 0.433813] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1233worker1 # [ 0.432460] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1234worker2 # [ 0.427706] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1235lb # [ 0.433343] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1236client # [ 0.435137] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1237worker1 # [ 0.433306] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1238worker2 # [ 0.429229] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1239lb # [ 0.433625] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1240worker1 # [ 0.434321] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1241lb # [ 0.434642] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1242worker2 # [ 0.430732] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1243worker1 # [ 0.434939] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1244worker2 # [ 0.431633] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1245lb # [ 0.436186] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1246worker2 # [ 0.432443] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1247worker1 # [ 0.436798] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1248lb # [ 0.437652] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1249worker2 # [ 0.433767] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1250lb # [ 0.438518] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1251lb # [ 0.439415] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1252worker2 # [ 0.435710] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1253worker2 # [ 0.436583] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1254worker2 # [ 0.437444] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1255lb # [ 0.441114] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1256client # [ 0.435818] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1257worker2 # [ 0.438260] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1258lb # [ 0.442442] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1259client # [ 0.438159] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1260worker2 # [ 0.439239] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1261lb # [ 0.443463] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1262client # [ 0.438842] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1263lb # [ 0.445308] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1264client # [ 0.440131] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1265worker2 # [ 0.439915] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1266worker1 # [ 0.437847] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1267worker2 # [ 0.441251] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1268client # [ 0.440919] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1269worker1 # [ 0.440324] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1270client # [ 0.441904] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1271worker1 # [ 0.440981] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1272client # [ 0.442864] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1273worker1 # [ 0.442265] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1274client # [ 0.444459] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1275worker1 # [ 0.443043] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1276client # [ 0.445302] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1277worker1 # [ 0.444057] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1278client # [ 0.445958] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1279worker1 # [ 0.445028] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1280client # [ 0.447164] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1281worker1 # [ 0.446534] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1282lb # [ 0.445818] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1283worker1 # [ 0.446752] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1284worker2 # [ 0.441877] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1285lb # [ 0.448387] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1286client # [ 0.450764] ACPI: PCI: Interrupt link LNKA configured for IRQ 101287worker1 # [ 0.448027] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1288worker2 # [ 0.444233] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1289lb # [ 0.448926] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1290client # [ 0.451751] ACPI: PCI: Interrupt link LNKB configured for IRQ 101291worker1 # [ 0.449348] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1292worker2 # [ 0.444953] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1293client # [ 0.452719] ACPI: PCI: Interrupt link LNKC configured for IRQ 111294lb # [ 0.450339] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1295client # [ 0.453718] ACPI: PCI: Interrupt link LNKD configured for IRQ 111296worker2 # [ 0.446206] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1297lb # [ 0.450841] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1298client # [ 0.454717] ACPI: PCI: Interrupt link LNKE configured for IRQ 101299worker2 # [ 0.446932] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1300client # [ 0.455716] ACPI: PCI: Interrupt link LNKF configured for IRQ 101301worker1 # [ 0.453081] ACPI: PCI: Interrupt link LNKA configured for IRQ 101302lb # [ 0.451932] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1303client # [ 0.456720] ACPI: PCI: Interrupt link LNKG configured for IRQ 111304worker2 # [ 0.447998] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1305worker1 # [ 0.453853] ACPI: PCI: Interrupt link LNKB configured for IRQ 101306lb # [ 0.452882] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1307client # [ 0.457716] ACPI: PCI: Interrupt link LNKH configured for IRQ 111308worker1 # [ 0.454854] ACPI: PCI: Interrupt link LNKC configured for IRQ 111309worker2 # [ 0.448941] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1310client # [ 0.458656] ACPI: PCI: Interrupt link GSIA configured for IRQ 161311worker1 # [ 0.455847] ACPI: PCI: Interrupt link LNKD configured for IRQ 111312lb # [ 0.454672] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1313client # [ 0.459635] ACPI: PCI: Interrupt link GSIB configured for IRQ 171314worker2 # [ 0.450468] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1315worker1 # [ 0.456841] ACPI: PCI: Interrupt link LNKE configured for IRQ 101316lb # [ 0.455540] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1317client # [ 0.460601] ACPI: PCI: Interrupt link GSIC configured for IRQ 181318worker2 # [ 0.450690] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1319worker1 # [ 0.457843] ACPI: PCI: Interrupt link LNKF configured for IRQ 101320client # [ 0.461346] ACPI: PCI: Interrupt link GSID configured for IRQ 191321worker1 # [ 0.458841] ACPI: PCI: Interrupt link LNKG configured for IRQ 111322worker2 # [ 0.451937] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1323client # [ 0.461633] ACPI: PCI: Interrupt link GSIE configured for IRQ 201324lb # [ 0.457324] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1325worker1 # [ 0.459847] ACPI: PCI: Interrupt link LNKH configured for IRQ 111326client # [ 0.462574] ACPI: PCI: Interrupt link GSIF configured for IRQ 211327worker2 # [ 0.453266] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1328worker1 # [ 0.460780] ACPI: PCI: Interrupt link GSIA configured for IRQ 161329lb # [ 0.459411] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1330client # [ 0.463440] ACPI: PCI: Interrupt link GSIG configured for IRQ 221331worker1 # [ 0.461760] ACPI: PCI: Interrupt link GSIB configured for IRQ 171332client # [ 0.464364] ACPI: PCI: Interrupt link GSIH configured for IRQ 231333worker1 # [ 0.462748] ACPI: PCI: Interrupt link GSIC configured for IRQ 181334worker1 # [ 0.463731] ACPI: PCI: Interrupt link GSID configured for IRQ 191335client # [ 0.465599] iommu: Default domain type: Translated1336worker1 # [ 0.464509] ACPI: PCI: Interrupt link GSIE configured for IRQ 201337lb # [ 0.463251] ACPI: PCI: Interrupt link LNKA configured for IRQ 101338worker2 # [ 0.457077] ACPI: PCI: Interrupt link LNKA configured for IRQ 101339client # [ 0.466267] iommu: DMA domain TLB invalidation policy: lazy mode1340worker1 # [ 0.464758] ACPI: PCI: Interrupt link GSIF configured for IRQ 211341lb # [ 0.463754] ACPI: PCI: Interrupt link LNKB configured for IRQ 101342worker2 # [ 0.457790] ACPI: PCI: Interrupt link LNKB configured for IRQ 101343client # [ 0.466859] ACPI: bus type USB registered1344worker1 # [ 0.465680] ACPI: PCI: Interrupt link GSIG configured for IRQ 221345client # [ 0.467599] usbcore: registered new interface driver usbfs1346lb # [ 0.464745] ACPI: PCI: Interrupt link LNKC configured for IRQ 111347worker2 # [ 0.458785] ACPI: PCI: Interrupt link LNKC configured for IRQ 111348worker1 # [ 0.466473] ACPI: PCI: Interrupt link GSIH configured for IRQ 231349client # [ 0.468296] usbcore: registered new interface driver hub1350worker2 # [ 0.459781] ACPI: PCI: Interrupt link LNKD configured for IRQ 111351lb # [ 0.465717] ACPI: PCI: Interrupt link LNKD configured for IRQ 111352client # [ 0.468629] usbcore: registered new device driver usb1353worker2 # [ 0.460783] ACPI: PCI: Interrupt link LNKE configured for IRQ 101354lb # [ 0.466718] ACPI: PCI: Interrupt link LNKE configured for IRQ 101355worker1 # [ 0.467890] iommu: Default domain type: Translated1356client # [ 0.470283] NetLabel: Initializing1357worker2 # [ 0.461781] ACPI: PCI: Interrupt link LNKF configured for IRQ 101358lb # [ 0.467715] ACPI: PCI: Interrupt link LNKF configured for IRQ 101359worker1 # [ 0.468711] iommu: DMA domain TLB invalidation policy: lazy mode1360client # [ 0.470620] NetLabel: domain hash size = 1281361worker2 # [ 0.462782] ACPI: PCI: Interrupt link LNKG configured for IRQ 111362lb # [ 0.468718] ACPI: PCI: Interrupt link LNKG configured for IRQ 111363worker1 # [ 0.469758] ACPI: bus type USB registered1364client # [ 0.471347] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1365worker1 # [ 0.470452] usbcore: registered new interface driver usbfs1366worker2 # [ 0.463783] ACPI: PCI: Interrupt link LNKH configured for IRQ 111367client # [ 0.471652] NetLabel: unlabeled traffic allowed by default1368lb # [ 0.469716] ACPI: PCI: Interrupt link LNKH configured for IRQ 111369client # [ 0.472491] PCI: Using ACPI for IRQ routing1370worker1 # [ 0.470761] usbcore: registered new interface driver hub1371lb # [ 0.470656] ACPI: PCI: Interrupt link GSIA configured for IRQ 161372worker2 # [ 0.464720] ACPI: PCI: Interrupt link GSIA configured for IRQ 161373worker1 # [ 0.471615] usbcore: registered new device driver usb1374lb # [ 0.471586] ACPI: PCI: Interrupt link GSIB configured for IRQ 171375worker2 # [ 0.465690] ACPI: PCI: Interrupt link GSIB configured for IRQ 171376lb # [ 0.472361] ACPI: PCI: Interrupt link GSIC configured for IRQ 181377worker2 # [ 0.466675] ACPI: PCI: Interrupt link GSIC configured for IRQ 181378worker1 # [ 0.473227] NetLabel: Initializing1379worker1 # [ 0.473746] NetLabel: domain hash size = 1281380lb # [ 0.472633] ACPI: PCI: Interrupt link GSID configured for IRQ 191381worker2 # [ 0.467689] ACPI: PCI: Interrupt link GSID configured for IRQ 191382worker1 # [ 0.474484] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1383lb # [ 0.473601] ACPI: PCI: Interrupt link GSIE configured for IRQ 201384worker2 # [ 0.468646] ACPI: PCI: Interrupt link GSIE configured for IRQ 201385worker1 # [ 0.474780] NetLabel: unlabeled traffic allowed by default1386lb # [ 0.474346] ACPI: PCI: Interrupt link GSIF configured for IRQ 211387worker2 # [ 0.469412] ACPI: PCI: Interrupt link GSIF configured for IRQ 211388worker1 # [ 0.475663] PCI: Using ACPI for IRQ routing1389worker2 # [ 0.469695] ACPI: PCI: Interrupt link GSIG configured for IRQ 221390lb # [ 0.474631] ACPI: PCI: Interrupt link GSIG configured for IRQ 221391worker2 # [ 0.470668] ACPI: PCI: Interrupt link GSIH configured for IRQ 231392lb # [ 0.475630] ACPI: PCI: Interrupt link GSIH configured for IRQ 231393worker2 # [ 0.472514] iommu: Default domain type: Translated1394lb # [ 0.477691] iommu: Default domain type: Translated1395worker2 # [ 0.473313] iommu: DMA domain TLB invalidation policy: lazy mode1396lb # [ 0.478503] iommu: DMA domain TLB invalidation policy: lazy mode1397worker2 # [ 0.473943] ACPI: bus type USB registered1398lb # [ 0.479683] ACPI: bus type USB registered1399worker2 # [ 0.474753] usbcore: registered new interface driver usbfs1400lb # [ 0.480451] usbcore: registered new interface driver usbfs1401worker2 # [ 0.475685] usbcore: registered new interface driver hub1402lb # [ 0.481336] usbcore: registered new interface driver hub1403worker2 # [ 0.476594] usbcore: registered new device driver usb1404lb # [ 0.481629] usbcore: registered new device driver usb1405worker2 # [ 0.478434] NetLabel: Initializing1406lb # [ 0.483566] NetLabel: Initializing1407worker2 # [ 0.478684] NetLabel: domain hash size = 1281408lb # [ 0.484177] NetLabel: domain hash size = 1281409worker2 # [ 0.479430] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1410lb # [ 0.484618] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1411worker2 # [ 0.479721] NetLabel: unlabeled traffic allowed by default1412lb # [ 0.485670] NetLabel: unlabeled traffic allowed by default1413worker2 # [ 0.480674] PCI: Using ACPI for IRQ routing1414lb # [ 0.486631] PCI: Using ACPI for IRQ routing1415client # [ 0.517005] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416client # [ 0.517615] pci 0000:00:01.0: vgaarb: bridge control possible1417client # [ 0.517615] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418client # [ 0.517623] vgaarb: loaded1419client # [ 0.518391] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker1 # [ 0.520338] pci 0000:00:01.0: vgaarb: setting as boot VGA device1421client # [ 0.518619] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1422worker1 # [ 0.520741] pci 0000:00:01.0: vgaarb: bridge control possible1423worker1 # [ 0.520741] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1424worker1 # [ 0.520750] vgaarb: loaded1425worker1 # [ 0.521496] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01426worker1 # [ 0.521747] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1427client # [ 0.522704] clocksource: Switched to clocksource kvm-clock1428client # [ 0.526172] VFS: Disk quotas dquot_6.6.01429worker1 # [ 0.524837] clocksource: Switched to clocksource kvm-clock1430client # [ 0.526863] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1431client # [ 0.528318] pnp: PnP ACPI init1432client # [ 0.529126] ACPI: IRQ 4 override to edge(!), high(!)1433worker1 # [ 0.528343] VFS: Disk quotas dquot_6.6.01434client # [ 0.530146] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1435worker1 # [ 0.529091] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1436worker2 # [ 0.524606] pci 0000:00:01.0: vgaarb: setting as boot VGA device1437lb # [ 0.530820] pci 0000:00:01.0: vgaarb: setting as boot VGA device1438worker1 # [ 0.530417] pnp: PnP ACPI init1439worker2 # [ 0.524679] pci 0000:00:01.0: vgaarb: bridge control possible1440client # [ 0.531684] pnp: PnP ACPI: found 6 devices1441lb # [ 0.531614] pci 0000:00:01.0: vgaarb: bridge control possible1442worker1 # [ 0.531181] ACPI: IRQ 4 override to edge(!), high(!)1443worker2 # [ 0.524679] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1444lb # [ 0.531614] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1445worker2 # [ 0.524688] vgaarb: loaded1446worker1 # [ 0.532110] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1447lb # [ 0.531622] vgaarb: loaded1448worker2 # [ 0.525404] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01449worker1 # [ 0.533600] pnp: PnP ACPI: found 6 devices1450lb # [ 0.532346] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01451worker2 # [ 0.525683] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1452lb # [ 0.532620] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1453worker2 # [ 0.528773] clocksource: Switched to clocksource kvm-clock1454client # [ 0.539307] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1455client # [ 0.540843] clocksource: Switched to clocksource acpi_pm1456lb # [ 0.536705] clocksource: Switched to clocksource kvm-clock1457client # [ 0.541887] NET: Registered PF_INET protocol family1458worker2 # [ 0.532237] VFS: Disk quotas dquot_6.6.01459worker1 # [ 0.541227] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1460client # [ 0.543129] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1461worker2 # [ 0.532956] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1462worker1 # [ 0.542652] clocksource: Switched to clocksource acpi_pm1463lb # [ 0.540227] VFS: Disk quotas dquot_6.6.01464worker2 # [ 0.534320] pnp: PnP ACPI init1465worker1 # [ 0.543600] NET: Registered PF_INET protocol family1466lb # [ 0.540930] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1467worker2 # [ 0.535115] ACPI: IRQ 4 override to edge(!), high(!)1468lb # [ 0.542260] pnp: PnP ACPI init1469worker1 # [ 0.544798] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1470lb # [ 0.543050] ACPI: IRQ 4 override to edge(!), high(!)1471worker2 # [ 0.536157] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1472lb # [ 0.544018] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1473worker2 # [ 0.538176] pnp: PnP ACPI: found 6 devices1474lb # [ 0.545602] pnp: PnP ACPI: found 6 devices1475worker2 # [ 0.546194] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1476lb # [ 0.553263] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1477worker2 # [ 0.547726] clocksource: Switched to clocksource acpi_pm1478lb # [ 0.554687] clocksource: Switched to clocksource acpi_pm1479worker2 # [ 0.548740] NET: Registered PF_INET protocol family1480client # [ 0.559492] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1481lb # [ 0.555682] NET: Registered PF_INET protocol family1482worker2 # [ 0.549925] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1483client # [ 0.561016] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1484lb # [ 0.556870] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1485client # [ 0.562343] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1486worker1 # [ 0.561457] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1487client # [ 0.563732] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1488worker1 # [ 0.563013] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1489client # [ 0.565007] TCP: Hash tables configured (established 16384 bind 16384)1490worker1 # [ 0.564404] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1491client # [ 0.566152] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1492worker1 # [ 0.565767] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1493client # [ 0.567438] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1494worker1 # [ 0.567021] TCP: Hash tables configured (established 16384 bind 16384)1495client # [ 0.568519] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1496client # [ 0.569710] NET: Registered PF_UNIX/PF_LOCAL protocol family1497worker1 # [ 0.568183] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1498client # [ 0.570700] NET: Registered PF_XDP protocol family1499worker1 # [ 0.569481] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1500client # [ 0.571565] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1501worker1 # [ 0.570601] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1502client # [ 0.572638] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1503worker1 # [ 0.571836] NET: Registered PF_UNIX/PF_LOCAL protocol family1504client # [ 0.573667] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1505worker1 # [ 0.572822] NET: Registered PF_XDP protocol family1506client # [ 0.574831] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1507worker1 # [ 0.573655] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1508worker1 # [ 0.574653] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1509client # [ 0.575958] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1510worker1 # [ 0.575657] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1511client # [ 0.577068] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1512worker2 # [ 0.566680] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1513lb # [ 0.573428] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1514worker1 # [ 0.576745] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1515client # [ 0.578740] ACPI: \_SB_.GSIA: Enabled at IRQ 161516worker1 # [ 0.577815] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1517worker2 # [ 0.568238] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1518lb # [ 0.574940] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1519worker1 # [ 0.578895] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1520worker2 # [ 0.569513] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1521lb # [ 0.576210] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1522client # [ 0.581343] ACPI: \_SB_.GSIB: Enabled at IRQ 171523worker1 # [ 0.580573] ACPI: \_SB_.GSIA: Enabled at IRQ 161524worker2 # [ 0.570808] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1525lb # [ 0.577494] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1526worker2 # [ 0.572059] TCP: Hash tables configured (established 16384 bind 16384)1527client # [ 0.583224] ACPI: \_SB_.GSIC: Enabled at IRQ 181528lb # [ 0.578733] TCP: Hash tables configured (established 16384 bind 16384)1529worker1 # [ 0.582912] ACPI: \_SB_.GSIB: Enabled at IRQ 171530worker2 # [ 0.573254] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1531lb # [ 0.579841] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1532client # [ 0.585050] ACPI: \_SB_.GSID: Enabled at IRQ 191533worker2 # [ 0.574574] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1534lb # [ 0.581103] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1535worker1 # [ 0.585118] ACPI: \_SB_.GSIC: Enabled at IRQ 181536client # [ 0.586677] PCI: CLS 0 bytes, default 641537lb # [ 0.582177] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1538worker2 # [ 0.575779] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1539lb # [ 0.583344] NET: Registered PF_UNIX/PF_LOCAL protocol family1540worker2 # [ 0.576963] NET: Registered PF_UNIX/PF_LOCAL protocol family1541client # [ 0.587534] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1542worker1 # [ 0.587111] ACPI: \_SB_.GSID: Enabled at IRQ 191543lb # [ 0.584300] NET: Registered PF_XDP protocol family1544worker2 # [ 0.577920] NET: Registered PF_XDP protocol family1545client # [ 0.589212] Trying to unpack rootfs image as initramfs...1546lb # [ 0.585096] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1547worker2 # [ 0.578761] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1548worker1 # [ 0.588738] PCI: CLS 0 bytes, default 641549lb # [ 0.586080] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1550worker2 # [ 0.579753] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1551lb # [ 0.587101] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1552worker1 # [ 0.589639] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1553worker2 # [ 0.580751] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1554lb # [ 0.588184] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1555worker1 # [ 0.591395] Trying to unpack rootfs image as initramfs...1556worker2 # [ 0.581819] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1557lb # [ 0.589259] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1558worker2 # [ 0.582902] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1559lb # [ 0.590362] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1560worker2 # [ 0.584012] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1561lb # [ 0.592083] ACPI: \_SB_.GSIA: Enabled at IRQ 161562worker2 # [ 0.585815] ACPI: \_SB_.GSIA: Enabled at IRQ 161563lb # [ 0.594606] ACPI: \_SB_.GSIB: Enabled at IRQ 171564worker2 # [ 0.588504] ACPI: \_SB_.GSIB: Enabled at IRQ 171565lb # [ 0.596571] ACPI: \_SB_.GSIC: Enabled at IRQ 181566worker2 # [ 0.591072] ACPI: \_SB_.GSIC: Enabled at IRQ 181567lb # [ 0.598566] ACPI: \_SB_.GSID: Enabled at IRQ 191568worker2 # [ 0.593190] ACPI: \_SB_.GSID: Enabled at IRQ 191569lb # [ 0.600279] PCI: CLS 0 bytes, default 641570worker2 # [ 0.595071] PCI: CLS 0 bytes, default 641571lb # [ 0.601193] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1572worker2 # [ 0.596177] Trying to unpack rootfs image as initramfs...1573lb # [ 0.602980] Trying to unpack rootfs image as initramfs...1574worker2 # [ 0.602477] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575client # [ 0.632994] Initialise system trusted keyrings1576client # [ 0.636163] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker1 # [ 0.637163] Initialise system trusted keyrings1578worker1 # [ 0.640109] workingset: timestamp_bits=40 max_order=19 bucket_order=01579worker2 # [ 0.642549] Initialise system trusted keyrings1580lb # [ 0.649350] Initialise system trusted keyrings1581lb # [ 0.650354] workingset: timestamp_bits=40 max_order=19 bucket_order=01582worker2 # [ 0.646103] workingset: timestamp_bits=40 max_order=19 bucket_order=01583client # [ 0.658316] Key type asymmetric registered1584client # [ 0.659029] Asymmetric key parser 'x509' registered1585client # [ 0.659917] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1586worker1 # [ 0.661500] Key type asymmetric registered1587client # [ 0.663250] io scheduler mq-deadline registered1588client # [ 0.663988] io scheduler kyber registered1589worker1 # [ 0.664101] Asymmetric key parser 'x509' registered1590worker1 # [ 0.665683] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1591client # [ 0.667659] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1592client # [ 0.668924] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1593worker1 # [ 0.669231] io scheduler mq-deadline registered1594worker1 # [ 0.669988] io scheduler kyber registered1595client # [ 0.674199] Linux agpgart interface v0.1031596client # [ 0.674949] ACPI: bus type drm_connector registered1597worker1 # [ 0.673674] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1598worker1 # [ 0.674951] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1599lb # [ 0.673009] Key type asymmetric registered1600client # [ 0.677280] usbcore: registered new interface driver usbserial_generic1601lb # [ 0.673733] Asymmetric key parser 'x509' registered1602worker2 # [ 0.667532] Key type asymmetric registered1603client # [ 0.678332] usbserial: USB Serial support registered for generic1604lb # [ 0.674582] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1605worker2 # [ 0.669057] Asymmetric key parser 'x509' registered1606worker2 # [ 0.669928] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1607worker1 # [ 0.680354] Linux agpgart interface v0.1031608client # [ 0.681128] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1609client # [ 0.681128] Please enable it if your BIOS has the CPPC option.1610worker1 # [ 0.681191] ACPI: bus type drm_connector registered1611client # [ 0.683340] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1612lb # [ 0.680088] io scheduler mq-deadline registered1613lb # [ 0.680868] io scheduler kyber registered1614worker2 # [ 0.675207] io scheduler mq-deadline registered1615worker1 # [ 0.684471] usbcore: registered new interface driver usbserial_generic1616worker2 # [ 0.675980] io scheduler kyber registered1617worker1 # [ 0.685548] usbserial: USB Serial support registered for generic1618client # [ 0.687248] drop_monitor: Initializing network drop monitor service1619client # [ 0.688416] NET: Registered PF_INET6 protocol family1620lb # [ 0.684540] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1621lb # [ 0.685833] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1622worker2 # [ 0.679682] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1623worker1 # [ 0.689073] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1624worker1 # [ 0.689073] Please enable it if your BIOS has the CPPC option.1625worker2 # [ 0.680965] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1626worker1 # [ 0.691234] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1627client # [ 0.693243] Segment Routing with IPv61628client # [ 0.693878] In-situ OAM (IOAM) with IPv61629lb # [ 0.689751] Linux agpgart interface v0.1031630client # [ 0.694960] IPI shorthand broadcast: enabled1631lb # [ 0.690539] ACPI: bus type drm_connector registered1632worker2 # [ 0.684937] Linux agpgart interface v0.1031633worker2 # [ 0.685766] ACPI: bus type drm_connector registered1634worker1 # [ 0.695200] drop_monitor: Initializing network drop monitor service1635worker1 # [ 0.696351] NET: Registered PF_INET6 protocol family1636lb # [ 0.695067] usbcore: registered new interface driver usbserial_generic1637worker1 # [ 0.699163] Segment Routing with IPv61638lb # [ 0.696168] usbserial: USB Serial support registered for generic1639worker1 # [ 0.699835] In-situ OAM (IOAM) with IPv61640worker2 # [ 0.690527] usbcore: registered new interface driver usbserial_generic1641worker2 # [ 0.691674] usbserial: USB Serial support registered for generic1642client # [ 0.703242] sched_clock: Marking stable (570013758, 133088915)->(780612206, -77509533)1643lb # [ 0.698952] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1644worker1 # [ 0.703333] IPI shorthand broadcast: enabled1645lb # [ 0.698952] Please enable it if your BIOS has the CPPC option.1646lb # [ 0.701157] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1647worker2 # [ 0.695063] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1648worker2 # [ 0.695063] Please enable it if your BIOS has the CPPC option.1649client # [ 0.708334] registered taskstats version 11650worker2 # [ 0.697368] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1651lb # [ 0.704083] drop_monitor: Initializing network drop monitor service1652client # [ 0.709259] Loading compiled-in X.509 certificates1653lb # [ 0.705220] NET: Registered PF_INET6 protocol family1654worker1 # [ 0.709745] sched_clock: Marking stable (576016704, 133041345)->(783606672, -74548623)1655worker2 # [ 0.701204] drop_monitor: Initializing network drop monitor service1656lb # [ 0.708383] Segment Routing with IPv61657worker2 # [ 0.702435] NET: Registered PF_INET6 protocol family1658worker1 # [ 0.713245] registered taskstats version 11659lb # [ 0.710966] In-situ OAM (IOAM) with IPv61660worker1 # [ 0.714233] Loading compiled-in X.509 certificates1661worker2 # [ 0.705620] Segment Routing with IPv61662lb # [ 0.712005] IPI shorthand broadcast: enabled1663worker2 # [ 0.708069] In-situ OAM (IOAM) with IPv61664worker2 # [ 0.709202] IPI shorthand broadcast: enabled1665lb # [ 0.720166] sched_clock: Marking stable (587014089, 132914376)->(795301563, -75373098)1666client # [ 0.726126] Demotion targets for Node 0: null1667client # [ 0.727028] Key type .fscrypt registered1668client # [ 0.727757] Key type fscrypt-provisioning registered1669lb # [ 0.724163] registered taskstats version 11670client # [ 0.728705] ima: No TPM chip found, activating TPM-bypass!1671worker2 # [ 0.717473] sched_clock: Marking stable (583013924, 134026409)->(790902715, -73862382)1672lb # [ 0.725236] Loading compiled-in X.509 certificates1673worker2 # [ 0.722342] registered taskstats version 11674client # [ 0.733124] ima: Allocated hash algorithm: sha11675client # [ 0.734244] ima: No architecture policies found1676worker2 # [ 0.723450] Loading compiled-in X.509 certificates1677worker1 # [ 0.733070] Demotion targets for Node 0: null1678worker1 # [ 0.735116] Key type .fscrypt registered1679client # [ 0.737182] PM: Magic number: 10:369:8311680worker1 # [ 0.735798] Key type fscrypt-provisioning registered1681worker1 # [ 0.736740] ima: No TPM chip found, activating TPM-bypass!1682client # [ 0.738741] RAS: Correctable Errors collector initialized.1683worker1 # [ 0.741078] ima: Allocated hash algorithm: sha11684worker1 # [ 0.741873] ima: No architecture policies found1685worker1 # [ 0.744069] PM: Magic number: 10:369:8311686client # [ 0.746721] clk: Disabling unused clocks1687worker1 # [ 0.745751] RAS: Correctable Errors collector initialized.1688lb # [ 0.744944] Demotion targets for Node 0: null1689lb # [ 0.745839] Key type .fscrypt registered1690lb # [ 0.746533] Key type fscrypt-provisioning registered1691client # [ 0.751128] PM: genpd: Disabling unused power domains1692worker2 # [ 0.742071] Demotion targets for Node 0: null1693lb # [ 0.749056] ima: No TPM chip found, activating TPM-bypass!1694worker2 # [ 0.743005] Key type .fscrypt registered1695lb # [ 0.749969] ima: Allocated hash algorithm: sha11696lb # [ 0.750754] ima: No architecture policies found1697worker2 # [ 0.745056] Key type fscrypt-provisioning registered1698worker1 # [ 0.755734] clk: Disabling unused clocks1699worker2 # [ 0.746074] ima: No TPM chip found, activating TPM-bypass!1700worker2 # [ 0.747008] ima: Allocated hash algorithm: sha11701lb # [ 0.755116] PM: Magic number: 10:369:8311702worker1 # [ 0.758075] PM: genpd: Disabling unused power domains1703lb # [ 0.756681] RAS: Correctable Errors collector initialized.1704worker2 # [ 0.751089] ima: No architecture policies found1705worker2 # [ 0.752148] PM: Magic number: 10:369:8311706worker2 # [ 0.753923] RAS: Correctable Errors collector initialized.1707lb # [ 0.766607] clk: Disabling unused clocks1708lb # [ 0.768941] PM: genpd: Disabling unused power domains1709worker2 # [ 0.763773] clk: Disabling unused clocks1710worker2 # [ 0.767060] PM: genpd: Disabling unused power domains1711client # [ 0.910276] Freeing initrd memory: 29096K1712client # [ 0.913392] Freeing unused decrypted memory: 2028K1713client # [ 0.915942] Freeing unused kernel image (initmem) memory: 3644K1714client # [ 0.917066] Write protecting the kernel read-only data: 32768k1715client # [ 0.918957] Freeing unused kernel image (text/rodata gap) memory: 1208K1716client # [ 0.920492] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker1 # [ 0.924927] Freeing initrd memory: 29092K1718worker1 # [ 0.928080] Freeing unused decrypted memory: 2028K1719worker1 # [ 0.930647] Freeing unused kernel image (initmem) memory: 3644K1720worker1 # [ 0.931768] Write protecting the kernel read-only data: 32768k1721lb # [ 0.930047] Freeing initrd memory: 29092K1722worker1 # [ 0.933657] Freeing unused kernel image (text/rodata gap) memory: 1208K1723worker1 # [ 0.935210] Freeing unused kernel image (rodata/data gap) memory: 752K1724lb # [ 0.933204] Freeing unused decrypted memory: 2028K1725lb # [ 0.935818] Freeing unused kernel image (initmem) memory: 3644K1726worker2 # [ 0.929755] Freeing initrd memory: 29092K1727lb # [ 0.936935] Write protecting the kernel read-only data: 32768k1728lb # [ 0.938790] Freeing unused kernel image (text/rodata gap) memory: 1208K1729worker2 # [ 0.933102] Freeing unused decrypted memory: 2028K1730lb # [ 0.940314] Freeing unused kernel image (rodata/data gap) memory: 752K1731worker2 # [ 0.935956] Freeing unused kernel image (initmem) memory: 3644K1732worker2 # [ 0.937111] Write protecting the kernel read-only data: 32768k1733worker2 # [ 0.939095] Freeing unused kernel image (text/rodata gap) memory: 1208K1734worker2 # [ 0.940676] Freeing unused kernel image (rodata/data gap) memory: 752K1735client # [ 0.971818] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736client # [ 0.972940] Run /init as init process1737client # [ 0.982941] systemd[1]: Inserted module 'autofs4'1738worker1 # [ 0.986510] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739worker1 # [ 0.987622] Run /init as init process1740lb # [ 0.991466] x86/mm: Checked W+X mappings: passed, no W+X pages found.1741lb # [ 0.992629] Run /init as init process1742client # [ 0.999208] fuse: init (API version 7.45)1743worker1 # [ 0.997790] systemd[1]: Inserted module 'autofs4'1744worker2 # [ 0.993528] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745client # [ 1.004925] ACPI: \_SB_.GSIG: Enabled at IRQ 221746worker2 # [ 0.994656] Run /init as init process1747client # [ 1.007544] ACPI: \_SB_.GSIH: Enabled at IRQ 231748lb # [ 1.003219] systemd[1]: Inserted module 'autofs4'1749client # [ 1.011357] ACPI: \_SB_.GSIE: Enabled at IRQ 201750client # [ 1.013797] ACPI: \_SB_.GSIF: Enabled at IRQ 211751worker1 # [ 1.014122] fuse: init (API version 7.45)1752worker2 # [ 1.005263] systemd[1]: Inserted module 'autofs4'1753worker1 # [ 1.019973] ACPI: \_SB_.GSIG: Enabled at IRQ 221754lb # [ 1.019375] fuse: init (API version 7.45)1755worker1 # [ 1.022328] ACPI: \_SB_.GSIH: Enabled at IRQ 231756worker1 # [ 1.026284] ACPI: \_SB_.GSIE: Enabled at IRQ 201757lb # [ 1.025107] ACPI: \_SB_.GSIG: Enabled at IRQ 221758worker1 # [ 1.029031] ACPI: \_SB_.GSIF: Enabled at IRQ 211759lb # [ 1.027397] ACPI: \_SB_.GSIH: Enabled at IRQ 231760worker2 # [ 1.021988] fuse: init (API version 7.45)1761lb # [ 1.030472] ACPI: \_SB_.GSIE: Enabled at IRQ 201762lb # [ 1.032657] ACPI: \_SB_.GSIF: Enabled at IRQ 211763worker2 # [ 1.027933] ACPI: \_SB_.GSIG: Enabled at IRQ 221764client # [ 1.040319] systemd[1]: Successfully made /usr/ read-only.1765worker2 # [ 1.030785] ACPI: \_SB_.GSIH: Enabled at IRQ 231766worker2 # [ 1.034159] ACPI: \_SB_.GSIE: Enabled at IRQ 201767worker2 # [ 1.036554] ACPI: \_SB_.GSIF: Enabled at IRQ 211768worker1 # [ 1.059141] systemd[1]: Successfully made /usr/ read-only.1769lb # [ 1.057652] systemd[1]: Successfully made /usr/ read-only.1770worker2 # [ 1.064126] systemd[1]: Successfully made /usr/ read-only.1771client # [ 1.376872] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772client # [ 1.388849] systemd[1]: Detected virtualization kvm.1773client # [ 1.390978] systemd[1]: Detected architecture x86-64.1774client # [ 1.393153] systemd[1]: Running in initrd.1775client # [ 1.395767] systemd[1]: Initializing machine ID from random generator.1776client # [ 1.398682] systemd[1]: Hostname set to <client>.1777lb # [ 1.393274] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778lb # [ 1.398229] systemd[1]: Detected virtualization kvm.1779lb # [ 1.399116] systemd[1]: Detected architecture x86-64.1780lb # [ 1.399974] systemd[1]: Running in initrd.1781lb # [ 1.401135] systemd[1]: Initializing machine ID from random generator.1782lb # [ 1.402332] systemd[1]: Hostname set to <lb>.1783worker1 # [ 1.395902] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784worker1 # [ 1.407983] systemd[1]: Detected virtualization kvm.1785worker1 # [ 1.410162] systemd[1]: Detected architecture x86-64.1786worker1 # [ 1.412266] systemd[1]: Running in initrd.1787worker1 # [ 1.414811] systemd[1]: Initializing machine ID from random generator.1788worker1 # [ 1.417773] systemd[1]: Hostname set to <worker1>.1789worker2 # [ 1.400642] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker2 # [ 1.412685] systemd[1]: Detected virtualization kvm.1791worker2 # [ 1.414818] systemd[1]: Detected architecture x86-64.1792worker2 # [ 1.416982] systemd[1]: Running in initrd.1793worker2 # [ 1.419601] systemd[1]: Initializing machine ID from random generator.1794worker2 # [ 1.422473] systemd[1]: Hostname set to <worker2>.1795lb # [ 1.595044] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796client # [ 1.601649] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker1 # [ 1.627679] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798lb # [ 1.633566] systemd[1]: Queued start job for default target Initrd Default Target.1799client # [ 1.641971] systemd[1]: Queued start job for default target Initrd Default Target.1800lb # [ 1.638223] systemd[1]: Created slice Slice /system/modprobe.1801lb # [ 1.639437] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1802lb # [ 1.640879] systemd[1]: Expecting device /dev/disk/by-label/nixos...1803lb # [ 1.642002] systemd[1]: Reached target Path Units.1804client # [ 1.646519] systemd[1]: Created slice Slice /system/modprobe.1805lb # [ 1.642886] systemd[1]: Reached target Slice Units.1806lb # [ 1.643771] systemd[1]: Reached target Swaps.1807client # [ 1.647753] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1808lb # [ 1.644595] systemd[1]: Reached target Timer Units.1809client # [ 1.649200] systemd[1]: Expecting device /dev/disk/by-label/nixos...1810lb # [ 1.645600] systemd[1]: Listening on D-Bus System Message Bus Socket.1811client # [ 1.650321] systemd[1]: Reached target Path Units.1812client # [ 1.651201] systemd[1]: Reached target Slice Units.1813lb # [ 1.646887] systemd[1]: Listening on Journal Socket (/dev/log).1814client # [ 1.652060] systemd[1]: Reached target Swaps.1815lb # [ 1.648081] systemd[1]: Listening on Journal Sockets.1816client # [ 1.652882] systemd[1]: Reached target Timer Units.1817lb # [ 1.649078] systemd[1]: Listening on udev Control Socket.1818client # [ 1.653917] systemd[1]: Listening on D-Bus System Message Bus Socket.1819worker2 # [ 1.641772] systemd[1]: bpf-restrict-fs: LSM BPF program attached1820lb # [ 1.650122] systemd[1]: Listening on udev Kernel Socket.1821client # [ 1.655180] systemd[1]: Listening on Journal Socket (/dev/log).1822lb # [ 1.651044] systemd[1]: Reached target Socket Units.1823client # [ 1.656366] systemd[1]: Listening on Journal Sockets.1824client # [ 1.657408] systemd[1]: Listening on udev Control Socket.1825lb # [ 1.652822] systemd[1]: Starting Create List of Static Device Nodes...1826client # [ 1.658493] systemd[1]: Listening on udev Kernel Socket.1827client # [ 1.659494] systemd[1]: Reached target Socket Units.1828lb # [ 1.656806] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1829client # [ 1.661393] systemd[1]: Starting Create List of Static Device Nodes...1830client # [ 1.665190] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1831lb # [ 1.664105] systemd[1]: Starting Load Kernel Module configfs...1832worker1 # [ 1.668552] systemd[1]: Queued start job for default target Initrd Default Target.1833client # [ 1.673186] systemd[1]: Starting Load Kernel Module configfs...1834worker1 # [ 1.672408] systemd[1]: Created slice Slice /system/modprobe.1835worker1 # [ 1.673601] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1836worker1 # [ 1.675066] systemd[1]: Expecting device /dev/disk/by-label/nixos...1837worker1 # [ 1.676200] systemd[1]: Reached target Path Units.1838worker1 # [ 1.677164] systemd[1]: Reached target Slice Units.1839worker1 # [ 1.678064] systemd[1]: Reached target Swaps.1840worker1 # [ 1.678858] systemd[1]: Reached target Timer Units.1841worker1 # [ 1.679890] systemd[1]: Listening on D-Bus System Message Bus Socket.1842lb # [ 1.677151] systemd[1]: Starting Journal Service...1843worker1 # [ 1.681136] systemd[1]: Listening on Journal Socket (/dev/log).1844worker1 # [ 1.682329] systemd[1]: Listening on Journal Sockets.1845worker1 # [ 1.683365] systemd[1]: Listening on udev Control Socket.1846worker1 # [ 1.684425] systemd[1]: Listening on udev Kernel Socket.1847worker1 # [ 1.685427] systemd[1]: Reached target Socket Units.1848worker1 # [ 1.687341] systemd[1]: Starting Create List of Static Device Nodes...1849client # [ 1.689807] systemd[1]: Starting Journal Service...1850worker1 # [ 1.691126] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1851lb # [ 1.690000] systemd[1]: Starting Load Kernel Modules...1852worker1 # [ 1.700127] systemd[1]: Starting Load Kernel Module configfs...1853client # [ 1.703217] systemd[1]: Starting Load Kernel Modules...1854worker2 # [ 1.696122] systemd[1]: Queued start job for default target Initrd Default Target.1855worker2 # [ 1.699376] systemd[1]: Created slice Slice /system/modprobe.1856worker2 # [ 1.700532] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1857lb # [ 1.696058] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1858worker2 # [ 1.701889] systemd[1]: Expecting device /dev/disk/by-label/nixos...1859worker2 # [ 1.702952] systemd[1]: Reached target Path Units.1860worker2 # [ 1.703810] systemd[1]: Reached target Slice Units.1861worker2 # [ 1.704713] systemd[1]: Reached target Swaps.1862worker2 # [ 1.705517] systemd[1]: Reached target Timer Units.1863worker1 # [ 1.715714] systemd[1]: Starting Journal Service...1864worker2 # [ 1.706443] systemd[1]: Listening on D-Bus System Message Bus Socket.1865lb # [ 1.713828] netfs: FS-Cache loaded1866worker2 # [ 1.707585] systemd[1]: Listening on Journal Socket (/dev/log).1867worker2 # [ 1.708702] systemd[1]: Listening on Journal Sockets.1868worker2 # [ 1.709651] systemd[1]: Listening on udev Control Socket.1869worker2 # [ 1.710621] systemd[1]: Listening on udev Kernel Socket.1870worker2 # [ 1.711526] systemd[1]: Reached target Socket Units.1871client # [ 1.710203] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1872lb # [ 1.718556] 9pnet: Installing 9P2000 support1873worker2 # [ 1.713258] systemd[1]: Starting Create List of Static Device Nodes...1874client # [ 1.725899] netfs: FS-Cache loaded1875worker2 # [ 1.716883] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1876client # [ 1.730842] 9pnet: Installing 9P2000 support1877worker1 # [ 1.730179] systemd[1]: Starting Load Kernel Modules...1878lb # [ 1.730045] systemd[1]: Starting Coldplug All udev Devices...1879worker2 # [ 1.727161] systemd[1]: Starting Load Kernel Module configfs...1880client # [ 1.741340] systemd[1]: Starting Coldplug All udev Devices...1881worker2 # [ 1.736712] systemd[1]: Starting Journal Service...1882worker1 # [ 1.735148] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1883lb # [ 1.747020] systemd[1]: Finished Create List of Static Device Nodes.1884worker1 # [ 1.750796] netfs: FS-Cache loaded1885worker1 # [ 1.755620] 9pnet: Installing 9P2000 support1886client # [ 1.757233] systemd[1]: Finished Create List of Static Device Nodes.1887lb # [ 1.754995] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1888client # [ 1.761759] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1889worker2 # [ 1.752116] systemd[1]: Starting Load Kernel Modules...1890lb # [ 1.761714] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1891worker1 # [ 1.764938] systemd[1]: Starting Coldplug All udev Devices...1892lb # [ 1.763192] systemd-journald[67]: Collecting audit messages is disabled.1893client # [ 1.769516] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1894lb # [ 1.768252] systemd[1]: modprobe@configfs.service: Deactivated successfully.1895client # [ 1.773757] systemd-journald[67]: Collecting audit messages is disabled.1896client # [ 1.775389] systemd[1]: modprobe@configfs.service: Deactivated successfully.1897lb # [ 1.773327] systemd[1]: Finished Load Kernel Module configfs.1898worker2 # [ 1.756112] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1899worker1 # [ 1.780166] systemd[1]: Finished Create List of Static Device Nodes.1900client # [ 1.783461] systemd[1]: Finished Load Kernel Module configfs.1901lb # [ 1.778483] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1902worker2 # [ 1.773324] netfs: FS-Cache loaded1903lb # [ 1.782856] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1904worker1 # [ 1.786697] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1905client # [ 1.787611] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1906worker2 # [ 1.778055] 9pnet: Installing 9P2000 support1907client # [ 1.792169] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1908lb # [ 1.791151] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1909worker1 # [ 1.794499] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1910lb # [ 1.792671] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1911worker1 # [ 1.796956] systemd-journald[67]: Collecting audit messages is disabled.1912worker2 # [ 1.788248] systemd[1]: Starting Coldplug All udev Devices...1913client # [ 1.799195] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1914client # [ 1.800523] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1915worker1 # [ 1.800499] systemd[1]: modprobe@configfs.service: Deactivated successfully.1916worker1 # [ 1.807270] systemd[1]: Finished Load Kernel Module configfs.1917worker2 # [ 1.802144] systemd[1]: Finished Create List of Static Device Nodes.1918worker1 # [ 1.811913] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1919worker1 # [ 1.814378] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1920worker2 # [ 1.807813] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1921worker1 # [ 1.823267] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1922worker2 # [ 1.815090] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1923worker1 # [ 1.826233] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1924client # [ 1.829670] systemd[1]: Finished Load Kernel Modules.1925lb # [ 1.825513] systemd[1]: Finished Load Kernel Modules.1926worker2 # [ 1.821140] systemd-journald[67]: Collecting audit messages is disabled.1927worker2 # [ 1.822643] systemd[1]: modprobe@configfs.service: Deactivated successfully.1928client # [ 1.837193] systemd[1]: Starting Apply Kernel Variables...1929lb # [ 1.834658] systemd[1]: Starting Apply Kernel Variables...1930worker2 # [ 1.828432] systemd[1]: Finished Load Kernel Module configfs.1931worker2 # [ 1.833505] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1932client # [ 1.847241] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1933worker2 # [ 1.835798] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1934lb # [ 1.847035] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1935worker1 # [ 1.854718] systemd[1]: Finished Load Kernel Modules.1936worker2 # [ 1.845262] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1937client # [ 1.857326] systemd[1]: Starting Create Static Device Nodes in /dev...1938worker2 # [ 1.846536] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1939lb # [ 1.856646] systemd[1]: Starting Create Static Device Nodes in /dev...1940worker1 # [ 1.863313] systemd[1]: Starting Apply Kernel Variables...1941client # [ 1.873220] systemd[1]: Finished Apply Kernel Variables.1942worker1 # [ 1.874616] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1943lb # [ 1.876819] systemd[1]: Finished Apply Kernel Variables.1944worker2 # [ 1.874567] systemd[1]: Finished Load Kernel Modules.1945worker1 # [ 1.885261] systemd[1]: Starting Create Static Device Nodes in /dev...1946lb # [ 1.884514] systemd[1]: Started Journal Service.1947lb # [ 1.752653] systemd-modules-load[68]: Inserted module 'dm_mod'1948client # [ 1.756608] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.890769] systemd[1]: Started Journal Service.1949lb # [ 1.754294] systemd-modules-load[68]: Inserted module 'virtio_balloon'1950worker2 # [ 1.881247] systemd[1]: Starting Apply Kernel Variables...1951client # 1952client # [ 1.760302] systemd-modules-load[68]: Inserted module 'virtio_balloon'1953lb # [ 1.756291] systemd-modules-load[68]: Inserted module 'virtio_gpu'1954client # [ 1.762275] systemd-modules-load[68]: Inserted module 'virtio_gpu'1955client # [ 1.763312] systemd[1]: Finished Create Static Device Nodes in /dev.1956client # [ 1.764443] systemd[1]: Reached target Preparation for Local File Systems.1957client # [ 1.766272] systemd[1]: Reached target Local File Systems.1958worker1 # [ 1.898662] systemd[1]: Finished Apply Kernel Variables.1959client # [ 1.769056] systemd[1]: Starting Create System Files and Directories...1960lb # [ 1.764867] systemd[1]: Finished Create Static Device Nodes in /dev.1961worker2 # [ 1.892176] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1962lb # [ 1.770073] systemd[1]: Reached target Preparation for Local File Systems.1963client # [ 1.774925] systemd[1]: Starting Rule-based Manager for Device Events and Files...1964lb # [ 1.771242] systemd[1]: Reached target Local File Systems.1965lb # [ 1.775046] systemd[1]: Starting Create System Files and Directories...1966worker2 # [ 1.901334] systemd[1]: Starting Create Static Device Nodes in /dev...1967worker1 # [ 1.914992] systemd[1]: Started Journal Service.1968lb # [ 1.782069] systemd[1]: Starting Rule-based Manager for Device Events and Files...1969worker1 # [ 1.785236] systemd-modules-load[68]: Inserted module 'dm_mod'1970worker1 # [ 1.786647] systemd-modules-load[68]: Inserted module 'virtio_balloon'1971worker1 # [ 1.790167] systemd-modules-load[68]: Inserted module 'virtio_gpu'1972worker1 # [ 1.795109] systemd[1]: Finished Create Static Device Nodes in /dev.1973worker2 # [ 1.921230] systemd[1]: Finished Apply Kernel Variables.1974worker1 # [ 1.801121] systemd[1]: Reached target Preparation for Local File Systems.1975worker1 # [ 1.802119] systemd[1]: Reached target Local File Systems.1976client # [ 1.805221] systemd[1]: Finished Create System Files and Directories.1977worker1 # [ 1.805091] systemd[1]: Starting Create System Files and Directories...1978lb # [ 1.805421] systemd[1]: Finished Create System Files and Directories.1979worker1 # [ 1.810080] systemd[1]: Starting Rule-based Manager for Device Events and Files...1980worker2 # [ 1.934967] systemd[1]: Started Journal Service.1981worker2 # [ 1.803667] systemd-modules-load[68]: Inserted module 'dm_mod'1982worker2 # [ 1.806471] systemd-modules-load[68]: Inserted module 'virtio_balloon'1983worker2 # [ 1.808349] systemd-modules-load[68]: Inserted module 'virtio_gpu'1984worker2 # [ 1.810179] systemd[1]: Finished Create Static Device Nodes in /dev.1985worker2 # [ 1.811426] systemd[1]: Reached target Preparation for Local File Systems.1986worker2 # [ 1.813326] systemd[1]: Reached target Local File Systems.1987worker2 # [ 1.815266] systemd[1]: Starting Create System Files and Directories...1988client # [ 1.827738] systemd-udevd[76]: Using default interface naming scheme 'v261'.1989lb # [ 1.827250] systemd-udevd[83]: Using default interface naming scheme 'v261'.1990worker2 # [ 1.819977] systemd[1]: Starting Rule-based Manager for Device Events and Files...1991worker1 # [ 1.837163] systemd[1]: Finished Create System Files and Directories.1992client # [ 1.851823] systemd[1]: Started Rule-based Manager for Device Events and Files.1993lb # [ 1.852329] systemd[1]: Started Rule-based Manager for Device Events and Files.1994worker1 # [ 1.859939] systemd-udevd[84]: Using default interface naming scheme 'v261'.1995worker2 # [ 1.853195] systemd[1]: Finished Create System Files and Directories.1996worker1 # [ 1.884727] systemd[1]: Started Rule-based Manager for Device Events and Files.1997worker2 # [ 1.875431] systemd-udevd[76]: Using default interface naming scheme 'v261'.1998client # [ 1.902646] systemd[1]: Finished Coldplug All udev Devices.1999client # [ 1.903603] systemd[1]: Reached target System Initialization.2000client # [ 1.904440] systemd[1]: Reached target Basic System.
loading 1,950 hidden lines…
3951lb # [ 13.294515] systemd[1]: Reached target PostgreSQL.3952lb # [ 16.501248] dhcpcd[704]: eth0: leased 10.0.2.15 for 86400 seconds3953lb # [ 16.502127] dhcpcd[704]: eth0: adding route to 10.0.2.0/243954lb # [ 16.502827] dhcpcd[704]: eth0: adding default route via 10.0.2.23955lb # [ 16.600312] systemd[1]: Started DHCP Client.3956lb # [ 16.602093] systemd[1]: Reached target Network is Online.3957lb # [ 16.606107] systemd[1]: Started Envoy reverse proxy.3958lb # [ 16.609606] systemd[1]: Started mock-oidc.service.3959lb # [ 16.709422] mock-oidc-server[911]: Mock OIDC Server running3960lb # [ 16.710745] mock-oidc-server[911]: OIDC Address: 192.168.1.2:80803961lb # [ 16.711919] mock-oidc-server[911]: Issue Address: 0.0.0.0:80813962lb # [ 16.713046] mock-oidc-server[911]: Issuer: http://192.168.1.2:8080/oidc3963lb # [ 16.713910] mock-oidc-server[911]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3964lb # [ 16.715114] mock-oidc-server[911]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3965lb # [ 16.716469] mock-oidc-server[911]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3966worker1 # [ 16.722212] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds3967worker1 # [ 16.723387] dhcpcd[695]: eth0: adding route to 10.0.2.0/243968worker1 # [ 16.724396] dhcpcd[695]: eth0: adding default route via 10.0.2.23969worker1 # [ 16.818877] systemd[1]: Started DHCP Client.3970worker1 # [ 16.821098] systemd[1]: Reached target Multi-User System.3971worker1 # [ 16.821885] systemd[1]: Startup finished in 858ms (kernel) + 3.912s (initrd) + 12.050s (userspace) = 16.820s.3972worker2 # [ 17.111805] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3973worker2 # [ 17.114781] dhcpcd[692]: eth0: adding route to 10.0.2.0/243974worker2 # [ 17.117102] dhcpcd[692]: eth0: adding default route via 10.0.2.23975lb # [ 17.181265] envoy[910]: [2026-09-20 10:50:46.426][910][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3976lb # [ 17.183109] envoy[910]: [2026-09-20 10:50:46.426][910][info][main] [source/server/server.cc:469] statically linked extensions:3977lb # [ 17.184650] envoy[910]: [2026-09-20 10:50:46.426][910][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3978lb # [ 17.187151] envoy[910]: [2026-09-20 10:50:46.426][910][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3979lb # [ 17.188931] envoy[910]: [2026-09-20 10:50:46.426][910][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3980lb # [ 17.191682] envoy[910]: [2026-09-20 10:50:46.426][910][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3981lb # [ 17.194515] envoy[910]: [2026-09-20 10:50:46.426][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23982lb # [ 17.196071] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3983lb # [ 17.199961] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3984lb # [ 17.202061] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3985lb # [ 17.203853] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3986lb # [ 17.205975] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3987lb # [ 17.210344] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3988lb # [ 17.213113] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3989lb # [ 17.214898] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3990lb # [ 17.217163] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3991lb # [ 17.219099] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3992lb # [ 17.220867] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3993lb # [ 17.222597] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3994lb # [ 17.225604] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3995lb # [ 17.227320] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3996worker2 # [ 17.227466] systemd[1]: Started DHCP Client.3997worker2 # [ 17.229342] systemd[1]: Reached target Multi-User System.3998lb # [ 17.232094] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3999worker2 # [ 17.230338] systemd[1]: Startup finished in 864ms (kernel) + 4.150s (initrd) + 12.214s (userspace) = 17.229s.4000lb # [ 17.248854] envoy[910]: [2026-09-20 10:50:46.427][910][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4001lb # [ 17.251860] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4002lb # [ 17.255070] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4003lb # [ 17.257504] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4004lb # [ 17.259938] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24005lb # [ 17.261446] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4006lb # [ 17.263674] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4007lb # [ 17.267760] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4008lb # [ 17.270093] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4009lb # [ 17.272760] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4010lb # [ 17.276874] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14011lb # [ 17.279513] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4012lb # [ 17.281769] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24013lb # [ 17.284951] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4014lb # [ 17.287715] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4015lb # [ 17.289587] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4016lb # [ 17.295419] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4017lb # [ 17.298150] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4018lb # [ 17.300486] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4019lb # [ 17.303085] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4020lb # [ 17.306774] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4021lb # [ 17.308489] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4022lb # [ 17.312666] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4023lb # [ 17.314300] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4024lb # [ 17.315797] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4025lb # [ 17.318594] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4026lb # [ 17.322146] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4027lb # [ 17.324089] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4028lb # [ 17.326271] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4029lb # [ 17.332160] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4030lb # [ 17.343085] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4031lb # [ 17.345555] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4032lb # [ 17.347790] envoy[910]: [2026-09-20 10:50:46.430][910][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4033lb # [ 17.356848] envoy[910]: [2026-09-20 10:50:46.431][910][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4034lb # [ 17.362462] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4035lb # [ 17.365183] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4036lb # [ 17.367883] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4037lb # [ 17.370109] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4038lb # [ 17.372886] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4039lb # [ 17.374786] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4040lb # [ 17.377428] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4041lb # [ 17.379139] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4042lb # [ 17.380925] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4043lb # [ 17.388272] envoy[910]: [2026-09-20 10:50:46.434][910][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4044lb # [ 17.390121] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4045lb # [ 17.391668] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4046lb # [ 17.396813] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4047lb # [ 17.401270] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4048lb # [ 17.403934] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4049lb # [ 17.405960] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84050lb # [ 17.407836] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4051lb # [ 17.410086] envoy[910]: [2026-09-20 10:50:46.437][910][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4052lb # [ 17.412170] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4053lb # [ 17.414120] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4054lb # [ 17.416082] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4055lb # [ 17.420175] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4056lb # [ 17.421985] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4057lb # [ 17.424145] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4058lb # [ 17.426462] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4059lb # [ 17.428467] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4060lb # [ 17.454303] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4061lb # [ 17.456684] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4062lb # [ 17.458564] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4063lb # [ 17.460319] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4064lb # [ 17.462663] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4065lb # [ 17.464828] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4066lb # [ 17.466559] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4067lb # [ 17.468723] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4068lb # [ 17.471042] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4069lb # [ 17.472955] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4070lb # [ 17.474848] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4071lb # [ 17.476627] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4072lb # [ 17.479197] envoy[910]: [2026-09-20 10:50:46.440][910][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4073lb # [ 17.481587] envoy[910]: [2026-09-20 10:50:46.445][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4074lb # [ 17.483666] envoy[910]: [2026-09-20 10:50:46.445][910][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4075lb # [ 17.486173] envoy[910]: [2026-09-20 10:50:46.445][910][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4076lb # [ 17.488691] envoy[910]: [2026-09-20 10:50:46.445][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4077lb # [ 17.491207] envoy[910]: [2026-09-20 10:50:46.446][910][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4078lb # [ 17.493930] envoy[910]: [2026-09-20 10:50:46.446][910][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4079lb # [ 17.497126] envoy[910]: [2026-09-20 10:50:46.448][910][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4080lb # [ 17.503232] envoy[910]: [2026-09-20 10:50:46.448][910][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4081lb # [ 17.504891] envoy[910]: [2026-09-20 10:50:46.448][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4082lb # [ 17.506854] envoy[910]: [2026-09-20 10:50:46.448][910][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4083lb # [ 17.511648] envoy[910]: [2026-09-20 10:50:46.448][910][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4084lb # [ 17.513542] envoy[910]: [2026-09-20 10:50:46.569][910][info][main] [source/server/server.cc:531] HTTP header map info:4085lb # [ 17.514950] envoy[910]: [2026-09-20 10:50:46.649][910][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4086lb # [ 17.528296] envoy[910]: [2026-09-20 10:50:46.649][910][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4087lb # [ 17.530206] envoy[910]: [2026-09-20 10:50:46.649][910][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4088lb # [ 17.537834] envoy[910]: [2026-09-20 10:50:46.649][910][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4089lb # [ 17.579120] envoy[910]: [2026-09-20 10:50:46.825][910][info][main] [source/server/server.cc:968] runtime: {}4090lb # [ 17.587973] envoy[910]: [2026-09-20 10:50:46.834][910][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4091lb # [ 17.590564] envoy[910]: [2026-09-20 10:50:46.836][910][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014092lb # [ 17.593212] envoy[910]: [2026-09-20 10:50:46.839][910][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014093lb # [ 17.596596] envoy[910]: [2026-09-20 10:50:46.842][910][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4094lb # [ 17.598588] envoy[910]: [2026-09-20 10:50:46.844][910][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4095lb # [ 17.600097] envoy[910]: [2026-09-20 10:50:46.844][910][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4096worker1 # [ 17.650678] systemd[1]: Starting Nix worker-protocol over gRPC...4097lb # [ 17.647514] envoy[910]: [2026-09-20 10:50:46.893][910][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4098worker2 # [ 17.647917] systemd[1]: Starting Nix worker-protocol over gRPC...4099lb # [ 17.669581] envoy[910]: [2026-09-20 10:50:46.915][910][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4100lb # [ 17.671827] envoy[910]: [2026-09-20 10:50:46.917][910][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4101lb # [ 17.674595] envoy[910]: [2026-09-20 10:50:46.920][910][info][main] [source/server/server.cc:1077] starting main dispatch loop4102client # [ 17.820389] dhcpcd[568]: eth0: leased 10.0.2.15 for 86400 seconds4103client # [ 17.821359] dhcpcd[568]: eth0: adding route to 10.0.2.0/244104client # [ 17.822405] dhcpcd[568]: eth0: adding default route via 10.0.2.24105worker1 # [ 17.844327] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4106worker1 # [ 17.855419] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14107worker2 # [ 17.860331] nix-grpc-daemon[784]: ts=2026-09-20T10:50:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4108worker2 # [ 17.871170] nix-grpc-daemon[784]: ts=2026-09-20T10:50:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14109worker1 # [ 17.894597] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4110worker1 # [ 17.900344] systemd[1]: Started Nix worker-protocol over gRPC.4111client # [ 17.904728] systemd[1]: Started DHCP Client.4112client # [ 17.906805] systemd[1]: Reached target Multi-User System.4113client # [ 17.907814] systemd[1]: Startup finished in 843ms (kernel) + 4.986s (initrd) + 12.078s (userspace) = 17.907s.4114worker2 # [ 17.908366] nix-grpc-daemon[784]: ts=2026-09-20T10:50:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4115worker2 # [ 17.911966] systemd[1]: Started Nix worker-protocol over gRPC.4116lb # [ 17.947780] envoy[910]: [2026-09-20 10:50:47.193][910][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4117lb # [ 17.952427] envoy[910]: [2026-09-20 10:50:47.193][910][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4118lb # [ 17.959230] envoy[910]: [2026-09-20 10:50:47.193][910][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4119lb # [ 17.963288] envoy[910]: [2026-09-20 10:50:47.194][910][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4120worker1 # [ 17.988486] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_connected addr=lb:500514121worker2 # [ 17.978818] nix-grpc-daemon[784]: ts=2026-09-20T10:50:47Z level=info event=scheduler_connected addr=lb:500514122worker2 # [ 17.989188] nix-grpc-daemon[784]: ts=2026-09-20T10:50:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4123worker1 # [ 17.999679] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4124worker2 # [ 18.190530] nix-grpc-daemon[784]: ts=2026-09-20T10:50:47Z level=info event=scheduler_connected addr=lb:500514125worker1 # [ 18.201070] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_connected addr=lb:500514126worker2 # [ 18.194750] nix-grpc-daemon[784]: ts=2026-09-20T10:50:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4127worker1 # [ 18.205438] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4128worker2 # [ 18.395461] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514129worker1 # [ 18.406246] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 18.410188] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4131worker2 # [ 18.399554] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4132worker2 # [ 18.600411] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514133worker1 # [ 18.611177] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 18.604504] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4135worker1 # [ 18.615194] nix-grpc-daemon[785]: ts=2026-09-20T10:50:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4136worker2 # [ 18.804970] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 18.807202] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4138worker1 # [ 18.816229] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514139worker1 # [ 18.820210] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4140worker2 # [ 19.008073] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 19.009774] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4142worker1 # [ 19.022351] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514143worker1 # [ 19.025666] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4144worker2 # [ 19.211084] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 19.223072] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514146worker2 # [ 19.215708] nix-grpc-daemon[784]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4147worker1 # [ 19.226980] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4148worker2 # [ 19.416480] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 19.427867] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514150worker2 # [ 19.420144] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4151worker1 # [ 19.432119] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4152worker2 # [ 19.620645] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 19.630202] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_connected addr=lb:500514154worker2 # [ 19.622604] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4155worker1 # [ 19.634276] nix-grpc-daemon[785]: ts=2026-09-20T10:50:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4156worker2 # [ 19.823307] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 19.835437] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514158worker2 # [ 19.827418] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4159worker1 # [ 19.839145] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4160worker2 # [ 20.028787] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514161worker2 # [ 20.030962] nix-grpc-daemon[784]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4162worker1 # [ 20.041983] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514163worker1 # [ 20.045585] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4164worker2 # [ 20.231900] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 20.242436] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514166worker1 # [ 20.246620] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4167worker2 # [ 20.236136] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4168worker2 # [ 20.436587] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 20.447077] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514170worker1 # [ 20.449265] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4171worker2 # [ 20.438836] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4172worker2 # [ 20.639686] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 20.650334] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_connected addr=lb:500514174worker2 # [ 20.643708] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4175worker1 # [ 20.654341] nix-grpc-daemon[785]: ts=2026-09-20T10:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4176worker1 # [ 20.855458] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 20.844628] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514178worker1 # [ 20.859451] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4179worker2 # [ 20.849236] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4180worker1 # [ 21.061506] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 21.051486] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 21.065088] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4183worker2 # [ 21.054692] nix-grpc-daemon[784]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4184worker2 # [ 21.252306] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 21.266683] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514186worker2 # [ 21.256300] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4187worker1 # [ 21.269861] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4188worker2 # [ 21.457135] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 21.467944] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514190worker2 # [ 21.461192] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4191worker1 # [ 21.471887] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4192worker2 # [ 21.661937] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 21.672955] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_connected addr=lb:500514194worker2 # [ 21.666214] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4195worker1 # [ 21.677115] nix-grpc-daemon[785]: ts=2026-09-20T10:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4196worker2 # [ 21.866784] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 21.877885] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514198worker2 # [ 21.870953] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4199worker1 # [ 21.882223] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4200worker2 # [ 22.071904] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 22.074029] nix-grpc-daemon[784]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4202worker1 # [ 22.084620] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514203worker1 # [ 22.087861] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4204worker2 # [ 22.275210] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 22.285150] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514206worker2 # [ 22.279232] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4207worker1 # [ 22.290229] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4208worker2 # [ 22.479918] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 22.491188] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514210worker2 # [ 22.484142] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4211worker1 # [ 22.496632] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4212worker2 # [ 22.684652] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 22.697073] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 22.699028] nix-grpc-daemon[785]: ts=2026-09-20T10:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4215worker2 # [ 22.688666] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4216worker1 # [ 22.899765] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514217worker2 # [ 22.889472] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514218worker1 # [ 22.902152] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4219worker2 # [ 22.893487] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4220worker1 # [ 23.104588] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514221worker2 # [ 23.095520] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514222worker1 # [ 23.107850] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4223worker2 # [ 23.098709] nix-grpc-daemon[784]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4224worker1 # [ 23.305247] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 23.295833] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 23.309253] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4227worker2 # [ 23.299777] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4228worker1 # [ 23.509690] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514229worker1 # [ 23.511609] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4230worker2 # [ 23.500906] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514231worker2 # [ 23.504633] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4232worker2 # [ 23.702265] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 23.712804] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_connected addr=lb:500514234worker2 # [ 23.704562] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4235worker1 # [ 23.716920] nix-grpc-daemon[785]: ts=2026-09-20T10:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4236worker2 # [ 23.905043] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 23.906921] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4238worker1 # [ 23.917712] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514239worker1 # [ 23.921496] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4240worker2 # [ 24.109460] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514241worker1 # [ 24.120917] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 24.123519] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4243worker2 # [ 24.112604] nix-grpc-daemon[784]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4244worker1 # [ 24.321351] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514245worker2 # [ 24.310274] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 24.323462] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4247worker2 # [ 24.314491] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4248worker1 # [ 24.524765] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 24.515481] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 24.528740] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4251worker2 # [ 24.519411] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4252worker1 # [ 24.729297] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_connected addr=lb:500514253worker1 # [ 24.731257] nix-grpc-daemon[785]: ts=2026-09-20T10:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4254worker2 # [ 24.719950] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514255worker2 # [ 24.724454] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4256worker1 # [ 24.931945] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514257worker1 # [ 24.934025] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4258worker2 # [ 24.924986] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514259worker2 # [ 24.928987] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4260worker1 # [ 25.136629] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 25.129877] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514262worker2 # [ 25.131633] nix-grpc-daemon[784]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4263worker1 # [ 25.139854] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4264worker1 # [ 25.337396] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514265worker1 # [ 25.340657] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4266worker2 # [ 25.332407] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514267worker2 # [ 25.334387] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4268worker1 # [ 25.541916] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 25.535597] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 25.545936] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4271worker2 # [ 25.539605] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4272worker1 # [ 25.747154] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_connected addr=lb:500514273worker2 # [ 25.740521] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514274worker1 # [ 25.751605] nix-grpc-daemon[785]: ts=2026-09-20T10:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4275worker2 # [ 25.744490] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4276worker1 # [ 25.952212] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514277worker1 # [ 25.955584] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4278worker2 # [ 25.945295] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514279worker2 # [ 25.949350] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4280worker1 # [ 26.156587] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514281worker1 # [ 26.158274] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4282worker2 # [ 26.151611] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514283worker2 # [ 26.154809] nix-grpc-daemon[784]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4284worker1 # [ 26.359403] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514285worker2 # [ 26.351910] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 26.363514] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4287worker2 # [ 26.356377] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4288worker1 # [ 26.564468] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514289worker2 # [ 26.556894] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514290worker1 # [ 26.568557] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4291worker2 # [ 26.560903] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4292worker1 # [ 26.769402] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_connected addr=lb:500514293worker2 # [ 26.762525] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514294worker1 # [ 26.773567] nix-grpc-daemon[785]: ts=2026-09-20T10:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4295worker2 # [ 26.765644] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4296worker2 # [ 26.963562] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514297worker1 # [ 26.974359] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514298worker2 # [ 26.967501] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4299worker1 # [ 26.978363] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4300worker2 # [ 27.169872] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514301worker1 # [ 27.180504] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514302worker2 # [ 27.172997] nix-grpc-daemon[784]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4303worker1 # [ 27.183709] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4304worker2 # [ 27.370626] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514305worker1 # [ 27.381225] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514306worker2 # [ 27.374651] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4307worker1 # [ 27.385275] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4308worker2 # [ 27.575704] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514309worker1 # [ 27.586105] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500514310worker2 # [ 27.579871] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4311worker1 # [ 27.590325] nix-grpc-daemon[785]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4312worker1 # [ 27.790983] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514313worker2 # [ 27.780677] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514314worker1 # [ 27.793059] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4315worker2 # [ 27.784607] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4316worker1 # [ 27.993765] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514317worker2 # [ 27.985581] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514318worker1 # [ 27.997137] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4319worker2 # [ 27.990527] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4320worker1 # [ 28.198988] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514321worker2 # [ 28.192067] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514322worker1 # [ 28.202805] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4323worker2 # [ 28.195209] nix-grpc-daemon[784]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4324worker1 # [ 28.400704] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514325worker2 # [ 28.392790] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514326worker1 # [ 28.404731] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4327worker2 # [ 28.397125] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4328worker1 # [ 28.605737] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500514329worker2 # [ 28.597988] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514330worker1 # [ 28.609761] nix-grpc-daemon[785]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4331worker2 # [ 28.601842] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4332worker1 # [ 28.810806] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514333worker2 # [ 28.799962] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514334worker2 # [ 28.804178] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4335worker1 # [ 28.815230] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4336worker2 # [ 29.004419] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514337worker1 # [ 29.016117] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514338worker2 # [ 29.008311] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4339worker1 # [ 29.019907] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4340worker2 # [ 29.210645] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514341worker1 # [ 29.221580] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514342worker1 # [ 29.224203] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4343worker2 # [ 29.213783] nix-grpc-daemon[784]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4344worker2 # [ 29.411647] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514345worker1 # [ 29.422709] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514346worker2 # [ 29.415857] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4347worker1 # [ 29.426704] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4348worker2 # [ 29.616420] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514349worker1 # [ 29.627724] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500514350worker2 # [ 29.620652] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4351worker1 # [ 29.632101] nix-grpc-daemon[785]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4352lb # [ 29.691365] rustfs-bucket-start[1039]: mb s3://farm4353lb # [ 29.695904] systemd[1]: Finished rustfs-bucket.service.4354lb # [ 29.703481] systemd[1]: Starting niks3 server...4355worker2 # [ 29.820597] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514356worker1 # [ 29.832537] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514357worker1 # [ 29.834628] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4358worker2 # [ 29.824769] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4359lb # [ 29.916617] postgres[1054]: [1054] ERROR: relation "goose_db_version" does not exist at character 364360lb # [ 29.918163] postgres[1054]: [1054] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4361lb # [ 29.954541] niks3-server[1048]: 2026/09/20 10:50:59 OK 20241026095416_initial_model.sql (18.46ms)4362lb # [ 29.958046] niks3-server[1048]: 2026/09/20 10:50:59 OK 20251210153512_drop_unused_gin_index.sql (3.69ms)4363lb # [ 29.963983] niks3-server[1048]: 2026/09/20 10:50:59 OK 20251218171726_add_pins.sql (4.33ms)4364lb # [ 29.969570] niks3-server[1048]: 2026/09/20 10:50:59 OK 20260628120000_add_object_size_and_stats.sql (4.16ms)4365lb # [ 29.973698] niks3-server[1048]: 2026/09/20 10:50:59 OK 20260905000000_add_claims.sql (2.68ms)4366lb # [ 29.977768] niks3-server[1048]: 2026/09/20 10:50:59 OK 20260920000000_drop_claims.sql (3.99ms)4367lb # [ 29.978964] niks3-server[1048]: 2026/09/20 10:50:59 goose: successfully migrated database to version: 202609200000004368lb # [ 29.984196] niks3-server[1048]: 2026/09/20 10:50:59 OK 1_commit_pending_closure.sql (6.39ms)4369lb # [ 29.986483] niks3-server[1048]: 2026/09/20 10:50:59 OK 2_object_stats_trigger.sql (2.27ms)4370lb # [ 29.987616] niks3-server[1048]: 2026/09/20 10:50:59 goose: up to current file version: 24371lb # [ 29.993152] niks3-server[1048]: 2026/09/20 10:50:59 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4372worker1 # [ 30.033957] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514373worker2 # [ 30.026132] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514374worker1 # [ 30.037977] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4375worker2 # [ 30.029401] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4376lb # [ 30.066235] niks3-server[1048]: 2026/09/20 10:50:59 INFO Read proxy enabled — serving cache objects from S34377lb # [ 30.068339] niks3-server[1048]: 2026/09/20 10:50:59 INFO Using socket-activated listener address=0.0.0.0:57514378lb # [ 30.073906] niks3-server[1048]: 2026/09/20 10:50:59 INFO systemd watchdog enabled interval=15s4379lb # [ 30.075096] systemd[1]: Started niks3 server.4380lb # [ 30.075762] systemd[1]: Reached target Multi-User System.4381lb # [ 30.078084] systemd[1]: Startup finished in 863ms (kernel) + 3.943s (initrd) + 25.270s (userspace) = 30.077s.4382lb # [ 30.080547] niks3-server[1048]: 2026/09/20 10:50:59 INFO Starting HTTP server address=0.0.0.0:57514383lb # [ 30.086132] niks3-server[1048]: 2026/09/20 10:50:59 INFO lead: acquired remote=192.168.1.4:358544384worker2 # [ 30.084436] nix-grpc-daemon[784]: ts=2026-09-20T10:50:59Z level=info event=scheduler_take_over4385worker2 # [ 30.227988] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500514386worker1 # [ 30.240731] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514387worker2 # [ 30.232589] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4388worker1 # [ 30.243887] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4389worker1 # [ 30.440790] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514390worker1 # [ 30.443029] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4391worker2 # [ 30.433448] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500514392worker2 # [ 30.437996] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4393worker1 # [ 30.644250] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500514394worker1 # [ 30.648140] nix-grpc-daemon[785]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4395worker2 # [ 30.638404] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500514396lb: (finished: waiting for unit niks3.service, in 18.82 seconds)4397worker2 # [ 30.640280] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4398lb: waiting for TCP port 5751 on localhost4399lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4400lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4401lb: waiting for unit envoy.service4402lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4403lb: waiting for TCP port 50051 on localhost4404lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4405lb # [ 30.840260] envoy[910]: conn peer=[::1]:49948 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34406lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4407worker1 # [ 30.848985] nix-grpc-daemon[785]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500514408worker2 # [ 30.841156] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500514409worker1 # [ 30.853524] nix-grpc-daemon[785]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4410worker2 # [ 30.845674] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4411lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4412??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4413 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284414lb: must succeed: curl -sf localhost:9901/clusters4415lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4416lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)4417subtest: one node schedules and both builders hold a WorkerSession on it4418lb: must succeed: curl -sf localhost:9901/clusters4419worker1 # [ 31.053606] nix-grpc-daemon[785]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500514420worker2 # [ 31.042805] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500514421lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4422worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4423worker2 # [ 31.056230] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04424worker2 # [ 31.062494] nix-grpc-daemon[784]: ts=2026-09-20T10:51:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04425worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4426(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.11 seconds)4427subtest: balancer auth: client cert, bearer token, nothing, unknown CN4428worker1 # [ 31.466747] nix-grpc-daemon[785]: ts=2026-09-20T10:51:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366844429worker1 # [ 31.477610] systemd[1]: Started Nix Daemon.4430worker1 # [ 31.687305] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4431worker1 # [ 31.747328] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5)4432worker1 # [ 31.831354] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 109 ms (attempt 2/5)4433worker1 # [ 31.946438] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 3/5)4434worker1 # [ 32.004485] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 322 ms (attempt 4/5)4435worker1 # [ 32.343216] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4436worker1 # [ 32.377804] nix-grpc-daemon[785]: ts=2026-09-20T10:51:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:366844437worker1 # [ 32.389244] nix-grpc-daemon[785]: ts=2026-09-20T10:51:01Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4438worker2 # [ 32.396280] nix-grpc-daemon[784]: ts=2026-09-20T10:51:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:511104439worker2 # [ 32.411639] systemd[1]: Started Nix Daemon.4440worker2 # [ 32.629568] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4441worker2 # [ 32.658868] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)4442worker2 # [ 32.713486] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 2/5)4443worker2 # [ 32.899293] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 372 ms (attempt 3/5)4444worker2 # [ 33.276781] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 336 ms (attempt 4/5)4445worker2 # [ 33.624545] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4446worker2 # [ 33.643629] nix-grpc-daemon[784]: ts=2026-09-20T10:51:03Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4447client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4448client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4449client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4450client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4451worker2 # [ 34.033747] nix-grpc-daemon[784]: ts=2026-09-20T10:51:03Z level=info event=oidc_jwks provider=mock keys=14452worker2 # [ 34.038662] nix-grpc-daemon[784]: ts=2026-09-20T10:51:03Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:511104453worker1 # [ 34.081656] nix-grpc-daemon[785]: ts=2026-09-20T10:51:03Z level=info event=oidc_jwks provider=mock keys=14454worker1 # [ 34.086242] nix-grpc-daemon[785]: ts=2026-09-20T10:51:03Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:366844455worker1 # [ 34.094599] nix-grpc-daemon[785]: ts=2026-09-20T10:51:03Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4456worker2 # [ 34.088883] nix-grpc-daemon[784]: ts=2026-09-20T10:51:03Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:511104457worker2 # [ 34.100393] nix-grpc-daemon[784]: ts=2026-09-20T10:51:03Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4458client: must succeed: rm -r /var/lib/nix-grpc-store4459client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)4460worker2 # [ 36.367353] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=info event=denied method=QueryMissing cn=- role=none4461worker2 # [ 36.610186] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=info event=denied method=QueryMissing cn=stranger role=none4462(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.51 seconds)4463subtest: DAG build is scheduled across workers and lands in the cache4464client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24465worker1 # [ 36.830226] nix-grpc-daemon[785]: ts=2026-09-20T10:51:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366844466client # don't know how to build these paths:4467client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4468worker2 # [ 36.830817] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104469worker2 # [ 36.871488] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04470worker2 # [ 36.876927] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14471worker2 # [ 36.924157] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104472worker2 # [ 36.949194] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104473client # copying 1 paths to 'lb:50051'...4474worker2 # [ 36.963234] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511104475client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4476worker2 # [ 36.985321] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4477worker2 # [ 37.018221] nix-grpc-daemon[784]: ts=2026-09-20T10:51:06Z level=info event=niks3_push_started pid=8584478worker2 # [ 37.444591] nix-daemon[845]: accepted connection from pid 869, user nix-grpc-daemon (trusted)4479worker2 # [ 37.461468] nix-daemon[845]: reaped child process 873, status = succeeded4480worker2 # [ 37.634691] nix-daemon[845]: accepted connection from pid 875, user nix-grpc-daemon (trusted)4481lb # [ 37.656377] envoy[910]: conn peer=[2001:db8:1::1]:53026 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=22474482worker2 # [ 37.650347] nix-daemon[845]: reaped child process 878, status = succeeded4483lb # [ 37.658182] envoy[910]: conn peer=[2001:db8:1::1]:37084 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1004484lb # [ 37.659757] envoy[910]: conn peer=[2001:db8:1::1]:37100 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=104485lb # [ 37.661406] envoy[910]: conn peer=[2001:db8:1::1]:37106 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=124486lb # [ 37.672618] niks3-server[1048]: 2026/09/20 10:51:06 INFO Received uploads request method=POST path=/api/pending_closures4487worker2 # [ 37.682904] nix-grpc-daemon[858]: time=2026-09-20T10:51:07.457Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4488worker2 # [ 37.685521] nix-grpc-daemon[858]: time=2026-09-20T10:51:07.460Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4489lb # [ 37.722468] niks3-server[1048]: 2026/09/20 10:51:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4490lb # [ 37.727340] niks3-server[1048]: 2026/09/20 10:51:06 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4491lb # [ 37.740753] niks3-server[1048]: 2026/09/20 10:51:06 INFO Signed narinfos id=1 count=14492worker2 # [ 37.735511] nix-grpc-daemon[858]: time=2026-09-20T10:51:07.511Z level=INFO msg="Uploading 1 narinfos"4493lb # [ 37.751909] niks3-server[1048]: 2026/09/20 10:51:06 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4494lb # [ 37.755668] niks3-server[1048]: 2026/09/20 10:51:07 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4495lb # [ 37.762246] niks3-server[1048]: 2026/09/20 10:51:07 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4496lb # [ 37.770707] niks3-server[1048]: 2026/09/20 10:51:07 INFO Completed upload id=14497worker2 # [ 37.763390] nix-grpc-daemon[858]: time=2026-09-20T10:51:07.539Z level=INFO msg="Upload complete. (472ms)"4498worker2 # [ 37.768449] nix-grpc-daemon[784]: ts=2026-09-20T10:51:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_in=5044499worker2 # [ 37.775290] nix-grpc-daemon[784]: ts=2026-09-20T10:51:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104500worker2 # [ 37.786576] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4501worker2 # [ 37.789477] nix-daemon[845]: reaped child process 856, status = succeeded4502client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4503client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4504worker2 # [ 37.795358] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4505client # farm-a> LOG-farm-a-t14506worker2 # [ 39.223232] nix-daemon[845]: reaped child process 882, status = succeeded4507worker2 # [ 39.350924] nix-daemon[845]: accepted connection from pid 898, user nix-grpc-daemon (trusted)4508worker2 # [ 39.364834] nix-daemon[845]: reaped child process 902, status = succeeded4509lb # [ 39.383750] niks3-server[1048]: 2026/09/20 10:51:08 INFO Received uploads request method=POST path=/api/pending_closures4510worker2 # [ 39.389634] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.165Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4511worker2 # [ 39.391353] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.167Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4512lb # [ 39.430997] niks3-server[1048]: 2026/09/20 10:51:08 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4513lb # [ 39.438668] niks3-server[1048]: 2026/09/20 10:51:08 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4514lb # [ 39.450359] niks3-server[1048]: 2026/09/20 10:51:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4515worker2 # [ 39.448959] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.224Z level=INFO msg="Uploading 1 narinfos"4516lb # [ 39.456060] niks3-server[1048]: 2026/09/20 10:51:08 INFO Signed narinfos id=2 count=14517lb # [ 39.462424] niks3-server[1048]: 2026/09/20 10:51:08 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4518lb # [ 39.469894] niks3-server[1048]: 2026/09/20 10:51:08 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4519lb # [ 39.474093] niks3-server[1048]: 2026/09/20 10:51:08 INFO Completed upload id=24520lb # [ 39.475462] niks3-server[1048]: 2026/09/20 10:51:08 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4521worker2 # [ 39.466799] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.242Z level=INFO msg="Upload complete. (261ms)"4522worker2 # [ 39.476374] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14523worker2 # [ 39.491455] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04524worker2 # [ 39.493460] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14525worker2 # [ 39.497103] nix-daemon[845]: reaped child process 880, status = succeeded4526worker2 # [ 39.539614] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104527worker2 # [ 39.551745] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104528worker2 # [ 39.565546] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.341Z level=INFO msg="All 1 paths already cached"4529client # copying 1 paths to 'lb:50051'...4530worker2 # [ 39.573744] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511104531client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4532worker2 # [ 39.598370] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4533worker2 # [ 39.769799] nix-daemon[845]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4534worker2 # [ 39.784163] nix-daemon[845]: reaped child process 911, status = succeeded4535worker2 # [ 39.931068] nix-daemon[845]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4536worker2 # [ 39.944363] nix-daemon[845]: reaped child process 916, status = succeeded4537lb # [ 39.961175] niks3-server[1048]: 2026/09/20 10:51:09 INFO Received uploads request method=POST path=/api/pending_closures4538worker2 # [ 39.966725] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.742Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4539worker2 # [ 39.968057] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.742Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4540lb # [ 39.985921] niks3-server[1048]: 2026/09/20 10:51:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4541worker2 # [ 39.980875] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.756Z level=INFO msg="Uploading 1 narinfos"4542lb # [ 39.988583] niks3-server[1048]: 2026/09/20 10:51:09 INFO Signed narinfos id=3 count=14543lb # [ 39.993989] niks3-server[1048]: 2026/09/20 10:51:09 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4544lb # [ 39.996529] niks3-server[1048]: 2026/09/20 10:51:09 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4545lb # [ 40.000689] niks3-server[1048]: 2026/09/20 10:51:09 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4546lb # [ 40.003116] niks3-server[1048]: 2026/09/20 10:51:09 INFO Completed upload id=34547worker2 # [ 39.995817] nix-grpc-daemon[858]: time=2026-09-20T10:51:09.771Z level=INFO msg="Upload complete. (381ms)"4548lb # [ 40.005675] niks3-server[1048]: 2026/09/20 10:51:09 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4549worker2 # [ 39.997801] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_in=6244550worker2 # [ 40.000443] nix-grpc-daemon[784]: ts=2026-09-20T10:51:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104551worker2 # [ 40.005931] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4552worker2 # [ 40.014047] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4553client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4554worker2 # [ 40.016180] nix-daemon[845]: reaped child process 906, status = succeeded4555client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4556client # farm-b> LOG-farm-b-t14557worker2 # [ 41.031570] nix-daemon[845]: reaped child process 920, status = succeeded4558worker2 # [ 41.169681] nix-daemon[845]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4559worker2 # [ 41.184429] nix-daemon[845]: reaped child process 938, status = succeeded4560lb # [ 41.205974] niks3-server[1048]: 2026/09/20 10:51:10 INFO Received uploads request method=POST path=/api/pending_closures4561worker2 # [ 41.207387] nix-grpc-daemon[858]: time=2026-09-20T10:51:10.983Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4562worker2 # [ 41.209756] nix-grpc-daemon[858]: time=2026-09-20T10:51:10.984Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4563lb # [ 41.247829] niks3-server[1048]: 2026/09/20 10:51:10 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4564lb # [ 41.256415] niks3-server[1048]: 2026/09/20 10:51:10 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4565lb # [ 41.262265] niks3-server[1048]: 2026/09/20 10:51:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4566lb # [ 41.267709] niks3-server[1048]: 2026/09/20 10:51:10 INFO Signed narinfos id=4 count=14567worker2 # [ 41.265199] nix-grpc-daemon[858]: time=2026-09-20T10:51:11.040Z level=INFO msg="Uploading 1 narinfos"4568lb # [ 41.272973] niks3-server[1048]: 2026/09/20 10:51:10 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4569lb # [ 41.283053] niks3-server[1048]: 2026/09/20 10:51:10 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4570lb # [ 41.291503] niks3-server[1048]: 2026/09/20 10:51:10 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4571lb # [ 41.294649] niks3-server[1048]: 2026/09/20 10:51:10 INFO Completed upload id=44572worker2 # [ 41.287529] nix-grpc-daemon[858]: time=2026-09-20T10:51:11.063Z level=INFO msg="Upload complete. (266ms)"4573worker2 # [ 41.296269] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14574worker2 # [ 41.306242] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04575worker2 # [ 41.310249] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14576worker2 # [ 41.319368] nix-daemon[845]: reaped child process 918, status = succeeded4577worker2 # [ 41.352127] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104578worker2 # [ 41.364878] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104579worker2 # [ 41.377541] nix-grpc-daemon[858]: time=2026-09-20T10:51:11.153Z level=INFO msg="All 2 paths already cached"4580client # copying 1 paths to 'lb:50051'...4581client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4582worker2 # [ 41.386174] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511104583worker2 # [ 41.400370] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4584worker2 # [ 41.551907] nix-daemon[845]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4585worker2 # [ 41.566643] nix-daemon[845]: reaped child process 947, status = succeeded4586worker2 # [ 41.693279] nix-daemon[845]: accepted connection from pid 949, user nix-grpc-daemon (trusted)4587worker2 # [ 41.706234] nix-daemon[845]: reaped child process 952, status = succeeded4588lb # [ 41.729155] niks3-server[1048]: 2026/09/20 10:51:10 INFO Received uploads request method=POST path=/api/pending_closures4589worker2 # [ 41.733139] nix-grpc-daemon[858]: time=2026-09-20T10:51:11.508Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4590worker2 # [ 41.734523] nix-grpc-daemon[858]: time=2026-09-20T10:51:11.508Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4591lb # [ 41.767952] niks3-server[1048]: 2026/09/20 10:51:11 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4592lb # [ 41.778765] niks3-server[1048]: 2026/09/20 10:51:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4593lb # [ 41.782061] niks3-server[1048]: 2026/09/20 10:51:11 INFO Signed narinfos id=5 count=14594worker2 # [ 41.776852] nix-grpc-daemon[858]: time=2026-09-20T10:51:11.552Z level=INFO msg="Uploading 1 narinfos"4595lb # [ 41.787382] niks3-server[1048]: 2026/09/20 10:51:11 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4596lb # [ 41.797862] niks3-server[1048]: 2026/09/20 10:51:11 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4597lb # [ 41.801377] niks3-server[1048]: 2026/09/20 10:51:11 INFO Completed upload id=54598worker2 # [ 41.795618] nix-grpc-daemon[858]: time=2026-09-20T10:51:11.571Z level=INFO msg="Upload complete. (382ms)"4599lb # [ 41.805653] niks3-server[1048]: 2026/09/20 10:51:11 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4600worker2 # [ 41.799640] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_in=7524601worker2 # [ 41.805351] nix-grpc-daemon[784]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104602worker2 # [ 41.813494] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4603worker2 # [ 41.820476] nix-daemon[845]: reaped child process 942, status = succeeded4604worker2 # [ 41.825466] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4605client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4606client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4607client # farm-top> LOG-farm-top-t14608worker2 # [ 43.053373] nix-daemon[845]: reaped child process 956, status = succeeded4609worker2 # [ 43.190631] nix-daemon[845]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4610worker2 # [ 43.203718] nix-daemon[845]: reaped child process 975, status = succeeded4611lb # [ 43.227129] niks3-server[1048]: 2026/09/20 10:51:12 INFO Received uploads request method=POST path=/api/pending_closures4612worker2 # [ 43.227612] nix-grpc-daemon[858]: time=2026-09-20T10:51:13.003Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4613worker2 # [ 43.229456] nix-grpc-daemon[858]: time=2026-09-20T10:51:13.005Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4614lb # [ 43.263062] niks3-server[1048]: 2026/09/20 10:51:12 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4615lb # [ 43.272664] niks3-server[1048]: 2026/09/20 10:51:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4616worker2 # [ 43.271770] nix-grpc-daemon[858]: time=2026-09-20T10:51:13.047Z level=INFO msg="Uploading 1 narinfos"4617lb # [ 43.279132] niks3-server[1048]: 2026/09/20 10:51:12 INFO Signed narinfos id=6 count=14618lb # [ 43.285587] niks3-server[1048]: 2026/09/20 10:51:12 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4619lb # [ 43.288488] niks3-server[1048]: 2026/09/20 10:51:12 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4620lb # [ 43.290871] niks3-server[1048]: 2026/09/20 10:51:12 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4621lb # [ 43.297705] niks3-server[1048]: 2026/09/20 10:51:12 INFO Completed upload id=64622worker2 # [ 43.290464] nix-grpc-daemon[858]: time=2026-09-20T10:51:13.066Z level=INFO msg="Upload complete. (257ms)"4623lb # [ 43.299362] niks3-server[1048]: 2026/09/20 10:51:12 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4624worker2 # [ 43.297377] nix-grpc-daemon[784]: ts=2026-09-20T10:51:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14625worker2 # [ 43.306534] nix-daemon[845]: reaped child process 954, status = succeeded4626client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.70 seconds)4627client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4628client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4629client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4630client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4631client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4632client # copying 3 paths...4633client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4634client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4635client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4636client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4637(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.24 seconds)4638subtest: repeat is answered Cached by the scheduler without building4639worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4640worker1 # finding garbage collector roots...4641worker1 # deleting specified paths...4642worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4643worker1 # deleting unused links...4644worker1 # note: hard linking is currently saving 0.0 KiB4645worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4646worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4647worker2 # finding garbage collector roots...4648worker2 # deleting specified paths...4649worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4650worker2 # deleting unused links...4651worker2 # note: hard linking is currently saving 0.0 KiB4652worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.22 seconds)4653client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24654worker2 # [ 44.547293] nix-grpc-daemon[784]: ts=2026-09-20T10:51:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511104655client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4656client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4657worker1 # [ 44.573385] nix-grpc-daemon[785]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366844658worker2 # [ 44.581143] nix-grpc-daemon[784]: ts=2026-09-20T10:51:14Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14659client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.25 seconds)4660client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4661client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds)4662lb: must succeed: curl -sf localhost:9901/clusters4663lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4664lb: must succeed: curl -sf localhost:9901/clusters4665lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4666worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4667worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4668(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.14 seconds)4669subtest: inputs already in the cache are not sent to the scheduler4670lb: must succeed: curl -sf localhost:9901/clusters4671lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4672lb: must succeed: curl -sf localhost:9901/clusters4673lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4674worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4675worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4676client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24677worker2 # [ 45.322670] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511104678client # don't know how to build these paths:4679client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4680worker2 # [ 45.330560] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104681worker2 # [ 45.338796] nix-grpc-daemon[858]: time=2026-09-20T10:51:15.114Z level=INFO msg="All 2 paths already cached"4682worker2 # [ 45.349800] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04683worker2 # [ 45.354782] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14684worker2 # [ 45.393985] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104685worker2 # [ 45.404517] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104686worker2 # [ 45.414737] nix-grpc-daemon[858]: time=2026-09-20T10:51:15.190Z level=INFO msg="All 2 paths already cached"4687client # copying 1 paths to 'lb:50051'...4688client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4689worker2 # [ 45.422114] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511104690worker2 # [ 45.433420] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4691worker2 # [ 45.591400] nix-daemon[845]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4692worker2 # [ 45.604206] nix-daemon[845]: reaped child process 1007, status = succeeded4693worker2 # [ 45.767124] nix-daemon[845]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4694worker2 # [ 45.780558] nix-daemon[845]: reaped child process 1012, status = succeeded4695lb # [ 45.803318] niks3-server[1048]: 2026/09/20 10:51:15 INFO Received uploads request method=POST path=/api/pending_closures4696worker2 # [ 45.802649] nix-grpc-daemon[858]: time=2026-09-20T10:51:15.578Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4697worker2 # [ 45.804289] nix-grpc-daemon[858]: time=2026-09-20T10:51:15.580Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4698lb # [ 45.821400] niks3-server[1048]: 2026/09/20 10:51:15 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4699lb # [ 45.824763] niks3-server[1048]: 2026/09/20 10:51:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4700lb # [ 45.827307] niks3-server[1048]: 2026/09/20 10:51:15 INFO Signed narinfos id=7 count=14701worker2 # [ 45.819980] nix-grpc-daemon[858]: time=2026-09-20T10:51:15.595Z level=INFO msg="Uploading 1 narinfos"4702lb # [ 45.830170] niks3-server[1048]: 2026/09/20 10:51:15 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4703lb # [ 45.834863] niks3-server[1048]: 2026/09/20 10:51:15 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4704lb # [ 45.837353] niks3-server[1048]: 2026/09/20 10:51:15 INFO Completed upload id=74705worker2 # [ 45.829993] nix-grpc-daemon[858]: time=2026-09-20T10:51:15.605Z level=INFO msg="Upload complete. (385ms)"4706lb # [ 45.839821] niks3-server[1048]: 2026/09/20 10:51:15 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4707worker2 # [ 45.832241] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_in=7524708worker2 # [ 45.836164] nix-grpc-daemon[784]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104709worker2 # [ 45.842188] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4710worker2 # [ 45.844526] nix-daemon[845]: reaped child process 1002, status = succeeded4711client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4712client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4713worker2 # [ 45.849958] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4714client # farm-top> LOG-farm-top-t1b4715worker2 # [ 47.279858] nix-daemon[845]: reaped child process 1016, status = succeeded4716worker2 # [ 47.425415] nix-daemon[845]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4717worker2 # [ 47.437839] nix-daemon[845]: reaped child process 1034, status = succeeded4718lb # [ 47.456517] niks3-server[1048]: 2026/09/20 10:51:16 INFO Received uploads request method=POST path=/api/pending_closures4719worker2 # [ 47.457576] nix-grpc-daemon[858]: time=2026-09-20T10:51:17.233Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4720worker2 # [ 47.459416] nix-grpc-daemon[858]: time=2026-09-20T10:51:17.235Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4721lb # [ 47.494513] niks3-server[1048]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4722lb # [ 47.509397] niks3-server[1048]: 2026/09/20 10:51:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4723worker2 # [ 47.507971] nix-grpc-daemon[858]: time=2026-09-20T10:51:17.283Z level=INFO msg="Uploading 1 narinfos"4724lb # [ 47.515771] niks3-server[1048]: 2026/09/20 10:51:16 INFO Signed narinfos id=8 count=14725lb # [ 47.520597] niks3-server[1048]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4726lb # [ 47.525093] niks3-server[1048]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4727lb # [ 47.535949] niks3-server[1048]: 2026/09/20 10:51:16 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4728lb # [ 47.541057] niks3-server[1048]: 2026/09/20 10:51:16 INFO Completed upload id=84729lb # [ 47.543898] niks3-server[1048]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4730worker2 # [ 47.535417] nix-grpc-daemon[858]: time=2026-09-20T10:51:17.311Z level=INFO msg="Upload complete. (276ms)"4731worker2 # [ 47.543767] nix-grpc-daemon[784]: ts=2026-09-20T10:51:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14732worker2 # [ 47.556486] nix-daemon[845]: reaped child process 1014, status = succeeded4733client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.43 seconds)4734client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4735lb # [ 47.656919] envoy[910]: conn peer=[2001:db8:1::1]:37118 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9468 tx=3800 ms=65164736lb # [ 47.658500] envoy[910]: conn peer=[2001:db8:1::1]:33020 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=484737lb # [ 47.659902] envoy[910]: conn peer=[2001:db8:1::1]:33032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4139 tx=1685 ms=22304738client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.19 seconds)4739lb: must succeed: curl -sf localhost:9901/clusters4740lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4741lb: must succeed: curl -sf localhost:9901/clusters4742lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4743worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4744worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4745(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.89 seconds)4746subtest: two clients wanting the same drv build it once4747client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4748client # [ 47.966735] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4749client # Running as unit: dedup1.service; invocation ID: 60d3bb9869c846e8915ba01a18732cba4750client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4751client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4752worker2 # [ 48.131653] nix-grpc-daemon[784]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511104753client # [ 48.150134] nix[893]: don't know how to build these paths:4754client # [ 48.151227] nix[893]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4755worker2 # [ 48.145199] nix-grpc-daemon[784]: ts=2026-09-20T10:51:17Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04756worker2 # [ 48.149824] nix-grpc-daemon[784]: ts=2026-09-20T10:51:17Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14757worker1 # [ 48.164607] nix-grpc-daemon[785]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366844758worker1 # [ 48.180069] nix-grpc-daemon[785]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366844759client # [ 48.191785] nix[893]: copying 1 paths to 'lb:50051'...4760client # [ 48.192623] nix[893]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4761worker1 # [ 48.191275] nix-grpc-daemon[785]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366844762worker1 # [ 48.199892] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4763worker1 # [ 48.219481] nix-grpc-daemon[785]: ts=2026-09-20T10:51:17Z level=info event=niks3_push_started pid=8694764worker1 # [ 48.633109] nix-daemon[843]: accepted connection from pid 880, user nix-grpc-daemon (trusted)4765worker1 # [ 48.649534] nix-daemon[843]: reaped child process 884, status = succeeded4766worker1 # [ 48.796120] nix-daemon[843]: accepted connection from pid 887, user nix-grpc-daemon (trusted)4767worker1 # [ 48.810600] nix-daemon[843]: reaped child process 890, status = succeeded4768lb # [ 48.823241] niks3-server[1048]: 2026/09/20 10:51:18 INFO Received uploads request method=POST path=/api/pending_closures4769worker1 # [ 48.833593] nix-grpc-daemon[869]: time=2026-09-20T10:51:18.058Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4770worker1 # [ 48.836158] nix-grpc-daemon[869]: time=2026-09-20T10:51:18.061Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4771lb # [ 48.853187] niks3-server[1048]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4772lb # [ 48.856445] niks3-server[1048]: 2026/09/20 10:51:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4773worker1 # [ 48.864057] nix-grpc-daemon[869]: time=2026-09-20T10:51:18.090Z level=INFO msg="Uploading 1 narinfos"4774lb # [ 48.861334] niks3-server[1048]: 2026/09/20 10:51:18 INFO Signed narinfos id=9 count=14775lb # [ 48.864373] niks3-server[1048]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4776lb # [ 48.870061] niks3-server[1048]: 2026/09/20 10:51:18 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4777lb # [ 48.874379] niks3-server[1048]: 2026/09/20 10:51:18 INFO Completed upload id=94778worker1 # [ 48.877393] nix-grpc-daemon[869]: time=2026-09-20T10:51:18.103Z level=INFO msg="Upload complete. (419ms)"4779worker1 # [ 48.879275] nix-grpc-daemon[785]: ts=2026-09-20T10:51:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=0 paths=1 nar_bytes_in=4324780lb # [ 48.877084] niks3-server[1048]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4781worker1 # [ 48.886251] nix-grpc-daemon[785]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366844782worker1 # [ 48.890341] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4783worker1 # [ 48.892844] nix-daemon[843]: reaped child process 867, status = succeeded4784worker1 # [ 48.898352] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4785client # [ 48.898955] nix[893]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4786client # [ 49.045438] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4787client # Running as unit: dedup2.service; invocation ID: bc8dd3cf0de74d5eb6d79093e7746b6a4788client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4789worker1 # [ 49.300706] nix-grpc-daemon[785]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366844790client # [ 49.310534] nix[908]: this derivation will be built:4791worker2 # [ 49.300963] nix-grpc-daemon[784]: ts=2026-09-20T10:51:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:511104792worker2 # [ 49.308935] nix-grpc-daemon[784]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'...4793client # [ 49.340225] nix[908]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4794worker2 # [ 49.334962] nix-grpc-daemon[784]: ts=2026-09-20T10:51:19Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04795worker1 # [ 49.354323] nix-grpc-daemon[785]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366844796client # [ 49.358655] nix[908]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4797client: must succeed: sleep 24798client: (finished: must succeed: sleep 2, in 2.05 seconds)4799??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4800 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394801client: waiting for success: ! systemctl is-active dedup1 dedup24802??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4803 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394804worker1 # [ 52.516353] nix-daemon[843]: reaped child process 894, status = succeeded4805worker1 # [ 52.669931] nix-daemon[843]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4806worker1 # [ 52.683925] nix-daemon[843]: reaped child process 926, status = succeeded4807lb # [ 52.695850] niks3-server[1048]: 2026/09/20 10:51:21 INFO Received uploads request method=POST path=/api/pending_closures4808worker1 # [ 52.706814] nix-grpc-daemon[869]: time=2026-09-20T10:51:21.932Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4809worker1 # [ 52.708341] nix-grpc-daemon[869]: time=2026-09-20T10:51:21.934Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4810lb # [ 52.737081] niks3-server[1048]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4811lb # [ 52.750924] niks3-server[1048]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4812lb # [ 52.761995] niks3-server[1048]: 2026/09/20 10:51:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4813lb # [ 52.767198] niks3-server[1048]: 2026/09/20 10:51:22 INFO Signed narinfos id=10 count=14814worker1 # [ 52.773276] nix-grpc-daemon[869]: time=2026-09-20T10:51:21.998Z level=INFO msg="Uploading 1 narinfos"4815lb # [ 52.772621] niks3-server[1048]: 2026/09/20 10:51:22 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4816lb # [ 52.780965] niks3-server[1048]: 2026/09/20 10:51:22 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4817lb # [ 52.787295] niks3-server[1048]: 2026/09/20 10:51:22 INFO Completed upload id=104818worker1 # [ 52.790400] nix-grpc-daemon[869]: time=2026-09-20T10:51:22.016Z level=INFO msg="Upload complete. (280ms)"4819lb # [ 52.789101] niks3-server[1048]: 2026/09/20 10:51:22 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4820worker1 # [ 52.796914] nix-grpc-daemon[785]: ts=2026-09-20T10:51:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14821worker1 # [ 52.802244] nix-grpc-daemon[785]: ts=2026-09-20T10:51:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14822worker1 # [ 52.813711] nix-daemon[843]: reaped child process 892, status = succeeded4823client # [ 52.853077] systemd[1]: dedup1.service: Deactivated successfully.4824client # [ 52.856582] systemd[1]: dedup1.service: Consumed 110ms CPU time over 4.889s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.4825client # [ 52.862477] systemd[1]: dedup2.service: Deactivated successfully.4826client # [ 52.864564] systemd[1]: dedup2.service: Consumed 130ms CPU time over 3.817s wall clock time, 31.2M memory peak, 7.9K incoming IP traffic, 6.8K outgoing IP traffic.4827client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4828client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4829client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds)4830worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4831worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4832worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4833worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4834worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4835worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4836worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4837worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4838(finished: subtest: two clients wanting the same drv build it once, in 6.01 seconds)4839subtest: build hook: nix-daemon with builders = grpc://lb4840client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4841client # [ 54.120241] systemd[1]: Started Nix Daemon.4842client # [ 54.281259] nix-daemon[949]: accepted connection from pid 946, user root (trusted)4843worker1 # [ 54.423937] nix-grpc-daemon[785]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:366844844worker2 # [ 54.423946] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104845worker2 # [ 54.438891] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04846worker2 # [ 54.444421] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14847worker2 # [ 54.482517] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104848worker2 # [ 54.492966] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104849worker2 # [ 54.502977] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511104850worker2 # [ 54.522436] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4851worker2 # [ 54.708141] nix-daemon[845]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4852worker2 # [ 54.722078] nix-daemon[845]: reaped child process 1074, status = succeeded4853worker2 # [ 54.878408] nix-daemon[845]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)4854worker2 # [ 54.891163] nix-daemon[845]: reaped child process 1079, status = succeeded4855lb # [ 54.914353] niks3-server[1048]: 2026/09/20 10:51:24 INFO Received uploads request method=POST path=/api/pending_closures4856worker2 # [ 54.912100] nix-grpc-daemon[858]: time=2026-09-20T10:51:24.687Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4857worker2 # [ 54.914050] nix-grpc-daemon[858]: time=2026-09-20T10:51:24.689Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4858lb # [ 54.932552] niks3-server[1048]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4859lb # [ 54.937065] niks3-server[1048]: 2026/09/20 10:51:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4860lb # [ 54.940039] niks3-server[1048]: 2026/09/20 10:51:24 INFO Signed narinfos id=11 count=14861worker2 # [ 54.932858] nix-grpc-daemon[858]: time=2026-09-20T10:51:24.708Z level=INFO msg="Uploading 1 narinfos"4862lb # [ 54.944608] niks3-server[1048]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4863lb # [ 54.950330] niks3-server[1048]: 2026/09/20 10:51:24 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4864lb # [ 54.954607] niks3-server[1048]: 2026/09/20 10:51:24 INFO Completed upload id=114865worker2 # [ 54.947307] nix-grpc-daemon[858]: time=2026-09-20T10:51:24.723Z level=INFO msg="Upload complete. (411ms)"4866worker2 # [ 54.949307] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_in=5124867lb # [ 54.957347] niks3-server[1048]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4868worker2 # [ 54.952578] nix-grpc-daemon[784]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104869worker2 # [ 54.958585] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4870worker2 # [ 54.961677] nix-daemon[845]: reaped child process 1069, status = succeeded4871worker2 # [ 54.967770] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4872worker2 # [ 55.794355] nix-daemon[845]: reaped child process 1083, status = succeeded4873worker2 # [ 55.951101] nix-daemon[845]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4874worker2 # [ 55.963225] nix-daemon[845]: reaped child process 1101, status = succeeded4875lb # [ 55.982184] niks3-server[1048]: 2026/09/20 10:51:25 INFO Received uploads request method=POST path=/api/pending_closures4876worker2 # [ 55.983192] nix-grpc-daemon[858]: time=2026-09-20T10:51:25.758Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4877worker2 # [ 55.986064] nix-grpc-daemon[858]: time=2026-09-20T10:51:25.760Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4878lb # [ 56.018147] niks3-server[1048]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4879lb # [ 56.030136] niks3-server[1048]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4880lb # [ 56.041525] niks3-server[1048]: 2026/09/20 10:51:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4881lb # [ 56.048747] niks3-server[1048]: 2026/09/20 10:51:25 INFO Signed narinfos id=12 count=14882worker2 # [ 56.044617] nix-grpc-daemon[858]: time=2026-09-20T10:51:25.820Z level=INFO msg="Uploading 1 narinfos"4883lb # [ 56.054480] niks3-server[1048]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4884lb # [ 56.064696] niks3-server[1048]: 2026/09/20 10:51:25 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4885lb # [ 56.067527] niks3-server[1048]: 2026/09/20 10:51:25 INFO Completed upload id=124886lb # [ 56.069137] niks3-server[1048]: 2026/09/20 10:51:25 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4887worker2 # [ 56.061545] nix-grpc-daemon[858]: time=2026-09-20T10:51:25.837Z level=INFO msg="Upload complete. (287ms)"4888worker2 # [ 56.067619] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14889worker2 # [ 56.080580] nix-daemon[845]: reaped child process 1081, status = succeeded4890worker1 # [ 56.125079] nix-grpc-daemon[785]: ts=2026-09-20T10:51:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:366844891worker1 # [ 56.139324] nix-grpc-daemon[785]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4892worker2 # [ 56.169464] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:511104893worker2 # [ 56.174982] nix-grpc-daemon[784]: ts=2026-09-20T10:51:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_out=1284894worker2 # [ 56.394795] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:511104895worker2 # [ 56.400845] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104896worker2 # [ 56.405891] nix-grpc-daemon[858]: time=2026-09-20T10:51:26.180Z level=INFO msg="All 1 paths already cached"4897worker2 # [ 56.416298] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04898worker2 # [ 56.421604] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14899worker2 # [ 56.426984] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104900worker2 # [ 56.439186] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104901worker2 # [ 56.451735] nix-grpc-daemon[858]: time=2026-09-20T10:51:26.227Z level=INFO msg="All 1 paths already cached"4902worker2 # [ 56.458214] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511104903worker2 # [ 56.466209] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4904worker2 # [ 56.634324] nix-daemon[845]: accepted connection from pid 1107, user nix-grpc-daemon (trusted)4905worker2 # [ 56.648222] nix-daemon[845]: reaped child process 1110, status = succeeded4906worker2 # [ 56.812745] nix-daemon[845]: accepted connection from pid 1112, user nix-grpc-daemon (trusted)4907worker2 # [ 56.825488] nix-daemon[845]: reaped child process 1115, status = succeeded4908lb # [ 56.845305] niks3-server[1048]: 2026/09/20 10:51:26 INFO Received uploads request method=POST path=/api/pending_closures4909worker2 # [ 56.845679] nix-grpc-daemon[858]: time=2026-09-20T10:51:26.621Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4910worker2 # [ 56.847185] nix-grpc-daemon[858]: time=2026-09-20T10:51:26.621Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4911lb # [ 56.870312] niks3-server[1048]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4912lb # [ 56.882247] niks3-server[1048]: 2026/09/20 10:51:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4913lb # [ 56.888301] niks3-server[1048]: 2026/09/20 10:51:26 INFO Signed narinfos id=13 count=14914worker2 # [ 56.883906] nix-grpc-daemon[858]: time=2026-09-20T10:51:26.659Z level=INFO msg="Uploading 1 narinfos"4915lb # [ 56.891421] niks3-server[1048]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4916lb # [ 56.906321] niks3-server[1048]: 2026/09/20 10:51:26 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4917lb # [ 56.911328] niks3-server[1048]: 2026/09/20 10:51:26 INFO Completed upload id=134918worker2 # [ 56.906397] nix-grpc-daemon[858]: time=2026-09-20T10:51:26.682Z level=INFO msg="Upload complete. (428ms)"4919lb # [ 56.914661] niks3-server[1048]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4920worker2 # [ 56.909436] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_in=6244921worker2 # [ 56.914480] nix-grpc-daemon[784]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104922worker2 # [ 56.923310] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4923worker2 # [ 56.930153] nix-daemon[845]: reaped child process 1105, status = succeeded4924worker2 # [ 56.933644] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4925lb # [ 57.658960] envoy[910]: conn peer=[2001:db8:1::1]:33048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1353 ms=46694926lb # [ 57.662796] envoy[910]: conn peer=[2001:db8:1::1]:33056 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1589 tx=1486 ms=35144927lb # [ 57.666381] envoy[910]: conn peer=[2001:db8:1::1]:52216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3411 tx=1748 ms=17834928lb # [ 57.669907] envoy[910]: conn peer=[2001:db8:1::1]:52226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=334929worker2 # [ 57.757891] nix-daemon[845]: reaped child process 1119, status = succeeded4930worker2 # [ 57.916610] nix-daemon[845]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)4931worker2 # [ 57.929061] nix-daemon[845]: reaped child process 1137, status = succeeded4932lb # [ 57.946700] niks3-server[1048]: 2026/09/20 10:51:27 INFO Received uploads request method=POST path=/api/pending_closures4933worker2 # [ 57.946626] nix-grpc-daemon[858]: time=2026-09-20T10:51:27.722Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4934worker2 # [ 57.949560] nix-grpc-daemon[858]: time=2026-09-20T10:51:27.724Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4935lb # [ 57.979419] niks3-server[1048]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4936lb # [ 57.987131] niks3-server[1048]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4937lb # [ 57.999140] niks3-server[1048]: 2026/09/20 10:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4938worker2 # [ 57.997350] nix-grpc-daemon[858]: time=2026-09-20T10:51:27.773Z level=INFO msg="Uploading 1 narinfos"4939lb # [ 58.004668] niks3-server[1048]: 2026/09/20 10:51:27 INFO Signed narinfos id=14 count=14940lb # [ 58.009467] niks3-server[1048]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4941lb # [ 58.019512] niks3-server[1048]: 2026/09/20 10:51:27 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4942lb # [ 58.024710] niks3-server[1048]: 2026/09/20 10:51:27 INFO Completed upload id=144943lb # [ 58.026836] niks3-server[1048]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4944worker2 # [ 58.019056] nix-grpc-daemon[858]: time=2026-09-20T10:51:27.794Z level=INFO msg="Upload complete. (278ms)"4945worker2 # [ 58.026533] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14946worker1 # [ 58.038876] nix-grpc-daemon[785]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:366844947worker1 # [ 58.048112] nix-grpc-daemon[785]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4948worker2 # [ 58.039971] nix-daemon[845]: reaped child process 1117, status = succeeded4949worker2 # [ 58.066240] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:511104950worker2 # [ 58.071417] nix-grpc-daemon[784]: ts=2026-09-20T10:51:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_out=1764951worker1 # [ 58.297658] nix-grpc-daemon[785]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:366844952worker1 # [ 58.305537] nix-grpc-daemon[785]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366844953worker1 # [ 58.314632] nix-grpc-daemon[869]: time=2026-09-20T10:51:27.540Z level=INFO msg="All 2 paths already cached"4954worker2 # [ 58.319182] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04955worker2 # [ 58.321311] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14956worker2 # [ 58.363042] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104957worker2 # [ 58.371518] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511104958worker2 # [ 58.379685] nix-grpc-daemon[858]: time=2026-09-20T10:51:28.155Z level=INFO msg="All 2 paths already cached"4959worker2 # [ 58.384346] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511104960worker2 # [ 58.388307] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4961worker2 # [ 58.529647] nix-daemon[845]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4962worker2 # [ 58.542545] nix-daemon[845]: reaped child process 1146, status = succeeded4963worker2 # [ 58.698412] nix-daemon[845]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4964worker2 # [ 58.710558] nix-daemon[845]: reaped child process 1151, status = succeeded4965lb # [ 58.731956] niks3-server[1048]: 2026/09/20 10:51:27 INFO Received uploads request method=POST path=/api/pending_closures4966worker2 # [ 58.728917] nix-grpc-daemon[858]: time=2026-09-20T10:51:28.504Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4967worker2 # [ 58.730463] nix-grpc-daemon[858]: time=2026-09-20T10:51:28.506Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4968lb # [ 58.749615] niks3-server[1048]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4969lb # [ 58.752813] niks3-server[1048]: 2026/09/20 10:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4970lb # [ 58.754760] niks3-server[1048]: 2026/09/20 10:51:28 INFO Signed narinfos id=15 count=14971worker2 # [ 58.749081] nix-grpc-daemon[858]: time=2026-09-20T10:51:28.525Z level=INFO msg="Uploading 1 narinfos"4972lb # [ 58.757629] niks3-server[1048]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4973lb # [ 58.763155] niks3-server[1048]: 2026/09/20 10:51:28 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4974lb # [ 58.766699] niks3-server[1048]: 2026/09/20 10:51:28 INFO Completed upload id=154975worker2 # [ 58.759147] nix-grpc-daemon[858]: time=2026-09-20T10:51:28.535Z level=INFO msg="Upload complete. (364ms)"4976worker2 # [ 58.761070] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_in=7524977lb # [ 58.769438] niks3-server[1048]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4978worker2 # [ 58.764610] nix-grpc-daemon[784]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511104979worker2 # [ 58.771155] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4980worker2 # [ 58.773630] nix-daemon[845]: reaped child process 1141, status = succeeded4981worker2 # [ 58.779101] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4982worker2 # [ 59.805300] nix-daemon[845]: reaped child process 1155, status = succeeded4983worker2 # [ 59.960652] nix-daemon[845]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)4984worker2 # [ 59.972083] nix-daemon[845]: reaped child process 1173, status = succeeded4985lb # [ 59.994507] niks3-server[1048]: 2026/09/20 10:51:29 INFO Received uploads request method=POST path=/api/pending_closures4986worker2 # [ 59.995506] nix-grpc-daemon[858]: time=2026-09-20T10:51:29.771Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4987worker2 # [ 59.998065] nix-grpc-daemon[858]: time=2026-09-20T10:51:29.772Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4988lb # [ 60.035567] niks3-server[1048]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4989lb # [ 60.043286] niks3-server[1048]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4990lb # [ 60.054549] niks3-server[1048]: 2026/09/20 10:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4991worker2 # [ 60.053480] nix-grpc-daemon[858]: time=2026-09-20T10:51:29.829Z level=INFO msg="Uploading 1 narinfos"4992lb # [ 60.060653] niks3-server[1048]: 2026/09/20 10:51:29 INFO Signed narinfos id=16 count=14993lb # [ 60.066064] niks3-server[1048]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4994lb # [ 60.077244] niks3-server[1048]: 2026/09/20 10:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4995lb # [ 60.084104] niks3-server[1048]: 2026/09/20 10:51:29 INFO Completed upload id=164996worker2 # [ 60.076961] nix-grpc-daemon[858]: time=2026-09-20T10:51:29.852Z level=INFO msg="Upload complete. (290ms)"4997lb # [ 60.086047] niks3-server[1048]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4998worker2 # [ 60.084835] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14999worker2 # [ 60.091435] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:511105000worker2 # [ 60.101819] nix-daemon[845]: reaped child process 1153, status = succeeded5001worker2 # [ 60.104696] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:511105002worker2 # [ 60.108614] nix-grpc-daemon[784]: ts=2026-09-20T10:51:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=0 paths=1 nar_bytes_out=2325003client # [ 60.233532] nix-daemon[949]: reaped child process 951, status = succeeded5004client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.31 seconds)5005client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5006client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)5007client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5008client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)5009client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5010client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)5011(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.40 seconds)5012subtest: an input only one worker has still reaches the builder5013client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only5014client # this derivation will be built:5015client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5016client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5017client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.37 seconds)5018client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5019client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds)5020worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5021worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)5022worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5023worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)5024client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&25025client # [ 61.272910] nix-daemon[949]: accepted connection from pid 1029, user root (trusted)5026client # this derivation will be built:5027client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5028client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5029worker1 # [ 61.432307] nix-grpc-daemon[785]: ts=2026-09-20T10:51:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:366845030worker1 # [ 61.438901] nix-grpc-daemon[785]: ts=2026-09-20T10:51:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366845031worker1 # [ 61.605057] nix-daemon[843]: accepted connection from pid 944, user nix-grpc-daemon (trusted)5032worker1 # [ 61.616071] nix-daemon[843]: reaped child process 947, status = succeeded5033lb # [ 61.630785] niks3-server[1048]: 2026/09/20 10:51:30 INFO Received uploads request method=POST path=/api/pending_closures5034worker1 # [ 61.642222] nix-grpc-daemon[869]: time=2026-09-20T10:51:30.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5035worker1 # [ 61.644158] nix-grpc-daemon[869]: time=2026-09-20T10:51:30.869Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5036lb # [ 61.657940] niks3-server[1048]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5037lb # [ 61.673387] niks3-server[1048]: 2026/09/20 10:51:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5038lb # [ 61.678258] niks3-server[1048]: 2026/09/20 10:51:30 INFO Signed narinfos id=17 count=15039worker1 # [ 61.685187] nix-grpc-daemon[869]: time=2026-09-20T10:51:30.911Z level=INFO msg="Uploading 1 narinfos"5040lb # [ 61.684055] niks3-server[1048]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5041lb # [ 61.695991] niks3-server[1048]: 2026/09/20 10:51:30 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5042lb # [ 61.703525] niks3-server[1048]: 2026/09/20 10:51:30 INFO Completed upload id=175043worker1 # [ 61.706283] nix-grpc-daemon[869]: time=2026-09-20T10:51:30.932Z level=INFO msg="Upload complete. (268ms)"5044lb # [ 61.706242] niks3-server[1048]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5045worker2 # [ 61.711541] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05046worker2 # [ 61.713726] nix-grpc-daemon[784]: ts=2026-09-20T10:51:31Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=15047worker1 # [ 61.769569] nix-grpc-daemon[785]: ts=2026-09-20T10:51:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366845048worker1 # [ 61.782746] nix-grpc-daemon[785]: ts=2026-09-20T10:51:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366845049client # copying 2 paths to 'lb:50051'...5050client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5051worker1 # [ 61.798520] nix-grpc-daemon[785]: ts=2026-09-20T10:51:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366845052client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5053worker1 # [ 61.806180] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5054worker1 # [ 61.980112] nix-daemon[843]: accepted connection from pid 951, user nix-grpc-daemon (trusted)5055worker1 # [ 61.994271] nix-daemon[843]: reaped child process 954, status = succeeded5056worker1 # [ 62.159275] nix-daemon[843]: accepted connection from pid 956, user nix-grpc-daemon (trusted)5057worker1 # [ 62.172410] nix-daemon[843]: reaped child process 959, status = succeeded5058lb # [ 62.182347] niks3-server[1048]: 2026/09/20 10:51:31 INFO Received uploads request method=POST path=/api/pending_closures5059lb # [ 62.186671] niks3-server[1048]: 2026/09/20 10:51:31 INFO Received uploads request method=POST path=/api/pending_closures5060worker1 # [ 62.192884] nix-grpc-daemon[869]: time=2026-09-20T10:51:31.419Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5061worker1 # [ 62.194551] nix-grpc-daemon[869]: time=2026-09-20T10:51:31.420Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5062worker1 # [ 62.196476] nix-grpc-daemon[869]: time=2026-09-20T10:51:31.422Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5063lb # [ 62.205566] niks3-server[1048]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5064lb # [ 62.211244] niks3-server[1048]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5065lb # [ 62.216424] niks3-server[1048]: 2026/09/20 10:51:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5066lb # [ 62.218291] niks3-server[1048]: 2026/09/20 10:51:31 INFO Signed narinfos id=18 count=15067lb # [ 62.219952] niks3-server[1048]: 2026/09/20 10:51:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5068lb # [ 62.222240] niks3-server[1048]: 2026/09/20 10:51:31 INFO Signed narinfos id=19 count=25069worker1 # [ 62.225740] nix-grpc-daemon[869]: time=2026-09-20T10:51:31.451Z level=INFO msg="Uploading 3 narinfos"5070lb # [ 62.224167] niks3-server[1048]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5071lb # [ 62.234521] niks3-server[1048]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5072lb # [ 62.237030] niks3-server[1048]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5073lb # [ 62.241651] niks3-server[1048]: 2026/09/20 10:51:31 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5074lb # [ 62.244300] niks3-server[1048]: 2026/09/20 10:51:31 INFO Completed upload id=185075lb # [ 62.246506] niks3-server[1048]: 2026/09/20 10:51:31 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5076lb # [ 62.248144] niks3-server[1048]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5077lb # [ 62.250147] niks3-server[1048]: 2026/09/20 10:51:31 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5078lb # [ 62.252275] niks3-server[1048]: 2026/09/20 10:51:31 INFO Completed upload id=195079worker1 # [ 62.256450] nix-grpc-daemon[869]: time=2026-09-20T10:51:31.482Z level=INFO msg="Upload complete. (442ms)"5080worker1 # [ 62.260082] nix-grpc-daemon[785]: ts=2026-09-20T10:51:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=0 paths=2 nar_bytes_in=9765081worker1 # [ 62.262628] nix-grpc-daemon[785]: ts=2026-09-20T10:51:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366845082worker1 # [ 62.267280] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5083worker1 # [ 62.271873] nix-daemon[843]: reaped child process 949, status = succeeded5084worker1 # [ 62.277235] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5085client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5086client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5087worker1 # [ 63.304177] nix-daemon[843]: reaped child process 963, status = succeeded5088worker1 # [ 63.464911] nix-daemon[843]: accepted connection from pid 978, user nix-grpc-daemon (trusted)5089worker1 # [ 63.478378] nix-daemon[843]: reaped child process 981, status = succeeded5090lb # [ 63.491292] niks3-server[1048]: 2026/09/20 10:51:32 INFO Received uploads request method=POST path=/api/pending_closures5091worker1 # [ 63.503606] nix-grpc-daemon[869]: time=2026-09-20T10:51:32.729Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5092lb # [ 63.521157] niks3-server[1048]: 2026/09/20 10:51:32 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5093lb # [ 63.527349] niks3-server[1048]: 2026/09/20 10:51:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5094lb # [ 63.531461] niks3-server[1048]: 2026/09/20 10:51:32 INFO Signed narinfos id=20 count=15095worker1 # [ 63.540033] nix-grpc-daemon[869]: time=2026-09-20T10:51:32.765Z level=INFO msg="Uploading 1 narinfos"5096lb # [ 63.545947] niks3-server[1048]: 2026/09/20 10:51:32 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5097lb # [ 63.553786] niks3-server[1048]: 2026/09/20 10:51:32 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5098lb # [ 63.558142] niks3-server[1048]: 2026/09/20 10:51:32 INFO Completed upload id=205099worker1 # [ 63.563371] nix-grpc-daemon[869]: time=2026-09-20T10:51:32.789Z level=INFO msg="Upload complete. (278ms)"5100lb # [ 63.560725] niks3-server[1048]: 2026/09/20 10:51:32 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5101worker1 # [ 63.565927] nix-grpc-daemon[785]: ts=2026-09-20T10:51:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15102worker1 # [ 63.572930] nix-daemon[843]: reaped child process 961, status = succeeded5103client # copying 1 paths...5104worker2 # [ 63.604979] nix-grpc-daemon[784]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:511105105worker2 # [ 63.617583] nix-grpc-daemon[784]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5106client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5107worker1 # [ 63.658235] nix-grpc-daemon[785]: ts=2026-09-20T10:51:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:366845108worker1 # [ 63.663534] nix-grpc-daemon[785]: ts=2026-09-20T10:51:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=0 paths=1 nar_bytes_out=1205109client # [ 63.780143] nix-daemon[949]: reaped child process 1032, status = succeeded5110client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.69 seconds)5111client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25112client # [ 63.944524] nix-daemon[949]: accepted connection from pid 1050, user root (trusted)5113client # this derivation will be built:5114client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5115worker1 # [ 64.121782] nix-grpc-daemon[785]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:366845116client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5117worker2 # [ 64.115950] nix-grpc-daemon[784]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511105118worker2 # [ 64.139135] nix-grpc-daemon[784]: ts=2026-09-20T10:51:33Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05119worker2 # [ 64.144875] nix-grpc-daemon[784]: ts=2026-09-20T10:51:33Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15120worker2 # [ 64.150615] nix-grpc-daemon[784]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511105121worker2 # [ 64.162122] nix-grpc-daemon[784]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511105122client # copying 1 paths to 'lb:50051'...5123client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5124worker2 # [ 64.179286] nix-grpc-daemon[784]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511105125worker2 # [ 64.190601] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5126worker2 # [ 64.205870] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 1/5)5127worker2 # [ 64.287625] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 2/5)5128worker2 # [ 64.481776] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 3/5)5129worker2 # [ 64.485338] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 746 ms (attempt 4/5)5130worker2 # [ 65.235663] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5131worker2 # [ 65.241780] nix-grpc-daemon[784]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5132worker2 # [ 65.437483] nix-daemon[845]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)5133worker2 # [ 65.451552] nix-daemon[845]: reaped child process 1193, status = succeeded5134worker2 # [ 65.599044] nix-daemon[845]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5135worker2 # [ 65.611156] nix-daemon[845]: reaped child process 1198, status = succeeded5136lb # [ 65.632136] niks3-server[1048]: 2026/09/20 10:51:34 INFO Received uploads request method=POST path=/api/pending_closures5137worker2 # [ 65.632589] nix-grpc-daemon[858]: time=2026-09-20T10:51:35.408Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5138worker2 # [ 65.633970] nix-grpc-daemon[858]: time=2026-09-20T10:51:35.408Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5139lb # [ 65.655082] niks3-server[1048]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5140lb # [ 65.666922] niks3-server[1048]: 2026/09/20 10:51:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5141lb # [ 65.672105] niks3-server[1048]: 2026/09/20 10:51:34 INFO Signed narinfos id=21 count=15142worker2 # [ 65.667803] nix-grpc-daemon[858]: time=2026-09-20T10:51:35.443Z level=INFO msg="Uploading 1 narinfos"5143lb # [ 65.678217] niks3-server[1048]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5144lb # [ 65.689663] niks3-server[1048]: 2026/09/20 10:51:34 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5145worker2 # [ 65.687611] nix-grpc-daemon[858]: time=2026-09-20T10:51:35.463Z level=INFO msg="Upload complete. (427ms)"5146lb # [ 65.695082] niks3-server[1048]: 2026/09/20 10:51:34 INFO Completed upload id=215147worker2 # [ 65.689689] nix-grpc-daemon[784]: ts=2026-09-20T10:51:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 paths=1 nar_bytes_in=5605148lb # [ 65.698170] niks3-server[1048]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5149worker2 # [ 65.695095] nix-grpc-daemon[784]: ts=2026-09-20T10:51:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511105150worker2 # [ 65.701603] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5151worker2 # [ 65.709717] nix-daemon[845]: reaped child process 1183, status = succeeded5152worker2 # [ 65.711341] nix-grpc-daemon[784]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5153worker2 # [ 65.720195] nix-daemon[845]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5154client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5155client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5156worker2 # [ 66.934726] nix-daemon[845]: reaped child process 1203, status = succeeded5157worker2 # [ 67.075749] nix-daemon[845]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5158worker2 # [ 67.088354] nix-daemon[845]: reaped child process 1221, status = succeeded5159lb # [ 67.111820] niks3-server[1048]: 2026/09/20 10:51:36 INFO Received uploads request method=POST path=/api/pending_closures5160worker2 # [ 67.115341] nix-grpc-daemon[858]: time=2026-09-20T10:51:36.891Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5161lb # [ 67.145741] niks3-server[1048]: 2026/09/20 10:51:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5162worker2 # [ 67.147954] nix-grpc-daemon[858]: time=2026-09-20T10:51:36.923Z level=INFO msg="Uploading 1 narinfos"5163lb # [ 67.156134] niks3-server[1048]: 2026/09/20 10:51:36 INFO Signed narinfos id=22 count=15164lb # [ 67.159434] niks3-server[1048]: 2026/09/20 10:51:36 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5165lb # [ 67.167387] niks3-server[1048]: 2026/09/20 10:51:36 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5166lb # [ 67.178090] niks3-server[1048]: 2026/09/20 10:51:36 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5167worker2 # [ 67.175682] nix-grpc-daemon[858]: time=2026-09-20T10:51:36.951Z level=INFO msg="Upload complete. (247ms)"5168lb # [ 67.183440] niks3-server[1048]: 2026/09/20 10:51:36 INFO Completed upload id=225169lb # [ 67.186167] niks3-server[1048]: 2026/09/20 10:51:36 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5170worker2 # [ 67.178941] nix-grpc-daemon[784]: ts=2026-09-20T10:51:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51110 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15171client # copying 1 paths...5172worker2 # [ 67.185502] nix-grpc-daemon[784]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:511105173worker2 # [ 67.187989] nix-daemon[845]: reaped child process 1200, status = succeeded5174client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5175worker1 # [ 67.214629] nix-grpc-daemon[785]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:366845176worker1 # [ 67.223471] nix-grpc-daemon[785]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5177worker1 # [ 67.235162] nix-grpc-daemon[785]: ts=2026-09-20T10:51:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=0 paths=1 nar_bytes_out=1205178client # [ 67.343453] nix-daemon[949]: reaped child process 1053, status = succeeded5179client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.57 seconds)5180client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25181client # [ 67.522422] nix-daemon[949]: accepted connection from pid 1071, user root (trusted)5182client # this derivation will be built:5183client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5184lb # [ 67.658932] envoy[910]: conn peer=[2001:db8:1::1]:52236 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1951 ms=16875185lb # [ 67.662915] envoy[910]: conn peer=[2001:db8:1::1]:52244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=175186lb # [ 67.666452] envoy[910]: conn peer=[2001:db8:1::1]:52264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=545187lb # [ 67.670266] envoy[910]: conn peer=[2001:db8:1::1]:52250 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2083 ms=18775188lb # [ 67.673767] envoy[910]: conn peer=[2001:db8:1::1]:52276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3832 tx=1857 ms=22875189lb # [ 67.677374] envoy[910]: conn peer=[2001:db8:1::1]:59530 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=595190lb # [ 67.680835] envoy[910]: conn peer=[2001:db8:1::1]:59538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1801 ms=31645191lb # [ 67.685496] envoy[910]: conn peer=[2001:db8:1::1]:59548 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=745192worker1 # [ 67.712173] nix-grpc-daemon[785]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:366845193client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5194worker1 # [ 67.718185] nix-grpc-daemon[785]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366845195worker1 # [ 67.724284] nix-grpc-daemon[869]: time=2026-09-20T10:51:36.948Z level=INFO msg="All 1 paths already cached"5196worker2 # [ 67.721627] nix-grpc-daemon[784]: ts=2026-09-20T10:51:37Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05197worker2 # [ 67.724345] nix-grpc-daemon[784]: ts=2026-09-20T10:51:37Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15198worker1 # [ 67.734622] nix-grpc-daemon[785]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366845199worker1 # [ 67.747782] nix-grpc-daemon[785]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366845200worker1 # [ 67.761653] nix-grpc-daemon[869]: time=2026-09-20T10:51:36.987Z level=INFO msg="All 1 paths already cached"5201client # copying 1 paths to 'lb:50051'...5202client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5203worker1 # [ 67.768371] nix-grpc-daemon[785]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366845204worker1 # [ 67.780082] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5205worker1 # [ 67.927613] nix-daemon[843]: accepted connection from pid 986, user nix-grpc-daemon (trusted)5206worker1 # [ 67.940604] nix-daemon[843]: reaped child process 989, status = succeeded5207worker1 # [ 68.103590] nix-daemon[843]: accepted connection from pid 991, user nix-grpc-daemon (trusted)5208worker1 # [ 68.116282] nix-daemon[843]: reaped child process 994, status = succeeded5209lb # [ 68.130557] niks3-server[1048]: 2026/09/20 10:51:37 INFO Received uploads request method=POST path=/api/pending_closures5210worker1 # [ 68.140748] nix-grpc-daemon[869]: time=2026-09-20T10:51:37.366Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5211worker1 # [ 68.142299] nix-grpc-daemon[869]: time=2026-09-20T10:51:37.368Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5212lb # [ 68.162114] niks3-server[1048]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5213lb # [ 68.171926] niks3-server[1048]: 2026/09/20 10:51:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5214worker1 # [ 68.181499] nix-grpc-daemon[869]: time=2026-09-20T10:51:37.407Z level=INFO msg="Uploading 1 narinfos"5215lb # [ 68.178580] niks3-server[1048]: 2026/09/20 10:51:37 INFO Signed narinfos id=23 count=15216lb # [ 68.183344] niks3-server[1048]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5217lb # [ 68.193948] niks3-server[1048]: 2026/09/20 10:51:37 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5218lb # [ 68.202250] niks3-server[1048]: 2026/09/20 10:51:37 INFO Completed upload id=235219lb # [ 68.204529] niks3-server[1048]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5220worker1 # [ 68.207179] nix-grpc-daemon[869]: time=2026-09-20T10:51:37.433Z level=INFO msg="Upload complete. (416ms)"5221worker1 # [ 68.210879] nix-grpc-daemon[785]: ts=2026-09-20T10:51:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=0 paths=1 nar_bytes_in=5605222worker1 # [ 68.217053] nix-grpc-daemon[785]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366845223worker1 # [ 68.227138] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5224worker1 # [ 68.232264] nix-daemon[843]: reaped child process 984, status = succeeded5225worker1 # [ 68.237312] nix-daemon[843]: accepted connection from pid 785, user nix-grpc-daemon (trusted)5226client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5227client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5228worker1 # [ 69.263209] nix-daemon[843]: reaped child process 998, status = succeeded5229worker1 # [ 69.411415] nix-daemon[843]: accepted connection from pid 1013, user nix-grpc-daemon (trusted)5230worker1 # [ 69.424519] nix-daemon[843]: reaped child process 1016, status = succeeded5231lb # [ 69.435723] niks3-server[1048]: 2026/09/20 10:51:38 INFO Received uploads request method=POST path=/api/pending_closures5232worker1 # [ 69.450178] nix-grpc-daemon[869]: time=2026-09-20T10:51:38.676Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5233lb # [ 69.468669] niks3-server[1048]: 2026/09/20 10:51:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5234lb # [ 69.474680] niks3-server[1048]: 2026/09/20 10:51:38 INFO Signed narinfos id=24 count=15235worker1 # [ 69.480950] nix-grpc-daemon[869]: time=2026-09-20T10:51:38.706Z level=INFO msg="Uploading 1 narinfos"5236lb # [ 69.479663] niks3-server[1048]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5237lb # [ 69.489733] niks3-server[1048]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5238lb # [ 69.498091] niks3-server[1048]: 2026/09/20 10:51:38 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5239worker1 # [ 69.506659] nix-grpc-daemon[869]: time=2026-09-20T10:51:38.732Z level=INFO msg="Upload complete. (259ms)"5240lb # [ 69.503669] niks3-server[1048]: 2026/09/20 10:51:38 INFO Completed upload id=245241lb # [ 69.509409] niks3-server[1048]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5242worker1 # [ 69.509544] nix-grpc-daemon[785]: ts=2026-09-20T10:51:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15243worker1 # [ 69.521403] nix-daemon[843]: reaped child process 996, status = succeeded5244client # copying 1 paths...5245worker2 # [ 69.547206] nix-grpc-daemon[784]: ts=2026-09-20T10:51:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:511105246worker2 # [ 69.560204] nix-grpc-daemon[784]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5247client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5248worker1 # [ 69.604158] nix-grpc-daemon[785]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:366845249worker1 # [ 69.608608] nix-grpc-daemon[785]: ts=2026-09-20T10:51:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36684 duration_s=0 paths=1 nar_bytes_out=1205250client # [ 69.676634] nix-daemon[949]: reaped child process 1074, status = succeeded5251client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.33 seconds)5252(finished: subtest: an input only one worker has still reaches the builder, in 9.36 seconds)5253subtest: upload whose reference the worker lacks is completed from the cache5254client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5255client # this derivation will be built:5256client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5257client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5258client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds)5259client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5260client # this derivation will be built:5261client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5262client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5263client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.39 seconds)5264client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5265client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5266worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5267worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds)5268worker2 # [ 70.870782] systemd[1]: Stopping Nix worker-protocol over gRPC...5269worker2 # [ 70.931556] nix-grpc-daemon[784]: ts=2026-09-20T10:51:40Z level=info event=signal_exit5270worker2 # [ 71.181914] nix-grpc-daemon[784]: ts=2026-09-20T10:51:40Z level=info event=scheduler_yield5271worker1 # [ 71.196384] nix-grpc-daemon[785]: ts=2026-09-20T10:51:40Z level=info event=scheduler_restarting addr=lb:500515272lb # [ 71.194479] niks3-server[1048]: 2026/09/20 10:51:40 INFO lead: released remote=192.168.1.4:358545273worker2 # [ 71.191983] nix-grpc-daemon[784]: ts=2026-09-20T10:51:40Z level=info event=scheduler_restarting addr=lb:500515274worker2 # [ 71.194108] nix-grpc-daemon[784]: ts=2026-09-20T10:51:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:511045275worker2 # [ 71.195413] nix-grpc-daemon[784]: ts=2026-09-20T10:51:40Z level=info event=worker_gone addr=192.168.1.3:500515276worker2 # [ 71.196575] nix-grpc-daemon[784]: ts=2026-09-20T10:51:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:511045277worker2 # [ 71.197840] nix-grpc-daemon[784]: ts=2026-09-20T10:51:40Z level=info event=worker_gone addr=192.168.1.4:500515278worker1 # [ 71.396502] nix-grpc-daemon[785]: ts=2026-09-20T10:51:40Z level=info event=scheduler_connected addr=lb:500515279worker1 # [ 71.400497] nix-grpc-daemon[785]: ts=2026-09-20T10:51:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5280worker2 # [ 71.393493] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515281worker2 # [ 71.397455] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5282worker1 # [ 71.601478] nix-grpc-daemon[785]: ts=2026-09-20T10:51:40Z level=info event=scheduler_connected addr=lb:500515283worker1 # [ 71.605360] nix-grpc-daemon[785]: ts=2026-09-20T10:51:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5284worker2 # [ 71.598140] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515285worker2 # [ 71.602184] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5286worker1 # [ 71.805782] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515287worker1 # [ 71.807648] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5288worker2 # [ 71.802533] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515289worker2 # [ 71.804606] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5290worker1 # [ 72.008770] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515291worker1 # [ 72.012574] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5292worker2 # [ 72.005813] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515293worker2 # [ 72.007594] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5294worker2 # [ 72.182888] nix-grpc-daemon[784]: ts=2026-09-20T10:51:41Z level=info event=scheduler_restarting5295worker1 # [ 72.213537] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515296worker1 # [ 72.215373] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5297worker2 # [ 72.214698] nix-daemon[845]: reaped child process 847, status = succeeded5298worker2 # [ 72.225993] nix-grpc-daemon[784]: ts=2026-09-20T10:51:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5299worker1 # [ 72.416592] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515300worker1 # [ 72.420499] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5301worker1 # [ 72.621521] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_connected addr=lb:500515302worker1 # [ 72.625526] nix-grpc-daemon[785]: ts=2026-09-20T10:51:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5303worker1 # [ 72.826242] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_connected addr=lb:500515304worker1 # [ 72.830111] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5305worker1 # [ 73.030795] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_connected addr=lb:500515306worker1 # [ 73.034786] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5307worker2 # [ 73.088439] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5308worker2 # [ 73.091992] nix-grpc-daemon[784]: E0000 00:00:1789901502.862921 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5309worker2 # [ 73.096792] nix-grpc-daemon[784]: E0000 00:00:1789901502.863552 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5310worker1 # [ 73.237255] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_connected addr=lb:500515311worker1 # [ 73.240438] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5312worker1 # [ 73.438587] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_connected addr=lb:500515313worker1 # [ 73.442576] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5314worker1 # [ 73.643663] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_connected addr=lb:500515315worker1 # [ 73.647577] nix-grpc-daemon[785]: ts=2026-09-20T10:51:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5316worker1 # [ 73.848506] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_connected addr=lb:500515317worker1 # [ 73.852645] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5318worker2 # [ 73.963563] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5319worker2 # [ 73.968320] systemd[1]: Stopped Nix worker-protocol over gRPC.5320worker2 # [ 73.970417] systemd[1]: nix-grpc-daemon.service: Consumed 2.711s CPU time over 56.314s wall clock time, 63.9M memory peak, 92.8K incoming IP traffic, 184.6K outgoing IP traffic.5321worker2 # [ 73.980838] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5322worker2 # [ 73.984167] systemd[1]: Closed Nix worker-protocol over gRPC.5323worker2 # [ 73.986510] systemd[1]: nix-grpc-daemon.socket: Consumed 305us CPU time over 1min 4.339s wall clock time, 256K memory peak, 91.1K incoming IP traffic, 72.9K outgoing IP traffic.5324lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5325lb: must succeed: curl -sf localhost:9901/clusters5326worker1 # [ 74.053195] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_connected addr=lb:500515327worker1 # [ 74.056896] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5328lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5329lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5330client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25331worker1 # [ 74.257655] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_connected addr=lb:500515332worker1 # [ 74.259336] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5333worker1 # [ 74.292444] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366845334worker1 # [ 74.298414] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:366845335client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5336client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.26 seconds)5337worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5338worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5339worker2 # [ 74.404277] systemd[1]: Listening on Nix worker-protocol over gRPC.5340worker1 # [ 74.460550] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_connected addr=lb:500515341worker1 # [ 74.465342] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5342worker1 # [ 74.479874] systemd[1]: Stopping Nix worker-protocol over gRPC...5343worker1 # [ 74.665429] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_connected addr=lb:500515344worker1 # [ 74.667380] nix-grpc-daemon[785]: ts=2026-09-20T10:51:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5345worker1 # [ 74.868626] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500515346worker1 # [ 74.872487] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5347worker1 # [ 74.920251] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=signal_exit5348worker2 # [ 74.954447] systemd[1]: Starting Nix worker-protocol over gRPC...5349worker1 # [ 75.073171] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500515350worker1 # [ 75.076856] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5351lb # [ 75.085702] niks3-server[1048]: 2026/09/20 10:51:44 INFO lead: acquired remote=192.168.1.3:484965352worker1 # [ 75.088839] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_take_over5353lb # [ 75.088314] niks3-server[1048]: 2026/09/20 10:51:44 INFO lead: released remote=192.168.1.3:484965354worker1 # [ 75.091891] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_yield5355worker2 # [ 75.111818] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5356worker2 # [ 75.113680] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15357worker2 # [ 75.119895] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5358worker2 # [ 75.126792] systemd[1]: Started Nix worker-protocol over gRPC.5359lb # [ 75.136733] niks3-server[1048]: 2026/09/20 10:51:44 INFO lead: acquired remote=192.168.1.4:491225360worker2 # [ 75.132177] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:44Z level=info event=scheduler_take_over5361worker2 # [ 75.149928] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500515362worker2 # [ 75.151526] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5363worker1 # [ 75.278984] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500515364worker1 # [ 75.282178] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5365worker2 # [ 75.352618] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500515366worker2 # [ 75.356666] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5367worker1 # [ 75.480118] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500515368worker1 # [ 75.484245] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5369worker2 # [ 75.557630] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500515370worker2 # [ 75.561715] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5371worker1 # [ 75.684770] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500515372worker1 # [ 75.686542] nix-grpc-daemon[785]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5373worker2 # [ 75.762819] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500515374worker2 # [ 75.766989] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5375worker1 # [ 75.887271] nix-grpc-daemon[785]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500515376worker1 # [ 75.889165] nix-grpc-daemon[785]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5377worker2 # [ 75.967906] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500515378worker2 # [ 75.972105] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5379worker1 # [ 76.090130] nix-grpc-daemon[785]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500515380worker1 # [ 76.095284] nix-grpc-daemon[785]: ts=2026-09-20T10:51:45Z level=info event=scheduler_restarting5381worker1 # [ 76.100893] nix-grpc-daemon[785]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5382worker1 # [ 76.121776] nix-daemon[843]: reaped child process 845, status = succeeded5383worker2 # [ 76.173651] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500515384worker2 # [ 76.181728] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05385worker1 # [ 76.309889] nix-grpc-daemon[785]: ts=2026-09-20T10:51:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5386worker1 # [ 77.050587] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5387worker1 # [ 77.054588] nix-grpc-daemon[785]: E0000 00:00:1789901506.276384 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5388worker1 # [ 77.059500] nix-grpc-daemon[785]: E0000 00:00:1789901506.280537 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5389lb # [ 77.659672] envoy[910]: conn peer=[2001:db8:1::1]:59572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=185390lb # [ 77.663522] envoy[910]: conn peer=[2001:db8:1::1]:59558 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1916 ms=19115391lb # [ 77.667120] envoy[910]: conn peer=[2001:db8:1::4]:34658 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=15303 tx=3137 ms=542565392lb # [ 77.670731] envoy[910]: conn peer=[2001:db8:1::1]:33416 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=195393lb # [ 77.674314] envoy[910]: conn peer=192.168.1.3:41468 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=18692 tx=3389 ms=583245394worker1 # [ 77.907889] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5395worker1 # [ 77.910215] systemd[1]: Stopped Nix worker-protocol over gRPC.5396worker1 # [ 77.911071] systemd[1]: nix-grpc-daemon.service: Consumed 1.511s CPU time over 1min 255ms wall clock time, 49.8M memory peak, 54.6K incoming IP traffic, 104.3K outgoing IP traffic.5397worker1 # [ 77.915105] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5398worker1 # [ 77.916856] systemd[1]: Closed Nix worker-protocol over gRPC.5399worker1 # [ 77.918211] systemd[1]: nix-grpc-daemon.socket: Consumed 321us CPU time over 1min 8.713s wall clock time, 256K memory peak, 60.4K incoming IP traffic, 53.5K outgoing IP traffic.5400lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5401lb: must succeed: curl -sf localhost:9901/clusters5402lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5403lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5404client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25405worker2 # [ 78.209278] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:452745406worker2 # [ 78.221534] nix-daemon[845]: accepted connection from pid 1245, user nix-grpc-daemon (trusted)5407worker2 # [ 78.238653] nix-grpc-daemon[1245]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)5408worker2 # [ 78.284526] nix-grpc-daemon[1245]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 2/5)5409worker2 # [ 78.296282] nix-grpc-daemon[1245]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 385 ms (attempt 3/5)5410worker2 # [ 78.687252] nix-grpc-daemon[1245]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 4/5)5411worker2 # [ 78.845496] nix-grpc-daemon[1245]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5412client # copying 2 paths...5413client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5414worker2 # [ 78.864132] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:452745415client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5416worker2 # [ 78.876174] nix-daemon[845]: accepted connection from pid 1245, user nix-grpc-daemon (trusted)5417worker2 # [ 78.897185] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:48Z level=info event=niks3_push_started pid=13015418worker2 # [ 79.256315] nix-daemon[845]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5419worker2 # [ 79.268100] nix-daemon[845]: reaped child process 1317, status = succeeded5420lb # [ 79.292439] niks3-server[1048]: 2026/09/20 10:51:48 INFO Received uploads request method=POST path=/api/pending_closures5421lb # [ 79.300886] niks3-server[1048]: 2026/09/20 10:51:48 INFO Received uploads request method=POST path=/api/pending_closures5422worker2 # [ 79.300629] nix-grpc-daemon[1301]: time=2026-09-20T10:51:49.076Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5423worker2 # [ 79.302179] nix-grpc-daemon[1301]: time=2026-09-20T10:51:49.078Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5424worker2 # [ 79.304548] nix-grpc-daemon[1301]: time=2026-09-20T10:51:49.079Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5425lb # [ 79.338365] niks3-server[1048]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5426lb # [ 79.369467] niks3-server[1048]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5427lb # [ 79.371845] niks3-server[1048]: 2026/09/20 10:51:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5428lb # [ 79.375956] niks3-server[1048]: 2026/09/20 10:51:48 INFO Signed narinfos id=25 count=15429lb # [ 79.377540] niks3-server[1048]: 2026/09/20 10:51:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5430lb # [ 79.380784] niks3-server[1048]: 2026/09/20 10:51:48 INFO Signed narinfos id=26 count=25431worker2 # [ 79.373133] nix-grpc-daemon[1301]: time=2026-09-20T10:51:49.148Z level=INFO msg="Uploading 3 narinfos"5432lb # [ 79.395593] niks3-server[1048]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5433lb # [ 79.401896] niks3-server[1048]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5434lb # [ 79.406219] niks3-server[1048]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5435lb # [ 79.409852] niks3-server[1048]: 2026/09/20 10:51:48 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5436lb # [ 79.414858] niks3-server[1048]: 2026/09/20 10:51:48 INFO Completed upload id=255437lb # [ 79.416319] niks3-server[1048]: 2026/09/20 10:51:48 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5438lb # [ 79.419247] niks3-server[1048]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5439lb # [ 79.421057] niks3-server[1048]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5440lb # [ 79.423793] niks3-server[1048]: 2026/09/20 10:51:48 INFO Completed upload id=265441worker2 # [ 79.418107] nix-grpc-daemon[1301]: time=2026-09-20T10:51:49.193Z level=INFO msg="Upload complete. (328ms)"5442worker2 # [ 79.423897] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45274 duration_s=0 paths=2 nar_bytes_in=3125443worker2 # [ 79.437397] nix-daemon[845]: reaped child process 1299, status = succeeded5444client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.47 seconds)5445worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5446worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5447worker1 # [ 79.559608] systemd[1]: Listening on Nix worker-protocol over gRPC.5448worker1 # [ 79.566585] systemd[1]: Starting Nix worker-protocol over gRPC...5449worker1 # [ 79.708332] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5450worker1 # [ 79.712060] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15451worker1 # [ 79.718799] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5452worker1 # [ 79.720373] systemd[1]: Started Nix worker-protocol over gRPC.5453lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5454lb: must succeed: curl -sf localhost:9901/clusters5455worker1 # [ 79.754750] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:48Z level=info event=scheduler_connected addr=lb:500515456worker2 # [ 79.746885] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05457lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5458lb: must succeed: curl -sf localhost:9901/clusters5459lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5460lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5461(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.19 seconds)5462subtest: scheduler down: the other node takes the lock and keeps it5463lb: must succeed: curl -sf localhost:9901/clusters5464lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5465lb: must succeed: curl -sf localhost:9901/clusters5466lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5467lb: must succeed: curl -sf localhost:9901/clusters5468lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5469lb: must succeed: curl -sf localhost:9901/clusters5470lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5471worker2 # [ 81.092518] systemd[1]: Stopping Nix worker-protocol over gRPC...5472worker2 # [ 81.126447] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:50Z level=info event=signal_exit5473worker2 # [ 81.137554] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:50Z level=info event=scheduler_yield5474lb # [ 81.147934] niks3-server[1048]: 2026/09/20 10:51:50 INFO lead: released remote=192.168.1.4:491225475worker1 # [ 81.155324] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:50Z level=info event=scheduler_restarting addr=lb:500515476worker2 # [ 81.145798] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452725477worker2 # [ 81.152079] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:50Z level=info event=worker_gone addr=192.168.1.3:500515478worker2 # [ 81.155214] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:50Z level=info event=scheduler_restarting addr=lb:500515479worker2 # [ 81.158949] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452725480worker2 # [ 81.162342] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:50Z level=info event=worker_gone addr=192.168.1.4:500515481worker1 # [ 81.355639] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:50Z level=info event=scheduler_connected addr=lb:500515482worker1 # [ 81.357645] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5483worker2 # [ 81.351517] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515484worker2 # [ 81.355467] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5485worker1 # [ 81.558639] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:50Z level=info event=scheduler_connected addr=lb:500515486worker1 # [ 81.562628] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5487worker2 # [ 81.556467] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515488worker2 # [ 81.560277] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5489worker1 # [ 81.763412] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:50Z level=info event=scheduler_connected addr=lb:500515490worker1 # [ 81.767376] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5491worker2 # [ 81.761391] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515492worker2 # [ 81.765209] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5493worker1 # [ 81.968115] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515494worker1 # [ 81.971978] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5495worker2 # [ 81.966135] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515496worker2 # [ 81.970112] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5497worker2 # [ 82.146458] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=scheduler_restarting5498worker2 # [ 82.150270] nix-grpc-daemon[1245]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5499worker2 # [ 82.154128] nix-grpc-daemon[1245]: E0000 00:00:1789901511.922175 1288 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5500worker2 # [ 82.159143] nix-grpc-daemon[1245]: E0000 00:00:1789901511.929795 1288 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5501worker1 # [ 82.174619] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515502worker1 # [ 82.177800] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5503worker2 # [ 82.181246] nix-grpc-daemon[1245]: ts=2026-09-20T10:51:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5504worker2 # [ 82.189479] nix-daemon[845]: reaped child process 1294, status = succeeded5505worker1 # [ 82.375587] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515506worker1 # [ 82.379577] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5507worker1 # [ 82.580599] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_connected addr=lb:500515508worker1 # [ 82.584608] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5509worker1 # [ 82.785515] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_connected addr=lb:500515510worker1 # [ 82.789454] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5511worker1 # [ 82.990257] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_connected addr=lb:500515512worker1 # [ 82.994092] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5513worker2 # [ 83.138822] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5514worker2 # [ 83.141887] systemd[1]: Stopped Nix worker-protocol over gRPC.5515worker2 # [ 83.145808] systemd[1]: nix-grpc-daemon.service: Consumed 357ms CPU time over 8.183s wall clock time, 32.6M memory peak, 18.5K incoming IP traffic, 24.5K outgoing IP traffic.5516worker2 # [ 83.157227] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5517worker2 # [ 83.161486] systemd[1]: Closed Nix worker-protocol over gRPC.5518worker2 # [ 83.165446] systemd[1]: nix-grpc-daemon.socket: Consumed 314us CPU time over 8.761s wall clock time, 256K memory peak, 18.8K incoming IP traffic, 14.1K outgoing IP traffic.5519worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5520worker1 # [ 83.196540] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_connected addr=lb:500515521worker1 # [ 83.200790] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5522worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds)5523worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5524worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5525worker1 # [ 83.397558] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_connected addr=lb:500515526worker1 # [ 83.401565] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5527worker1 # [ 83.602526] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_connected addr=lb:500515528worker1 # [ 83.606528] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5529worker1 # [ 83.807397] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_connected addr=lb:500515530worker1 # [ 83.811457] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5531worker1 # [ 84.012451] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_connected addr=lb:500515532worker1 # [ 84.016422] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5533worker1 # [ 84.218527] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_connected addr=lb:500515534worker1 # [ 84.221937] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5535worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5536worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5537worker1 # [ 84.422917] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_connected addr=lb:500515538worker1 # [ 84.426930] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5539worker1 # [ 84.627829] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_connected addr=lb:500515540worker1 # [ 84.631782] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5541worker1 # [ 84.731531] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:53Z level=info event=scheduler_take_over5542lb # [ 84.728653] niks3-server[1048]: 2026/09/20 10:51:53 INFO lead: acquired remote=192.168.1.3:581585543worker1 # [ 84.832752] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:54Z level=info event=scheduler_connected addr=lb:500515544worker1 # [ 84.836790] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5545worker1 # [ 85.037631] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:54Z level=info event=scheduler_connected addr=lb:500515546worker1 # [ 85.045609] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05547worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5548worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5549client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25550worker1 # [ 85.640839] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:354705551worker1 # [ 85.652118] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5552client # don't know how to build these paths:5553client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5554worker1 # [ 85.667182] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354705555worker1 # [ 85.678378] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)5556worker1 # [ 85.718973] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 2/5)5557worker1 # [ 85.799986] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 3/5)5558worker1 # [ 85.889294] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 788 ms (attempt 4/5)5559worker1 # [ 86.684838] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5560worker1 # [ 86.714791] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:55Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05561worker1 # [ 86.719984] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:55Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15562worker1 # [ 86.760240] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705563worker1 # [ 86.774144] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354705564client # copying 1 paths to 'lb:50051'...5565client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5566worker1 # [ 86.786754] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354705567worker1 # [ 86.798213] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5568worker1 # [ 86.818127] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:56Z level=info event=niks3_push_started pid=11125569worker1 # [ 87.152106] nix-daemon[843]: accepted connection from pid 1125, user nix-grpc-daemon (trusted)5570worker1 # [ 87.165277] nix-daemon[843]: reaped child process 1128, status = succeeded5571worker1 # [ 87.322211] nix-daemon[843]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5572worker1 # [ 87.336922] nix-daemon[843]: reaped child process 1133, status = succeeded5573lb # [ 87.350614] niks3-server[1048]: 2026/09/20 10:51:56 INFO Received uploads request method=POST path=/api/pending_closures5574worker1 # [ 87.366210] nix-grpc-daemon[1112]: time=2026-09-20T10:51:56.589Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5575worker1 # [ 87.367766] nix-grpc-daemon[1112]: time=2026-09-20T10:51:56.590Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5576lb # [ 87.386100] niks3-server[1048]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5577lb # [ 87.397680] niks3-server[1048]: 2026/09/20 10:51:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5578worker1 # [ 87.409083] nix-grpc-daemon[1112]: time=2026-09-20T10:51:56.634Z level=INFO msg="Uploading 1 narinfos"5579lb # [ 87.405844] niks3-server[1048]: 2026/09/20 10:51:56 INFO Signed narinfos id=27 count=15580lb # [ 87.415526] niks3-server[1048]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5581lb # [ 87.423561] niks3-server[1048]: 2026/09/20 10:51:56 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5582lb # [ 87.428483] niks3-server[1048]: 2026/09/20 10:51:56 INFO Completed upload id=275583worker1 # [ 87.431616] nix-grpc-daemon[1112]: time=2026-09-20T10:51:56.657Z level=INFO msg="Upload complete. (430ms)"5584lb # [ 87.433053] niks3-server[1048]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5585worker1 # [ 87.435210] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=0 paths=1 nar_bytes_in=5205586worker1 # [ 87.441319] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705587worker1 # [ 87.451063] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5588worker1 # [ 87.455775] nix-daemon[843]: reaped child process 1110, status = succeeded5589worker1 # [ 87.461158] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5590client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5591client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5592lb # [ 87.659935] envoy[910]: conn peer=[2001:db8:1::1]:33420 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=12295593lb # [ 87.663683] envoy[910]: conn peer=[2001:db8:1::4]:42868 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2293 tx=535 ms=70245594client # farm-a> LOG-farm-a-on-standby5595worker1 # [ 88.689261] nix-daemon[843]: reaped child process 1137, status = succeeded5596worker1 # [ 88.836100] nix-daemon[843]: accepted connection from pid 1152, user nix-grpc-daemon (trusted)5597worker1 # [ 88.849121] nix-daemon[843]: reaped child process 1155, status = succeeded5598lb # [ 88.857817] niks3-server[1048]: 2026/09/20 10:51:58 INFO Received uploads request method=POST path=/api/pending_closures5599worker1 # [ 88.866120] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.091Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5600worker1 # [ 88.871063] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.094Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5601lb # [ 88.876038] niks3-server[1048]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5602lb # [ 88.882340] niks3-server[1048]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5603lb # [ 88.886925] niks3-server[1048]: 2026/09/20 10:51:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5604lb # [ 88.889199] niks3-server[1048]: 2026/09/20 10:51:58 INFO Signed narinfos id=28 count=15605worker1 # [ 88.893924] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.119Z level=INFO msg="Uploading 1 narinfos"5606lb # [ 88.896338] niks3-server[1048]: 2026/09/20 10:51:58 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5607lb # [ 88.911748] niks3-server[1048]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5608lb # [ 88.923858] niks3-server[1048]: 2026/09/20 10:51:58 INFO Completed upload id=285609worker1 # [ 88.927163] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.153Z level=INFO msg="Upload complete. (258ms)"5610lb # [ 88.931757] niks3-server[1048]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5611worker1 # [ 88.934213] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15612worker1 # [ 88.943419] nix-daemon[843]: reaped child process 1135, status = succeeded5613worker1 # [ 88.945943] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05614worker1 # [ 88.947769] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15615worker1 # [ 88.992145] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705616worker1 # [ 89.003338] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354705617worker1 # [ 89.016522] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.242Z level=INFO msg="All 1 paths already cached"5618client # copying 1 paths to 'lb:50051'...5619client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5620worker1 # [ 89.022778] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354705621worker1 # [ 89.033133] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5622worker1 # [ 89.194663] nix-daemon[843]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5623worker1 # [ 89.210415] nix-daemon[843]: reaped child process 1164, status = succeeded5624worker1 # [ 89.363269] nix-daemon[843]: accepted connection from pid 1166, user nix-grpc-daemon (trusted)5625worker1 # [ 89.378214] nix-daemon[843]: reaped child process 1169, status = succeeded5626lb # [ 89.388914] niks3-server[1048]: 2026/09/20 10:51:58 INFO Received uploads request method=POST path=/api/pending_closures5627worker1 # [ 89.432870] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.658Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5628worker1 # [ 89.434396] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.658Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5629lb # [ 89.447466] niks3-server[1048]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5630lb # [ 89.456234] niks3-server[1048]: 2026/09/20 10:51:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5631lb # [ 89.461787] niks3-server[1048]: 2026/09/20 10:51:58 INFO Signed narinfos id=29 count=15632worker1 # [ 89.468526] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.694Z level=INFO msg="Uploading 1 narinfos"5633lb # [ 89.474438] niks3-server[1048]: 2026/09/20 10:51:58 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5634lb # [ 89.486437] niks3-server[1048]: 2026/09/20 10:51:58 INFO Completed upload id=295635worker1 # [ 89.489390] nix-grpc-daemon[1112]: time=2026-09-20T10:51:58.715Z level=INFO msg="Upload complete. (446ms)"5636lb # [ 89.489904] niks3-server[1048]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5637worker1 # [ 89.494157] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=0 paths=1 nar_bytes_in=6405638lb # [ 89.495509] niks3-server[1048]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5639worker1 # [ 89.502839] nix-grpc-daemon[1039]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705640worker1 # [ 89.512962] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5641worker1 # [ 89.521303] nix-daemon[843]: reaped child process 1159, status = succeeded5642worker1 # [ 89.530098] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5643client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5644client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5645client # farm-b> LOG-farm-b-on-standby5646worker1 # [ 90.558230] nix-daemon[843]: reaped child process 1173, status = succeeded5647worker1 # [ 90.709524] nix-daemon[843]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5648worker1 # [ 90.723477] nix-daemon[843]: reaped child process 1191, status = succeeded5649lb # [ 90.736255] niks3-server[1048]: 2026/09/20 10:51:59 INFO Received uploads request method=POST path=/api/pending_closures5650worker1 # [ 90.744595] nix-grpc-daemon[1112]: time=2026-09-20T10:51:59.970Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5651worker1 # [ 90.746089] nix-grpc-daemon[1112]: time=2026-09-20T10:51:59.972Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5652lb # [ 90.752499] niks3-server[1048]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5653lb # [ 90.760094] niks3-server[1048]: 2026/09/20 10:52:00 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5654lb # [ 90.762882] niks3-server[1048]: 2026/09/20 10:52:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5655lb # [ 90.764778] niks3-server[1048]: 2026/09/20 10:52:00 INFO Signed narinfos id=30 count=15656worker1 # [ 90.767817] nix-grpc-daemon[1112]: time=2026-09-20T10:51:59.993Z level=INFO msg="Uploading 1 narinfos"5657lb # [ 90.767405] niks3-server[1048]: 2026/09/20 10:52:00 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5658lb # [ 90.771587] niks3-server[1048]: 2026/09/20 10:52:00 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5659lb # [ 90.773966] niks3-server[1048]: 2026/09/20 10:52:00 INFO Completed upload id=305660worker1 # [ 90.777002] nix-grpc-daemon[1112]: time=2026-09-20T10:52:00.003Z level=WARN msg="Failed to register uploaded object" key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo error="server returned 404: object is not pending upload\n"5661worker1 # [ 90.780933] nix-grpc-daemon[1112]: time=2026-09-20T10:52:00.005Z level=INFO msg="Upload complete. (242ms)"5662worker1 # [ 90.784275] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15663worker1 # [ 90.788110] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05664worker1 # [ 90.789950] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15665worker1 # [ 90.795146] nix-daemon[843]: reaped child process 1171, status = succeeded5666worker1 # [ 90.832546] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705667worker1 # [ 90.843235] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354705668worker1 # [ 90.859465] nix-grpc-daemon[1112]: time=2026-09-20T10:52:00.085Z level=INFO msg="All 2 paths already cached"5669client # copying 1 paths to 'lb:50051'...5670client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5671worker1 # [ 90.868124] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354705672worker1 # [ 90.876139] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5673worker1 # [ 91.039070] nix-daemon[843]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)5674worker1 # [ 91.052720] nix-daemon[843]: reaped child process 1200, status = succeeded5675worker1 # [ 91.213625] nix-daemon[843]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5676worker1 # [ 91.227523] nix-daemon[843]: reaped child process 1205, status = succeeded5677lb # [ 91.238718] niks3-server[1048]: 2026/09/20 10:52:00 INFO Received uploads request method=POST path=/api/pending_closures5678worker1 # [ 91.246278] nix-grpc-daemon[1112]: time=2026-09-20T10:52:00.472Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5679worker1 # [ 91.247852] nix-grpc-daemon[1112]: time=2026-09-20T10:52:00.473Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5680lb # [ 91.256022] niks3-server[1048]: 2026/09/20 10:52:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5681lb # [ 91.258700] niks3-server[1048]: 2026/09/20 10:52:00 INFO Signed narinfos id=31 count=15682worker1 # [ 91.261575] nix-grpc-daemon[1112]: time=2026-09-20T10:52:00.487Z level=INFO msg="Uploading 1 narinfos"5683lb # [ 91.262301] niks3-server[1048]: 2026/09/20 10:52:00 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5684lb # [ 91.265469] niks3-server[1048]: 2026/09/20 10:52:00 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5685lb # [ 91.271793] niks3-server[1048]: 2026/09/20 10:52:00 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5686lb # [ 91.277083] niks3-server[1048]: 2026/09/20 10:52:00 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5687lb # [ 91.279517] niks3-server[1048]: 2026/09/20 10:52:00 INFO Completed upload id=315688worker1 # [ 91.282562] nix-grpc-daemon[1112]: time=2026-09-20T10:52:00.508Z level=INFO msg="Upload complete. (396ms)"5689worker1 # [ 91.284665] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=0 paths=1 nar_bytes_in=7685690worker1 # [ 91.288151] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705691worker1 # [ 91.292974] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5692worker1 # [ 91.297903] nix-daemon[843]: reaped child process 1195, status = succeeded5693client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5694client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5695worker1 # [ 91.303082] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5696client # farm-top> LOG-farm-top-on-standby5697worker1 # [ 92.327646] nix-daemon[843]: reaped child process 1209, status = succeeded5698worker1 # [ 92.488104] nix-daemon[843]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5699worker1 # [ 92.500590] nix-daemon[843]: reaped child process 1227, status = succeeded5700lb # [ 92.514968] niks3-server[1048]: 2026/09/20 10:52:01 INFO Received uploads request method=POST path=/api/pending_closures5701worker1 # [ 92.526549] nix-grpc-daemon[1112]: time=2026-09-20T10:52:01.752Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5702worker1 # [ 92.529070] nix-grpc-daemon[1112]: time=2026-09-20T10:52:01.754Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5703lb # [ 92.544748] niks3-server[1048]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5704lb # [ 92.564264] niks3-server[1048]: 2026/09/20 10:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5705lb # [ 92.568389] niks3-server[1048]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5706lb # [ 92.573480] niks3-server[1048]: 2026/09/20 10:52:01 INFO Signed narinfos id=32 count=15707worker1 # [ 92.579513] nix-grpc-daemon[1112]: time=2026-09-20T10:52:01.805Z level=INFO msg="Uploading 1 narinfos"5708lb # [ 92.578786] niks3-server[1048]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5709lb # [ 92.587089] niks3-server[1048]: 2026/09/20 10:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5710lb # [ 92.589659] niks3-server[1048]: 2026/09/20 10:52:01 INFO Completed upload id=325711worker1 # [ 92.592692] nix-grpc-daemon[1112]: time=2026-09-20T10:52:01.818Z level=INFO msg="Upload complete. (282ms)"5712lb # [ 92.591731] niks3-server[1048]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5713worker1 # [ 92.600060] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15714worker1 # [ 92.612274] nix-daemon[843]: reaped child process 1207, status = succeeded5715client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 7.21 seconds)5716client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5717client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.19 seconds)5718worker2 # [ 92.878755] systemd[1]: Listening on Nix worker-protocol over gRPC.5719worker2 # [ 92.886435] systemd[1]: Starting Nix worker-protocol over gRPC...5720worker2 # [ 93.046245] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5721worker2 # [ 93.049689] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15722worker2 # [ 93.056055] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5723worker2 # [ 93.059949] systemd[1]: Started Nix worker-protocol over gRPC.5724lb: must succeed: curl -sf localhost:9901/clusters5725worker2 # [ 93.097297] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:02Z level=info event=scheduler_connected addr=lb:500515726worker1 # [ 93.109935] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05727lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5728worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5729worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5730lb: must succeed: curl -sf localhost:9901/clusters5731lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5732lb: must succeed: curl -sf localhost:9901/clusters5733lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5734worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5735worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5736(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.50 seconds)5737subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5738client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5739client # [ 93.428910] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5740client # Running as unit: rs.service; invocation ID: fd679d60b7c449628954eeddd92c29305741client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5742worker2 # [ 93.616168] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473645743worker2 # [ 93.628462] nix-daemon[845]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5744client # [ 93.652322] nix[1172]: don't know how to build these paths:5745client # [ 93.653251] nix[1172]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5746worker1 # [ 93.663270] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:02Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05747worker1 # [ 93.667309] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:02Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15748worker1 # [ 93.706275] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705749worker1 # [ 93.719434] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354705750client # [ 93.730308] nix[1172]: copying 1 paths to 'lb:50051'...5751client # [ 93.733103] nix[1172]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5752worker1 # [ 93.732993] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354705753worker1 # [ 93.744640] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5754worker1 # [ 93.913464] nix-daemon[843]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5755worker1 # [ 93.927553] nix-daemon[843]: reaped child process 1243, status = succeeded5756worker1 # [ 94.080830] nix-daemon[843]: accepted connection from pid 1245, user nix-grpc-daemon (trusted)5757worker1 # [ 94.094295] nix-daemon[843]: reaped child process 1248, status = succeeded5758lb # [ 94.103796] niks3-server[1048]: 2026/09/20 10:52:03 INFO Received uploads request method=POST path=/api/pending_closures5759worker1 # [ 94.116185] nix-grpc-daemon[1112]: time=2026-09-20T10:52:03.341Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5760worker1 # [ 94.117768] nix-grpc-daemon[1112]: time=2026-09-20T10:52:03.343Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5761lb # [ 94.138069] niks3-server[1048]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5762lb # [ 94.150720] niks3-server[1048]: 2026/09/20 10:52:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5763lb # [ 94.157495] niks3-server[1048]: 2026/09/20 10:52:03 INFO Signed narinfos id=33 count=15764worker1 # [ 94.163653] nix-grpc-daemon[1112]: time=2026-09-20T10:52:03.389Z level=INFO msg="Uploading 1 narinfos"5765lb # [ 94.163771] niks3-server[1048]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5766lb # [ 94.172948] niks3-server[1048]: 2026/09/20 10:52:03 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5767lb # [ 94.181528] niks3-server[1048]: 2026/09/20 10:52:03 INFO Completed upload id=335768worker1 # [ 94.184525] nix-grpc-daemon[1112]: time=2026-09-20T10:52:03.410Z level=INFO msg="Upload complete. (427ms)"5769lb # [ 94.183373] niks3-server[1048]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5770worker1 # [ 94.188109] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=0 paths=1 nar_bytes_in=4165771worker1 # [ 94.193520] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354705772worker1 # [ 94.203224] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5773worker1 # [ 94.211278] nix-daemon[843]: reaped child process 1238, status = succeeded5774worker1 # [ 94.214312] nix-daemon[843]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5775client # [ 94.215456] nix[1172]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5776lb: must succeed: curl -sf localhost:9901/clusters5777lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5778lb: must succeed: curl -sf localhost:9901/clusters5779lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5780lb: must succeed: curl -sf localhost:9901/clusters5781lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5782lb: must succeed: curl -sf localhost:9901/clusters5783lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5784worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5785worker2 # [ 96.269119] systemd-journald[288]: Received client request to rotate journal, rotating.5786worker2 # [ 96.287112] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ff81f221367d4c76aaf2ef272b23254f.5787worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5788worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5789worker1 # [ 96.214720] systemd[1]: Stopping Nix worker-protocol over gRPC...5790worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5791??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5792 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735793client: must succeed: sleep 5.05794worker1 # [ 96.732042] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:05Z level=info event=draining5795lb # [ 97.660404] envoy[910]: conn peer=[2001:db8:1::1]:59614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9620 tx=3913 ms=69765796client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5797worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5798worker1 # [ 101.636594] nix-daemon[843]: reaped child process 1252, status = succeeded5799worker1 # [ 101.793161] nix-daemon[843]: accepted connection from pid 1292, user nix-grpc-daemon (trusted)5800worker1 # [ 101.805182] nix-daemon[843]: reaped child process 1295, status = succeeded5801lb # [ 101.819734] niks3-server[1048]: 2026/09/20 10:52:11 INFO Received uploads request method=POST path=/api/pending_closures5802worker1 # [ 101.833171] nix-grpc-daemon[1112]: time=2026-09-20T10:52:11.059Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5803worker1 # [ 101.834637] nix-grpc-daemon[1112]: time=2026-09-20T10:52:11.060Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5804lb # [ 101.866452] niks3-server[1048]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5805lb # [ 101.869114] niks3-server[1048]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5806lb # [ 101.873695] niks3-server[1048]: 2026/09/20 10:52:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5807lb # [ 101.876516] niks3-server[1048]: 2026/09/20 10:52:11 INFO Signed narinfos id=34 count=15808worker1 # [ 101.879342] nix-grpc-daemon[1112]: time=2026-09-20T10:52:11.105Z level=INFO msg="Uploading 1 narinfos"5809lb # [ 101.879646] niks3-server[1048]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5810lb # [ 101.884060] niks3-server[1048]: 2026/09/20 10:52:11 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5811lb # [ 101.887208] niks3-server[1048]: 2026/09/20 10:52:11 INFO Completed upload id=345812worker1 # [ 101.891583] nix-grpc-daemon[1112]: time=2026-09-20T10:52:11.117Z level=INFO msg="Upload complete. (263ms)"5813lb # [ 101.889634] niks3-server[1048]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5814worker1 # [ 101.899117] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35470 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15815worker1 # [ 101.909412] nix-daemon[843]: reaped child process 1250, status = succeeded5816client # [ 101.937280] systemd[1]: rs.service: Deactivated successfully.5817client # [ 101.939967] systemd[1]: rs.service: Consumed 116ms CPU time over 8.507s wall clock time, 39.1M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5818worker1 # [ 102.733721] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:11Z level=info event=signal_exit5819lb # [ 102.951374] niks3-server[1048]: 2026/09/20 10:52:12 INFO lead: released remote=192.168.1.3:581585820worker1 # [ 102.952911] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_yield5821worker2 # [ 102.948669] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:12Z level=info event=scheduler_restarting addr=lb:500515822worker1 # [ 102.959240] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_restarting addr=lb:500515823worker1 # [ 102.962321] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:354545824worker1 # [ 102.965607] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=worker_gone addr=192.168.1.4:500515825worker1 # [ 102.968605] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:354545826worker1 # [ 102.971865] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=worker_gone addr=192.168.1.3:500515827lb # [ 103.072716] niks3-server[1048]: 2026/09/20 10:52:12 INFO lead: acquired remote=192.168.1.4:503745828worker2 # [ 103.065786] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:12Z level=info event=scheduler_take_over5829worker1 # [ 103.158503] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500515830worker2 # [ 103.148186] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500515831worker1 # [ 103.162496] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5832worker2 # [ 103.152307] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5833worker1 # [ 103.363401] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500515834worker2 # [ 103.353059] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500515835worker2 # [ 103.357093] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5836worker1 # [ 103.367473] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5837worker2 # [ 103.557766] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500515838worker1 # [ 103.568370] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500515839worker1 # [ 103.572476] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5840worker2 # [ 103.562118] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5841worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.13 seconds)5842client: waiting for success: ! systemctl is-active rs5843client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5844client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5845client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5846client: must fail: journalctl -u rs | grep -q 'reconnecting'5847client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5848lb: must succeed: curl -sf localhost:9901/clusters5849worker2 # [ 103.762582] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500515850worker2 # [ 103.764482] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5851worker1 # [ 103.773276] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500515852worker1 # [ 103.777510] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5854worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5855worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5856worker1 # [ 103.954913] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:13Z level=info event=scheduler_restarting5857worker1 # [ 103.958449] nix-grpc-daemon[1039]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5858worker1 # [ 103.961638] nix-grpc-daemon[1039]: E0000 00:00:1789901533.184484 1082 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5859worker2 # [ 103.965776] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500515860worker2 # [ 103.967531] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5861worker1 # [ 103.978066] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500515862worker1 # [ 103.981754] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5863worker1 # [ 104.011428] nix-daemon[843]: reaped child process 1103, status = succeeded5864worker2 # [ 104.169488] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500515865worker2 # [ 104.177474] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05866worker1 # [ 104.195385] nix-grpc-daemon[1039]: ts=2026-09-20T10:52:13Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5867lb: must succeed: curl -sf localhost:9901/clusters5868lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5869worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5870worker1 # [ 104.954706] nix-grpc-daemon[1039]: E0000 00:00:1789901534.180278 1082 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5871worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5872worker1 # [ 105.252309] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5873worker1 # [ 105.253344] systemd[1]: Stopped Nix worker-protocol over gRPC.5874worker1 # [ 105.254279] systemd[1]: nix-grpc-daemon.service: Consumed 1.346s CPU time over 25.685s wall clock time, 35.7M memory peak, 48K incoming IP traffic, 92.1K outgoing IP traffic.5875worker1 # [ 105.261474] systemd[1]: Starting Nix worker-protocol over gRPC...5876worker1 # [ 105.419224] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5877worker1 # [ 105.421801] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15878worker1 # [ 105.428060] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5879worker1 # [ 105.431602] systemd[1]: Started Nix worker-protocol over gRPC.5880worker1 # [ 105.456664] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:14Z level=info event=scheduler_connected addr=lb:500515881worker2 # [ 105.448633] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:15Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05882lb: must succeed: curl -sf localhost:9901/clusters5883lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5884worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5885worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5886(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.78 seconds)5887subtest: scheduler restart mid-build: build finishes, no double build5888client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5889client # [ 106.208516] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5890client # Running as unit: mid.service; invocation ID: 2ec5992634a145c1b9024e719c3f11775891client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5892worker2 # [ 106.403785] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473645893client # [ 106.421695] nix[1207]: don't know how to build these paths:5894client # [ 106.422596] nix[1207]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5895worker2 # [ 106.420152] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:16Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05896worker2 # [ 106.425429] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:16Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15897worker2 # [ 106.464512] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473645898worker2 # [ 106.475965] nix-grpc-daemon[1338]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)5899worker2 # [ 106.556974] nix-grpc-daemon[1338]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 2/5)5900worker2 # [ 106.691275] nix-grpc-daemon[1338]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 135 ms (attempt 3/5)5901worker2 # [ 106.832601] nix-grpc-daemon[1338]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 527 ms (attempt 4/5)5902worker2 # [ 107.360321] nix-grpc-daemon[1338]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5903worker2 # [ 107.377891] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473645904client # [ 107.400350] nix[1207]: copying 1 paths to 'lb:50051'...5905worker2 # [ 107.389444] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473645906client # [ 107.402978] nix[1207]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5907worker2 # [ 107.402854] nix-daemon[845]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5908worker2 # [ 107.422226] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:17Z level=info event=niks3_push_started pid=14595909lb # [ 107.662182] envoy[910]: conn peer=[2001:db8:1::1]:33462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2934 tx=1325 ms=82845910lb # [ 107.666478] envoy[910]: conn peer=[2001:db8:1::3]:33974 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6163 tx=1399 ms=244365911worker2 # [ 107.747810] nix-daemon[845]: accepted connection from pid 1476, user nix-grpc-daemon (trusted)5912worker2 # [ 107.760317] nix-daemon[845]: reaped child process 1479, status = succeeded5913worker2 # [ 107.904341] nix-daemon[845]: accepted connection from pid 1481, user nix-grpc-daemon (trusted)5914worker2 # [ 107.916844] nix-daemon[845]: reaped child process 1484, status = succeeded5915lb # [ 107.944755] niks3-server[1048]: 2026/09/20 10:52:17 INFO Received uploads request method=POST path=/api/pending_closures5916worker2 # [ 107.944967] nix-grpc-daemon[1459]: time=2026-09-20T10:52:17.720Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5917worker2 # [ 107.948175] nix-grpc-daemon[1459]: time=2026-09-20T10:52:17.722Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5918lb # [ 107.977727] niks3-server[1048]: 2026/09/20 10:52:17 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5919lb # [ 107.985328] niks3-server[1048]: 2026/09/20 10:52:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5920lb # [ 107.991740] niks3-server[1048]: 2026/09/20 10:52:17 INFO Signed narinfos id=35 count=15921worker2 # [ 107.987545] nix-grpc-daemon[1459]: time=2026-09-20T10:52:17.763Z level=INFO msg="Uploading 1 narinfos"5922lb # [ 108.000829] niks3-server[1048]: 2026/09/20 10:52:17 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5923lb # [ 108.008791] niks3-server[1048]: 2026/09/20 10:52:17 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5924lb # [ 108.013261] niks3-server[1048]: 2026/09/20 10:52:17 INFO Completed upload id=355925worker2 # [ 108.006099] nix-grpc-daemon[1459]: time=2026-09-20T10:52:17.781Z level=INFO msg="Upload complete. (406ms)"5926lb # [ 108.016141] niks3-server[1048]: 2026/09/20 10:52:17 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5927worker2 # [ 108.009069] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47364 duration_s=0 paths=1 nar_bytes_in=4245928worker2 # [ 108.011515] nix-grpc-daemon[1338]: ts=2026-09-20T10:52:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473645929worker2 # [ 108.019145] nix-daemon[845]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5930worker2 # [ 108.021104] nix-daemon[845]: reaped child process 1457, status = succeeded5931worker2 # [ 108.026174] nix-daemon[845]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5932client # [ 108.038623] nix[1207]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5933lb: must succeed: curl -sf localhost:9901/clusters5934lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5935lb: must succeed: curl -sf localhost:9901/clusters5936lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5937worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5938worker2 # [ 110.012779] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1338 (nix-grpc-daemon) on client request.5939worker2 # [ 110.016346] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5940lb # [ 110.031290] niks3-server[1048]: 2026/09/20 10:52:19 INFO lead: released remote=192.168.1.4:503745941client # [ 110.043566] nix[1207]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5942client # [ 110.045599] nix[1207]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5943worker1 # [ 110.042073] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5944worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5945client: must succeed: sleep 5.05946worker2 # [ 110.048917] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5947worker2 # [ 110.050602] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5948worker2 # [ 110.052598] systemd[1]: nix-grpc-daemon.service: Consumed 448ms CPU time over 17.161s wall clock time, 33M memory peak, 14.5K incoming IP traffic, 23.2K outgoing IP traffic.5949worker2 # [ 110.055626] nix-daemon[845]: reaped child process 1486, status = succeeded5950worker2 # [ 110.056807] nix-daemon[845]: reaped child process 1394, status = succeeded5951worker2 # [ 110.065264] nix-daemon[1488]: unexpected Nix daemon error: error: interrupted by the user5952worker2 # [ 110.069074] nix-daemon[845]: reaped child process 1488, status = failed with exit code 15953worker2 # [ 110.180379] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5954worker2 # [ 110.188455] systemd[1]: Starting Nix worker-protocol over gRPC...5955worker1 # [ 110.242767] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:19Z level=info event=scheduler_connected addr=lb:500515956worker2 # [ 110.357685] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5957worker2 # [ 110.360949] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15958worker2 # [ 110.367401] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5959worker2 # [ 110.371480] systemd[1]: Started Nix worker-protocol over gRPC.5960worker2 # [ 110.381036] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=info event=scheduler_take_over5961lb # [ 110.387792] niks3-server[1048]: 2026/09/20 10:52:19 INFO lead: acquired remote=192.168.1.4:479945962worker2 # [ 110.386463] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05963worker2 # [ 110.404279] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=info event=scheduler_connected addr=lb:500515964worker2 # [ 110.405981] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05965worker2 # [ 110.540782] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05966worker2 # [ 110.542692] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:20Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15967worker1 # [ 110.601940] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379285968worker1 # [ 110.608175] nix-daemon[843]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5969worker1 # [ 110.616105] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 1/5)5970worker1 # [ 110.696857] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 2/5)5971worker1 # [ 110.770501] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 313 ms (attempt 3/5)5972worker1 # [ 111.090337] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 486 ms (attempt 4/5)5973worker1 # [ 111.582591] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5974worker1 # [ 111.599139] nix-grpc-daemon[1302]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5975worker1 # [ 111.619927] nix-daemon[843]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5976client # [ 111.635950] nix[1207]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5977worker1 # [ 111.635688] nix-daemon[843]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5978client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5979worker1 # [ 115.255482] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:24Z level=info event=niks3_push_started pid=14035980worker1 # [ 115.265462] nix-daemon[843]: reaped child process 1379, status = succeeded5981client: waiting for success: ! systemctl is-active mid5982worker1 # [ 115.610832] nix-daemon[843]: accepted connection from pid 1416, user nix-grpc-daemon (trusted)5983worker1 # [ 115.624061] nix-daemon[843]: reaped child process 1419, status = succeeded5984lb # [ 115.640628] niks3-server[1048]: 2026/09/20 10:52:24 INFO Received uploads request method=POST path=/api/pending_closures5985worker1 # [ 115.657299] nix-grpc-daemon[1403]: time=2026-09-20T10:52:24.883Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5986worker1 # [ 115.661156] nix-grpc-daemon[1403]: time=2026-09-20T10:52:24.885Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5987lb # [ 115.698284] niks3-server[1048]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5988lb # [ 115.703694] niks3-server[1048]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5989lb # [ 115.708227] niks3-server[1048]: 2026/09/20 10:52:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5990lb # [ 115.712262] niks3-server[1048]: 2026/09/20 10:52:24 INFO Signed narinfos id=36 count=15991worker1 # [ 115.718456] nix-grpc-daemon[1403]: time=2026-09-20T10:52:24.943Z level=INFO msg="Uploading 1 narinfos"5992lb # [ 115.719542] niks3-server[1048]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5993lb # [ 115.726646] niks3-server[1048]: 2026/09/20 10:52:24 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5994lb # [ 115.732071] niks3-server[1048]: 2026/09/20 10:52:24 INFO Completed upload id=365995lb # [ 115.733374] niks3-server[1048]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5996worker1 # [ 115.735457] nix-grpc-daemon[1403]: time=2026-09-20T10:52:24.961Z level=INFO msg="Upload complete. (303ms)"5997worker1 # [ 115.740346] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37928 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15998worker1 # [ 115.753766] nix-daemon[843]: reaped child process 1377, status = succeeded5999client # [ 115.777439] systemd[1]: mid.service: Deactivated successfully.6000client # [ 115.781262] systemd[1]: mid.service: Consumed 128ms CPU time over 9.571s wall clock time, 39.1M memory peak, 9.7K incoming IP traffic, 10.6K outgoing IP traffic.6001client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)6002client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6003client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)6004(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.28 seconds)6005subtest: interrupting the client stops the build on the worker6006client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr6007client # [ 116.471483] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.6008client # Running as unit: intr.service; invocation ID: 729517d3067f4c9cb2a20caa4cc140196009client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)6010worker1 # [ 116.677279] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379286011client # [ 116.685206] nix[1242]: don't know how to build these paths:6012client # [ 116.686097] nix[1242]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6013worker2 # [ 116.682990] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:26Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06014worker2 # [ 116.689068] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:26Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=16015worker2 # [ 116.733106] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466016worker2 # [ 116.739390] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6017worker2 # [ 116.748439] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5)6018worker2 # [ 116.797440] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 2/5)6019worker2 # [ 116.930536] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 232 ms (attempt 3/5)6020worker2 # [ 117.165544] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 4/5)6021worker2 # [ 117.334707] nix-grpc-daemon[1524]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6022worker2 # [ 117.350165] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466023client # [ 117.371144] nix[1242]: copying 1 paths to 'lb:50051'...6024client # [ 117.372117] nix[1242]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6025worker2 # [ 117.359985] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506466026worker2 # [ 117.368409] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6027worker2 # [ 117.388565] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:27Z level=info event=niks3_push_started pid=15966028lb # [ 117.661640] envoy[910]: conn peer=[2001:db8:1::4]:42614 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1754 tx=511 ms=169446029lb # [ 117.664936] envoy[910]: conn peer=[2001:db8:1::1]:50566 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1658 ms=93416030worker2 # [ 117.670092] nix-daemon[845]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6031worker2 # [ 117.688224] nix-daemon[845]: reaped child process 1614, status = succeeded6032worker2 # [ 117.817483] nix-daemon[845]: accepted connection from pid 1618, user nix-grpc-daemon (trusted)6033worker2 # [ 117.829951] nix-daemon[845]: reaped child process 1621, status = succeeded6034lb # [ 117.851553] niks3-server[1048]: 2026/09/20 10:52:27 INFO Received uploads request method=POST path=/api/pending_closures6035worker2 # [ 117.853089] nix-grpc-daemon[1596]: time=2026-09-20T10:52:27.628Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6036worker2 # [ 117.856098] nix-grpc-daemon[1596]: time=2026-09-20T10:52:27.630Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6037lb # [ 117.885270] niks3-server[1048]: 2026/09/20 10:52:27 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6038lb # [ 117.893604] niks3-server[1048]: 2026/09/20 10:52:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6039worker2 # [ 117.890543] nix-grpc-daemon[1596]: time=2026-09-20T10:52:27.666Z level=INFO msg="Uploading 1 narinfos"6040lb # [ 117.898297] niks3-server[1048]: 2026/09/20 10:52:27 INFO Signed narinfos id=37 count=16041lb # [ 117.910443] niks3-server[1048]: 2026/09/20 10:52:27 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6042worker2 # [ 117.910405] nix-grpc-daemon[1596]: time=2026-09-20T10:52:27.686Z level=INFO msg="Upload complete. (371ms)"6043lb # [ 117.918875] niks3-server[1048]: 2026/09/20 10:52:27 INFO Completed upload id=376044worker2 # [ 117.912859] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 paths=1 nar_bytes_in=4246045worker2 # [ 117.918573] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466046lb # [ 117.926403] niks3-server[1048]: 2026/09/20 10:52:27 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6047worker2 # [ 117.923841] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6048worker2 # [ 117.926347] nix-daemon[845]: reaped child process 1594, status = succeeded6049lb # [ 117.934292] niks3-server[1048]: 2026/09/20 10:52:27 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6050worker2 # [ 117.932817] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6051client # [ 117.943915] nix[1242]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6052client: must succeed: systemctl kill -s INT intr6053client # [ 120.021379] systemd[1]: intr.service: Sent signal SIGINT to main process 1242 (nix) on client request.6054client # [ 120.024927] nix[1242]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6055client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds)6056client # [ 120.029260] nix[1242]: error: interrupted by the user6057client # [ 120.053503] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6058client # [ 120.055749] systemd[1]: intr.service: Failed with result 'exit-code'.6059client # [ 120.057685] systemd[1]: intr.service: Consumed 106ms CPU time over 3.583s wall clock time, 39.3M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.6060worker2 # [ 120.150986] nix-daemon[1625]: unexpected Nix daemon error: error: interrupted by the user6061worker2 # [ 120.154556] nix-daemon[845]: reaped child process 1623, status = succeeded6062worker2 # [ 120.157308] nix-daemon[845]: reaped child process 1625, status = failed with exit code 16063(finished: subtest: interrupting the client stops the build on the worker, in 4.84 seconds)6064subtest: a deploy mid-build drains: the build finishes, the new generation takes over6065client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw6066client # [ 121.329496] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.6067client # Running as unit: sw.service; invocation ID: 766e87967d4f412aaf9c334b7f7bf3816068client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)6069client # [ 121.538614] nix[1262]: don't know how to build these paths:6070client # [ 121.539548] nix[1262]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6071worker2 # [ 121.526407] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506466072worker2 # [ 121.539472] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:31Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06073worker2 # [ 121.543687] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:31Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=16074worker1 # [ 121.594919] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379286075worker1 # [ 121.607325] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379286076client # [ 121.619358] nix[1262]: copying 1 paths to 'lb:50051'...6077worker1 # [ 121.619183] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379286078client # [ 121.621600] nix[1262]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6079worker1 # [ 121.632759] nix-daemon[843]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6080worker1 # [ 121.815126] nix-daemon[843]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)6081worker1 # [ 121.828592] nix-daemon[843]: reaped child process 1454, status = succeeded6082worker1 # [ 122.004131] nix-daemon[843]: accepted connection from pid 1456, user nix-grpc-daemon (trusted)6083worker1 # [ 122.017193] nix-daemon[843]: reaped child process 1459, status = succeeded6084lb # [ 122.030823] niks3-server[1048]: 2026/09/20 10:52:31 INFO Received uploads request method=POST path=/api/pending_closures6085worker1 # [ 122.046537] nix-grpc-daemon[1403]: time=2026-09-20T10:52:31.272Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6086worker1 # [ 122.048057] nix-grpc-daemon[1403]: time=2026-09-20T10:52:31.274Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6087lb # [ 122.066958] niks3-server[1048]: 2026/09/20 10:52:31 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6088lb # [ 122.077197] niks3-server[1048]: 2026/09/20 10:52:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6089worker1 # [ 122.088272] nix-grpc-daemon[1403]: time=2026-09-20T10:52:31.314Z level=INFO msg="Uploading 1 narinfos"6090lb # [ 122.084907] niks3-server[1048]: 2026/09/20 10:52:31 INFO Signed narinfos id=38 count=16091lb # [ 122.089738] niks3-server[1048]: 2026/09/20 10:52:31 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6092lb # [ 122.100060] niks3-server[1048]: 2026/09/20 10:52:31 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6093lb # [ 122.104936] niks3-server[1048]: 2026/09/20 10:52:31 INFO Completed upload id=386094worker1 # [ 122.110387] nix-grpc-daemon[1403]: time=2026-09-20T10:52:31.336Z level=INFO msg="Upload complete. (466ms)"6095lb # [ 122.109321] niks3-server[1048]: 2026/09/20 10:52:31 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6096worker1 # [ 122.113993] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37928 duration_s=0 paths=1 nar_bytes_in=4166097worker1 # [ 122.119914] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379286098worker1 # [ 122.128837] nix-daemon[843]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6099worker1 # [ 122.136910] nix-daemon[843]: reaped child process 1449, status = succeeded6100worker1 # [ 122.142943] nix-daemon[843]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6101client # [ 122.142695] nix[1262]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6102worker1: must succeed: systemctl reload nix-grpc-daemon.service6103worker1 # [ 123.896949] systemd[1]: Reloading Nix worker-protocol over gRPC...6104worker1 # [ 123.941864] systemd[1]: Reloaded Nix worker-protocol over gRPC.6105worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.09 seconds)6106worker1: must succeed: pgrep -f 'read -t [9]0 x'6107worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6108client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26109worker1 # [ 124.226436] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379286110client # don't know how to build these paths:6111client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6112worker2 # [ 124.224378] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466113worker2 # [ 124.249836] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:34Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06114worker2 # [ 124.254938] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:34Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16115worker2 # [ 124.294133] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466116worker2 # [ 124.306635] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466117client # copying 1 paths to 'lb:50051'...6118worker2 # [ 124.318968] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506466119client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6120worker2 # [ 124.338994] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6121worker1 # [ 124.438661] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:33Z level=info event=draining6122worker2 # [ 124.533492] nix-daemon[845]: accepted connection from pid 1679, user nix-grpc-daemon (trusted)6123worker2 # [ 124.546816] nix-daemon[845]: reaped child process 1682, status = succeeded6124worker2 # [ 124.719088] nix-daemon[845]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)6125worker2 # [ 124.730535] nix-daemon[845]: reaped child process 1687, status = succeeded6126lb # [ 124.752955] niks3-server[1048]: 2026/09/20 10:52:33 INFO Received uploads request method=POST path=/api/pending_closures6127worker2 # [ 124.752485] nix-grpc-daemon[1596]: time=2026-09-20T10:52:34.528Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6128worker2 # [ 124.754077] nix-grpc-daemon[1596]: time=2026-09-20T10:52:34.530Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6129lb # [ 124.776057] niks3-server[1048]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6130lb # [ 124.787294] niks3-server[1048]: 2026/09/20 10:52:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6131worker2 # [ 124.787167] nix-grpc-daemon[1596]: time=2026-09-20T10:52:34.563Z level=INFO msg="Uploading 1 narinfos"6132lb # [ 124.794554] niks3-server[1048]: 2026/09/20 10:52:34 INFO Signed narinfos id=39 count=16133lb # [ 124.798754] niks3-server[1048]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6134lb # [ 124.808867] niks3-server[1048]: 2026/09/20 10:52:34 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6135lb # [ 124.818382] niks3-server[1048]: 2026/09/20 10:52:34 INFO Completed upload id=396136worker2 # [ 124.813281] nix-grpc-daemon[1596]: time=2026-09-20T10:52:34.589Z level=INFO msg="Upload complete. (459ms)"6137lb # [ 124.820949] niks3-server[1048]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6138worker2 # [ 124.815587] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 paths=1 nar_bytes_in=5286139worker2 # [ 124.819920] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466140worker2 # [ 124.830464] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6141worker2 # [ 124.832139] nix-daemon[845]: reaped child process 1677, status = succeeded6142worker2 # [ 124.837121] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6143client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6144client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6145worker2 # [ 125.450807] nix-daemon[845]: reaped child process 1691, status = succeeded6146client # farm-a> LOG-farm-a-during-drain6147worker2 # [ 125.607878] nix-daemon[845]: accepted connection from pid 1706, user nix-grpc-daemon (trusted)6148worker2 # [ 125.621189] nix-daemon[845]: reaped child process 1709, status = succeeded6149lb # [ 125.645490] niks3-server[1048]: 2026/09/20 10:52:34 INFO Received uploads request method=POST path=/api/pending_closures6150worker2 # [ 125.648073] nix-grpc-daemon[1596]: time=2026-09-20T10:52:35.422Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6151worker2 # [ 125.649421] nix-grpc-daemon[1596]: time=2026-09-20T10:52:35.422Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6152lb # [ 125.680394] niks3-server[1048]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6153lb # [ 125.693973] niks3-server[1048]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6154lb # [ 125.705724] niks3-server[1048]: 2026/09/20 10:52:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6155worker2 # [ 125.704252] nix-grpc-daemon[1596]: time=2026-09-20T10:52:35.479Z level=INFO msg="Uploading 1 narinfos"6156lb # [ 125.711340] niks3-server[1048]: 2026/09/20 10:52:34 INFO Signed narinfos id=40 count=16157lb # [ 125.715630] niks3-server[1048]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6158lb # [ 125.725402] niks3-server[1048]: 2026/09/20 10:52:34 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6159lb # [ 125.733053] niks3-server[1048]: 2026/09/20 10:52:34 INFO Completed upload id=406160lb # [ 125.734840] niks3-server[1048]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6161worker2 # [ 125.725603] nix-grpc-daemon[1596]: time=2026-09-20T10:52:35.501Z level=INFO msg="Upload complete. (282ms)"6162worker2 # [ 125.733346] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16163worker2 # [ 125.740641] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:35Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06164worker2 # [ 125.744492] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:35Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16165worker2 # [ 125.753727] nix-daemon[845]: reaped child process 1689, status = succeeded6166worker2 # [ 125.786636] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466167worker2 # [ 125.798662] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466168worker2 # [ 125.812248] nix-grpc-daemon[1596]: time=2026-09-20T10:52:35.587Z level=INFO msg="All 1 paths already cached"6169client # copying 1 paths to 'lb:50051'...6170worker2 # [ 125.820464] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506466171client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6172worker2 # [ 125.845171] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6173worker2 # [ 126.032160] nix-daemon[845]: accepted connection from pid 1715, user nix-grpc-daemon (trusted)6174worker2 # [ 126.044911] nix-daemon[845]: reaped child process 1718, status = succeeded6175worker2 # [ 126.219558] nix-daemon[845]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6176worker2 # [ 126.232349] nix-daemon[845]: reaped child process 1723, status = succeeded6177lb # [ 126.256306] niks3-server[1048]: 2026/09/20 10:52:35 INFO Received uploads request method=POST path=/api/pending_closures6178worker2 # [ 126.253466] nix-grpc-daemon[1596]: time=2026-09-20T10:52:36.029Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6179worker2 # [ 126.255571] nix-grpc-daemon[1596]: time=2026-09-20T10:52:36.031Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6180lb # [ 126.271569] niks3-server[1048]: 2026/09/20 10:52:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6181lb # [ 126.274942] niks3-server[1048]: 2026/09/20 10:52:35 INFO Signed narinfos id=41 count=16182worker2 # [ 126.268989] nix-grpc-daemon[1596]: time=2026-09-20T10:52:36.044Z level=INFO msg="Uploading 1 narinfos"6183lb # [ 126.277282] niks3-server[1048]: 2026/09/20 10:52:35 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6184lb # [ 126.279468] niks3-server[1048]: 2026/09/20 10:52:35 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6185lb # [ 126.287495] niks3-server[1048]: 2026/09/20 10:52:35 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6186lb # [ 126.290636] niks3-server[1048]: 2026/09/20 10:52:35 INFO Completed upload id=416187worker2 # [ 126.284708] nix-grpc-daemon[1596]: time=2026-09-20T10:52:36.060Z level=INFO msg="Upload complete. (425ms)"6188lb # [ 126.292830] niks3-server[1048]: 2026/09/20 10:52:35 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6189worker2 # [ 126.286812] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 paths=1 nar_bytes_in=6406190worker2 # [ 126.289491] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466191worker2 # [ 126.296883] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6192worker2 # [ 126.299196] nix-daemon[845]: reaped child process 1713, status = succeeded6193worker2 # [ 126.304635] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6194client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6195client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6196client # farm-b> LOG-farm-b-during-drain6197worker2 # [ 127.331848] nix-daemon[845]: reaped child process 1727, status = succeeded6198worker2 # [ 127.490271] nix-daemon[845]: accepted connection from pid 1742, user nix-grpc-daemon (trusted)6199worker2 # [ 127.503377] nix-daemon[845]: reaped child process 1745, status = succeeded6200lb # [ 127.528440] niks3-server[1048]: 2026/09/20 10:52:36 INFO Received uploads request method=POST path=/api/pending_closures6201worker2 # [ 127.531031] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.306Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6202worker2 # [ 127.533280] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.308Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6203lb # [ 127.563916] niks3-server[1048]: 2026/09/20 10:52:36 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6204lb # [ 127.576963] niks3-server[1048]: 2026/09/20 10:52:36 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6205lb # [ 127.582090] niks3-server[1048]: 2026/09/20 10:52:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6206lb # [ 127.586621] niks3-server[1048]: 2026/09/20 10:52:36 INFO Signed narinfos id=42 count=16207worker2 # [ 127.582473] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.358Z level=INFO msg="Uploading 1 narinfos"6208lb # [ 127.597431] niks3-server[1048]: 2026/09/20 10:52:36 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6209lb # [ 127.602833] niks3-server[1048]: 2026/09/20 10:52:36 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6210lb # [ 127.609532] niks3-server[1048]: 2026/09/20 10:52:36 INFO Completed upload id=426211worker2 # [ 127.602309] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.378Z level=INFO msg="Upload complete. (289ms)"6212lb # [ 127.611061] niks3-server[1048]: 2026/09/20 10:52:36 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6213worker2 # [ 127.606459] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16214worker2 # [ 127.612291] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06215worker2 # [ 127.614403] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16216worker2 # [ 127.619313] nix-daemon[845]: reaped child process 1725, status = succeeded6217worker2 # [ 127.655244] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466218lb # [ 127.663353] envoy[910]: conn peer=[2001:db8:1::1]:53650 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=731 ms=33636219worker2 # [ 127.665444] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466220worker2 # [ 127.674606] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.450Z level=INFO msg="All 2 paths already cached"6221client # copying 1 paths to 'lb:50051'...6222worker2 # [ 127.679531] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506466223client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6224worker2 # [ 127.684615] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6225worker2 # [ 127.848592] nix-daemon[845]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)6226worker2 # [ 127.861509] nix-daemon[845]: reaped child process 1754, status = succeeded6227worker2 # [ 128.021802] nix-daemon[845]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6228worker2 # [ 128.034607] nix-daemon[845]: reaped child process 1759, status = succeeded6229lb # [ 128.057676] niks3-server[1048]: 2026/09/20 10:52:37 INFO Received uploads request method=POST path=/api/pending_closures6230worker2 # [ 128.059164] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.834Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6231worker2 # [ 128.060550] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.834Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6232lb # [ 128.085665] niks3-server[1048]: 2026/09/20 10:52:37 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6233lb # [ 128.095820] niks3-server[1048]: 2026/09/20 10:52:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6234lb # [ 128.100705] niks3-server[1048]: 2026/09/20 10:52:37 INFO Signed narinfos id=43 count=16235worker2 # [ 128.096586] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.872Z level=INFO msg="Uploading 1 narinfos"6236lb # [ 128.107697] niks3-server[1048]: 2026/09/20 10:52:37 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6237lb # [ 128.118111] niks3-server[1048]: 2026/09/20 10:52:37 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6238worker2 # [ 128.117486] nix-grpc-daemon[1596]: time=2026-09-20T10:52:37.893Z level=INFO msg="Upload complete. (426ms)"6239lb # [ 128.124812] niks3-server[1048]: 2026/09/20 10:52:37 INFO Completed upload id=436240lb # [ 128.128466] niks3-server[1048]: 2026/09/20 10:52:37 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6241worker2 # [ 128.119883] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 paths=1 nar_bytes_in=7686242worker2 # [ 128.125243] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466243worker2 # [ 128.134881] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6244worker2 # [ 128.139082] nix-daemon[845]: reaped child process 1749, status = succeeded6245client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6246client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6247worker2 # [ 128.144314] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6248client # farm-top> LOG-farm-top-during-drain6249worker2 # [ 129.771430] nix-daemon[845]: reaped child process 1763, status = succeeded6250worker2 # [ 129.917543] nix-daemon[845]: accepted connection from pid 1778, user nix-grpc-daemon (trusted)6251worker2 # [ 129.930378] nix-daemon[845]: reaped child process 1781, status = succeeded6252lb # [ 129.954409] niks3-server[1048]: 2026/09/20 10:52:39 INFO Received uploads request method=POST path=/api/pending_closures6253worker2 # [ 129.959290] nix-grpc-daemon[1596]: time=2026-09-20T10:52:39.734Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6254worker2 # [ 129.962057] nix-grpc-daemon[1596]: time=2026-09-20T10:52:39.736Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6255lb # [ 129.996950] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6256lb # [ 130.001904] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6257lb # [ 130.009266] niks3-server[1048]: 2026/09/20 10:52:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6258lb # [ 130.012369] niks3-server[1048]: 2026/09/20 10:52:39 INFO Signed narinfos id=44 count=16259worker2 # [ 130.008379] nix-grpc-daemon[1596]: time=2026-09-20T10:52:39.784Z level=INFO msg="Uploading 1 narinfos"6260lb # [ 130.019329] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6261lb # [ 130.027061] niks3-server[1048]: 2026/09/20 10:52:39 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6262lb # [ 130.031024] niks3-server[1048]: 2026/09/20 10:52:39 INFO Completed upload id=446263worker2 # [ 130.023789] nix-grpc-daemon[1596]: time=2026-09-20T10:52:39.799Z level=INFO msg="Upload complete. (269ms)"6264lb # [ 130.032633] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6265worker2 # [ 130.026400] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16266worker2 # [ 130.034057] nix-daemon[845]: reaped child process 1761, status = succeeded6267client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.09 seconds)6268client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6269client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.21 seconds)6270worker1: must succeed: pkill -f 'read -t [9]0 x'6271worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6272client: waiting for success: ! systemctl is-active sw6273worker1 # [ 130.362272] nix-daemon[843]: reaped child process 1463, status = succeeded6274worker1 # [ 130.517335] nix-daemon[843]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)6275worker1 # [ 130.530803] nix-daemon[843]: reaped child process 1507, status = succeeded6276lb # [ 130.545358] niks3-server[1048]: 2026/09/20 10:52:39 INFO Received uploads request method=POST path=/api/pending_closures6277worker1 # [ 130.557216] nix-grpc-daemon[1403]: time=2026-09-20T10:52:39.783Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6278worker1 # [ 130.558731] nix-grpc-daemon[1403]: time=2026-09-20T10:52:39.784Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6279lb # [ 130.585958] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6280lb # [ 130.592094] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6281lb # [ 130.602433] niks3-server[1048]: 2026/09/20 10:52:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6282lb # [ 130.607835] niks3-server[1048]: 2026/09/20 10:52:39 INFO Signed narinfos id=45 count=16283worker1 # [ 130.614589] nix-grpc-daemon[1403]: time=2026-09-20T10:52:39.839Z level=INFO msg="Uploading 1 narinfos"6284lb # [ 130.612391] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6285lb # [ 130.624149] niks3-server[1048]: 2026/09/20 10:52:39 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6286lb # [ 130.629551] niks3-server[1048]: 2026/09/20 10:52:39 INFO Completed upload id=456287lb # [ 130.631145] niks3-server[1048]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6288worker1 # [ 130.633894] nix-grpc-daemon[1403]: time=2026-09-20T10:52:39.860Z level=INFO msg="Upload complete. (278ms)"6289worker1 # [ 130.640639] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37928 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16290worker1 # [ 130.653544] nix-daemon[843]: reaped child process 1461, status = succeeded6291client # [ 130.676911] systemd[1]: sw.service: Deactivated successfully.6292client # [ 130.681676] systemd[1]: sw.service: Consumed 116ms CPU time over 9.350s wall clock time, 39.2M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.6293client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6294client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6295worker1 # [ 131.441896] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:40Z level=info event=signal_exit6296client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6297worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6298worker2 # [ 132.660481] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:586706299worker2 # [ 132.664128] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:42Z level=info event=worker_gone addr=192.168.1.3:500516300worker1 # [ 132.662888] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:41Z level=info event=scheduler_restarting6301worker1 # [ 132.681451] nix-grpc-daemon[1302]: ts=2026-09-20T10:52:41Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6302worker1 # [ 132.699144] nix-daemon[843]: reaped child process 1371, status = succeeded6303worker1 # [ 133.306489] nix-grpc-daemon[1302]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6304worker1 # [ 133.309988] nix-grpc-daemon[1302]: E0000 00:00:1789901562.532347 1345 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6305worker1 # [ 133.314702] nix-grpc-daemon[1302]: E0000 00:00:1789901562.532537 1345 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6306worker1 # [ 133.473913] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6307worker1 # [ 133.475141] systemd[1]: nix-grpc-daemon.service: Consumed 649ms CPU time over 28.211s wall clock time, 32.3M memory peak, 20.6K incoming IP traffic, 27.1K outgoing IP traffic.6308worker1 # [ 133.483535] systemd[1]: Starting Nix worker-protocol over gRPC...6309worker1 # [ 133.615340] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6310worker1 # [ 133.617860] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16311worker1 # [ 133.623681] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6312worker1 # [ 133.628026] systemd[1]: Started Nix worker-protocol over gRPC.6313worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.18 seconds)6314lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6315lb: must succeed: curl -sf localhost:9901/clusters6316worker1 # [ 133.657245] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500516317worker2 # [ 133.649492] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06318lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6319lb: must succeed: curl -sf localhost:9901/clusters6320lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6321lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.15 seconds)6322lb: must succeed: curl -sf localhost:9901/clusters6323lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6324worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6325worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6326(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.63 seconds)6327subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6328client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16329worker2 # [ 135.120631] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506466330worker1 # [ 135.137822] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966331worker1 # [ 135.149720] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6332worker1 # [ 135.166438] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)6333worker1 # [ 135.190266] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 2/5)6334worker1 # [ 135.283306] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 328 ms (attempt 3/5)6335worker1 # [ 135.611788] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 4/5)6336worker1 # [ 135.773105] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6337worker2 # [ 135.810182] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:45Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06338worker2 # [ 135.814966] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:45Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16339worker2 # [ 135.820798] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:45Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06340worker2 # [ 135.825389] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:45Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06341worker1 # [ 135.871958] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966342worker1 # [ 135.886201] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966343worker1 # [ 135.899271] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966344worker1 # [ 135.907070] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6345worker1 # [ 135.928966] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:45Z level=info event=niks3_push_started pid=15776346worker1 # [ 136.250332] nix-daemon[843]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6347worker1 # [ 136.263946] nix-daemon[843]: reaped child process 1593, status = succeeded6348worker1 # [ 136.396364] nix-daemon[843]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)6349worker1 # [ 136.408462] nix-daemon[843]: reaped child process 1598, status = succeeded6350lb # [ 136.418945] niks3-server[1048]: 2026/09/20 10:52:45 INFO Received uploads request method=POST path=/api/pending_closures6351worker1 # [ 136.428299] nix-grpc-daemon[1577]: time=2026-09-20T10:52:45.654Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6352worker1 # [ 136.429849] nix-grpc-daemon[1577]: time=2026-09-20T10:52:45.655Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6353lb # [ 136.448699] niks3-server[1048]: 2026/09/20 10:52:45 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6354lb # [ 136.458881] niks3-server[1048]: 2026/09/20 10:52:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6355lb # [ 136.463587] niks3-server[1048]: 2026/09/20 10:52:45 INFO Signed narinfos id=46 count=16356worker1 # [ 136.469884] nix-grpc-daemon[1577]: time=2026-09-20T10:52:45.695Z level=INFO msg="Uploading 1 narinfos"6357lb # [ 136.477149] niks3-server[1048]: 2026/09/20 10:52:45 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6358lb # [ 136.483104] niks3-server[1048]: 2026/09/20 10:52:45 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6359worker1 # [ 136.491780] nix-grpc-daemon[1577]: time=2026-09-20T10:52:45.717Z level=INFO msg="Upload complete. (374ms)"6360lb # [ 136.488626] niks3-server[1048]: 2026/09/20 10:52:45 INFO Completed upload id=466361worker1 # [ 136.493911] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=5046362worker1 # [ 136.497125] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966363lb # [ 136.493893] niks3-server[1048]: 2026/09/20 10:52:45 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6364worker1 # [ 136.503319] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6365worker1 # [ 136.507925] nix-daemon[843]: reaped child process 1575, status = succeeded6366worker1 # [ 136.513998] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6367lb # [ 137.663441] envoy[910]: conn peer=[2001:db8:1::1]:42316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9602 tx=3862 ms=58346368lb # [ 137.665059] envoy[910]: conn peer=[2001:db8:1::1]:53658 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2919 tx=1308 ms=91156369lb # [ 137.668281] envoy[910]: conn peer=[2001:db8:1::3]:51612 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1114 tx=448 ms=272176370worker1 # [ 137.740797] nix-daemon[843]: reaped child process 1602, status = succeeded6371worker1 # [ 137.870880] nix-daemon[843]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)6372worker1 # [ 137.883230] nix-daemon[843]: reaped child process 1620, status = succeeded6373lb # [ 137.895393] niks3-server[1048]: 2026/09/20 10:52:47 INFO Received uploads request method=POST path=/api/pending_closures6374worker1 # [ 137.906795] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.132Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6375worker1 # [ 137.908306] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.134Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6376lb # [ 137.929733] niks3-server[1048]: 2026/09/20 10:52:47 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6377lb # [ 137.943315] niks3-server[1048]: 2026/09/20 10:52:47 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6378lb # [ 137.955616] niks3-server[1048]: 2026/09/20 10:52:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6379worker1 # [ 137.964093] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.189Z level=INFO msg="Uploading 1 narinfos"6380lb # [ 137.960462] niks3-server[1048]: 2026/09/20 10:52:47 INFO Signed narinfos id=47 count=16381lb # [ 137.966344] niks3-server[1048]: 2026/09/20 10:52:47 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6382lb # [ 137.976104] niks3-server[1048]: 2026/09/20 10:52:47 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6383lb # [ 137.981521] niks3-server[1048]: 2026/09/20 10:52:47 INFO Completed upload id=476384worker1 # [ 137.984571] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.210Z level=INFO msg="Upload complete. (263ms)"6385lb # [ 137.983150] niks3-server[1048]: 2026/09/20 10:52:47 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6386worker1 # [ 137.989245] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16387worker2 # [ 137.979949] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:47Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16388worker1 # [ 138.000099] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966389worker2 # [ 137.990844] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:47Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06390worker1 # [ 138.007532] nix-daemon[843]: reaped child process 1600, status = succeeded6391worker1 # [ 138.013101] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966392worker1 # [ 138.022658] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966393worker1 # [ 138.030268] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6394worker1 # [ 138.179196] nix-daemon[843]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)6395worker1 # [ 138.191518] nix-daemon[843]: reaped child process 1627, status = succeeded6396worker1 # [ 138.340407] nix-daemon[843]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6397worker1 # [ 138.353129] nix-daemon[843]: reaped child process 1632, status = succeeded6398lb # [ 138.364313] niks3-server[1048]: 2026/09/20 10:52:47 INFO Received uploads request method=POST path=/api/pending_closures6399worker1 # [ 138.372235] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.597Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6400worker1 # [ 138.373643] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.598Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6401lb # [ 138.378404] niks3-server[1048]: 2026/09/20 10:52:47 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6402lb # [ 138.381269] niks3-server[1048]: 2026/09/20 10:52:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6403lb # [ 138.383489] niks3-server[1048]: 2026/09/20 10:52:47 INFO Signed narinfos id=48 count=16404worker1 # [ 138.388110] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.614Z level=INFO msg="Uploading 1 narinfos"6405lb # [ 138.388904] niks3-server[1048]: 2026/09/20 10:52:47 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6406lb # [ 138.392384] niks3-server[1048]: 2026/09/20 10:52:47 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6407lb # [ 138.396236] niks3-server[1048]: 2026/09/20 10:52:47 INFO Completed upload id=486408worker1 # [ 138.399254] nix-grpc-daemon[1577]: time=2026-09-20T10:52:47.625Z level=INFO msg="Upload complete. (364ms)"6409worker1 # [ 138.401262] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=5046410lb # [ 138.398720] niks3-server[1048]: 2026/09/20 10:52:47 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6411worker1 # [ 138.404295] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966412worker1 # [ 138.411071] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6413worker1 # [ 138.413586] nix-daemon[843]: reaped child process 1622, status = succeeded6414worker1 # [ 138.418765] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6415worker1 # [ 139.632795] nix-daemon[843]: reaped child process 1636, status = succeeded6416worker1 # [ 139.779301] nix-daemon[843]: accepted connection from pid 1651, user nix-grpc-daemon (trusted)6417worker1 # [ 139.791507] nix-daemon[843]: reaped child process 1654, status = succeeded6418lb # [ 139.805425] niks3-server[1048]: 2026/09/20 10:52:49 INFO Received uploads request method=POST path=/api/pending_closures6419worker1 # [ 139.818315] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.044Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6420worker1 # [ 139.819937] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.046Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6421lb # [ 139.834681] niks3-server[1048]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6422lb # [ 139.841716] niks3-server[1048]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6423lb # [ 139.845937] niks3-server[1048]: 2026/09/20 10:52:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6424lb # [ 139.848035] niks3-server[1048]: 2026/09/20 10:52:49 INFO Signed narinfos id=49 count=16425worker1 # [ 139.852776] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.078Z level=INFO msg="Uploading 1 narinfos"6426lb # [ 139.851430] niks3-server[1048]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6427lb # [ 139.857416] niks3-server[1048]: 2026/09/20 10:52:49 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6428lb # [ 139.860652] niks3-server[1048]: 2026/09/20 10:52:49 INFO Completed upload id=496429worker1 # [ 139.863759] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.089Z level=INFO msg="Upload complete. (238ms)"6430lb # [ 139.862315] niks3-server[1048]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6431worker1 # [ 139.866250] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16432worker1 # [ 139.873918] nix-daemon[843]: reaped child process 1634, status = succeeded6433worker2 # [ 139.859350] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:49Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16434worker1 # [ 139.877341] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966435worker1 # [ 139.883992] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966436worker2 # [ 139.871301] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:49Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06437worker1 # [ 139.889751] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966438worker1 # [ 139.894545] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6439worker1 # [ 140.052658] nix-daemon[843]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)6440worker1 # [ 140.065361] nix-daemon[843]: reaped child process 1661, status = succeeded6441worker1 # [ 140.233420] nix-daemon[843]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)6442worker1 # [ 140.245724] nix-daemon[843]: reaped child process 1666, status = succeeded6443lb # [ 140.259314] niks3-server[1048]: 2026/09/20 10:52:49 INFO Received uploads request method=POST path=/api/pending_closures6444worker1 # [ 140.270627] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.496Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6445worker1 # [ 140.272042] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.496Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6446lb # [ 140.284480] niks3-server[1048]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6447lb # [ 140.296883] niks3-server[1048]: 2026/09/20 10:52:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6448worker1 # [ 140.306555] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.532Z level=INFO msg="Uploading 1 narinfos"6449lb # [ 140.304614] niks3-server[1048]: 2026/09/20 10:52:49 INFO Signed narinfos id=50 count=16450lb # [ 140.307590] niks3-server[1048]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6451lb # [ 140.318433] niks3-server[1048]: 2026/09/20 10:52:49 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6452lb # [ 140.322195] niks3-server[1048]: 2026/09/20 10:52:49 INFO Completed upload id=506453worker1 # [ 140.325116] nix-grpc-daemon[1577]: time=2026-09-20T10:52:49.551Z level=INFO msg="Upload complete. (425ms)"6454lb # [ 140.323734] niks3-server[1048]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6455worker1 # [ 140.327263] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=5046456worker1 # [ 140.330579] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966457worker1 # [ 140.337779] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6458worker1 # [ 140.340104] nix-daemon[843]: reaped child process 1656, status = succeeded6459worker1 # [ 140.345772] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6460worker1 # [ 140.971939] nix-daemon[843]: reaped child process 1670, status = succeeded6461worker1 # [ 141.135619] nix-daemon[843]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6462worker1 # [ 141.148118] nix-daemon[843]: reaped child process 1688, status = succeeded6463lb # [ 141.161665] niks3-server[1048]: 2026/09/20 10:52:50 INFO Received uploads request method=POST path=/api/pending_closures6464worker1 # [ 141.172173] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.398Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6465worker1 # [ 141.173847] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.399Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6466lb # [ 141.192114] niks3-server[1048]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6467lb # [ 141.197591] niks3-server[1048]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6468lb # [ 141.204310] niks3-server[1048]: 2026/09/20 10:52:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6469lb # [ 141.208678] niks3-server[1048]: 2026/09/20 10:52:50 INFO Signed narinfos id=51 count=16470worker1 # [ 141.212048] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.437Z level=INFO msg="Uploading 1 narinfos"6471lb # [ 141.211983] niks3-server[1048]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6472lb # [ 141.216765] niks3-server[1048]: 2026/09/20 10:52:50 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6473lb # [ 141.220159] niks3-server[1048]: 2026/09/20 10:52:50 INFO Completed upload id=516474worker1 # [ 141.223121] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.449Z level=INFO msg="Upload complete. (270ms)"6475lb # [ 141.221899] niks3-server[1048]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6476worker1 # [ 141.225857] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16477worker1 # [ 141.230923] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966478worker2 # [ 141.218820] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:50Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16479worker1 # [ 141.238037] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966480worker1 # [ 141.240169] nix-daemon[843]: reaped child process 1668, status = succeeded6481worker2 # [ 141.228825] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:51Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06482worker1 # [ 141.244641] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.470Z level=INFO msg="All 1 paths already cached"6483worker1 # [ 141.247967] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966484worker1 # [ 141.253054] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6485worker1 # [ 141.410467] nix-daemon[843]: accepted connection from pid 1692, user nix-grpc-daemon (trusted)6486worker1 # [ 141.423208] nix-daemon[843]: reaped child process 1695, status = succeeded6487worker1 # [ 141.591442] nix-daemon[843]: accepted connection from pid 1697, user nix-grpc-daemon (trusted)6488worker1 # [ 141.603970] nix-daemon[843]: reaped child process 1700, status = succeeded6489lb # [ 141.614048] niks3-server[1048]: 2026/09/20 10:52:50 INFO Received uploads request method=POST path=/api/pending_closures6490worker1 # [ 141.621914] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6491worker1 # [ 141.623398] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.847Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6492lb # [ 141.626891] niks3-server[1048]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6493lb # [ 141.631450] niks3-server[1048]: 2026/09/20 10:52:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6494lb # [ 141.633574] niks3-server[1048]: 2026/09/20 10:52:50 INFO Signed narinfos id=52 count=16495worker1 # [ 141.638195] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.864Z level=INFO msg="Uploading 1 narinfos"6496lb # [ 141.638399] niks3-server[1048]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6497lb # [ 141.642922] niks3-server[1048]: 2026/09/20 10:52:50 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6498lb # [ 141.645884] niks3-server[1048]: 2026/09/20 10:52:50 INFO Completed upload id=526499worker1 # [ 141.648910] nix-grpc-daemon[1577]: time=2026-09-20T10:52:50.875Z level=INFO msg="Upload complete. (391ms)"6500worker1 # [ 141.650952] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=6246501lb # [ 141.648597] niks3-server[1048]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6502worker1 # [ 141.655837] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966503worker1 # [ 141.660955] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6504worker1 # [ 141.663274] nix-daemon[843]: reaped child process 1690, status = succeeded6505worker1 # [ 141.668525] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6506worker1 # [ 142.883226] nix-daemon[843]: reaped child process 1704, status = succeeded6507worker1 # [ 142.998376] nix-daemon[843]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)6508worker1 # [ 143.010819] nix-daemon[843]: reaped child process 1722, status = succeeded6509lb # [ 143.019316] niks3-server[1048]: 2026/09/20 10:52:52 INFO Received uploads request method=POST path=/api/pending_closures6510worker1 # [ 143.031181] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.257Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6511worker1 # [ 143.032667] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.258Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6512lb # [ 143.074190] niks3-server[1048]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6513lb # [ 143.077701] niks3-server[1048]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6514lb # [ 143.080401] niks3-server[1048]: 2026/09/20 10:52:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6515worker1 # [ 143.085799] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.311Z level=INFO msg="Uploading 1 narinfos"6516lb # [ 143.083388] niks3-server[1048]: 2026/09/20 10:52:52 INFO Signed narinfos id=53 count=16517lb # [ 143.087696] niks3-server[1048]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6518lb # [ 143.090708] niks3-server[1048]: 2026/09/20 10:52:52 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6519lb # [ 143.093930] niks3-server[1048]: 2026/09/20 10:52:52 INFO Completed upload id=536520worker1 # [ 143.098175] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.324Z level=INFO msg="Upload complete. (222ms)"6521lb # [ 143.096279] niks3-server[1048]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6522worker1 # [ 143.100641] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16523worker1 # [ 143.104825] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966524worker2 # [ 143.092224] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:52Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16525worker1 # [ 143.111351] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966526worker1 # [ 143.114175] nix-daemon[843]: reaped child process 1702, status = succeeded6527worker2 # [ 143.102338] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:52Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06528worker1 # [ 143.117635] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.343Z level=INFO msg="All 1 paths already cached"6529worker1 # [ 143.120779] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966530worker1 # [ 143.124501] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6531worker1 # [ 143.279436] nix-daemon[843]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)6532worker1 # [ 143.292472] nix-daemon[843]: reaped child process 1729, status = succeeded6533worker1 # [ 143.445949] nix-daemon[843]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6534worker1 # [ 143.458177] nix-daemon[843]: reaped child process 1734, status = succeeded6535lb # [ 143.465840] niks3-server[1048]: 2026/09/20 10:52:52 INFO Received uploads request method=POST path=/api/pending_closures6536worker1 # [ 143.477063] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.703Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6537worker1 # [ 143.478585] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.704Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6538lb # [ 143.497154] niks3-server[1048]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6539lb # [ 143.509714] niks3-server[1048]: 2026/09/20 10:52:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6540lb # [ 143.517674] niks3-server[1048]: 2026/09/20 10:52:52 INFO Signed narinfos id=54 count=16541worker1 # [ 143.524043] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.750Z level=INFO msg="Uploading 1 narinfos"6542lb # [ 143.521790] niks3-server[1048]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6543lb # [ 143.535117] niks3-server[1048]: 2026/09/20 10:52:52 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6544worker1 # [ 143.544803] nix-grpc-daemon[1577]: time=2026-09-20T10:52:52.770Z level=INFO msg="Upload complete. (414ms)"6545lb # [ 143.541778] niks3-server[1048]: 2026/09/20 10:52:52 INFO Completed upload id=546546lb # [ 143.543941] niks3-server[1048]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6547worker1 # [ 143.546773] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=6246548worker1 # [ 143.551428] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966549worker1 # [ 143.557236] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6550worker1 # [ 143.559565] nix-daemon[843]: reaped child process 1724, status = succeeded6551worker1 # [ 143.565052] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6552worker1 # [ 144.378396] nix-daemon[843]: reaped child process 1738, status = succeeded6553worker1 # [ 144.495441] nix-daemon[843]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)6554worker1 # [ 144.510163] nix-daemon[843]: reaped child process 1756, status = succeeded6555lb # [ 144.515835] niks3-server[1048]: 2026/09/20 10:52:53 INFO Received uploads request method=POST path=/api/pending_closures6556worker1 # [ 144.527427] nix-grpc-daemon[1577]: time=2026-09-20T10:52:53.753Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6557worker1 # [ 144.532248] nix-grpc-daemon[1577]: time=2026-09-20T10:52:53.755Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6558lb # [ 144.556259] niks3-server[1048]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6559lb # [ 144.562503] niks3-server[1048]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6560lb # [ 144.574165] niks3-server[1048]: 2026/09/20 10:52:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6561lb # [ 144.578477] niks3-server[1048]: 2026/09/20 10:52:53 INFO Signed narinfos id=55 count=16562worker1 # [ 144.584346] nix-grpc-daemon[1577]: time=2026-09-20T10:52:53.810Z level=INFO msg="Uploading 1 narinfos"6563lb # [ 144.584335] niks3-server[1048]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6564lb # [ 144.593469] niks3-server[1048]: 2026/09/20 10:52:53 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6565lb # [ 144.599471] niks3-server[1048]: 2026/09/20 10:52:53 INFO Completed upload id=556566lb # [ 144.601068] niks3-server[1048]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6567worker1 # [ 144.602660] nix-grpc-daemon[1577]: time=2026-09-20T10:52:53.828Z level=INFO msg="Upload complete. (230ms)"6568worker1 # [ 144.611470] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16569worker2 # [ 144.600547] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:54Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16570worker1 # [ 144.616156] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966571worker2 # [ 144.609338] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:54Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06572worker1 # [ 144.628841] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966573worker1 # [ 144.633207] nix-daemon[843]: reaped child process 1736, status = succeeded6574worker1 # [ 144.638243] nix-grpc-daemon[1577]: time=2026-09-20T10:52:53.864Z level=INFO msg="All 1 paths already cached"6575worker1 # [ 144.642527] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966576worker1 # [ 144.647497] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6577worker1 # [ 144.783124] nix-daemon[843]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)6578worker1 # [ 144.795784] nix-daemon[843]: reaped child process 1763, status = succeeded6579worker1 # [ 144.927588] nix-daemon[843]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6580worker1 # [ 144.939954] nix-daemon[843]: reaped child process 1768, status = succeeded6581lb # [ 144.946790] niks3-server[1048]: 2026/09/20 10:52:54 INFO Received uploads request method=POST path=/api/pending_closures6582worker1 # [ 144.955512] nix-grpc-daemon[1577]: time=2026-09-20T10:52:54.181Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6583worker1 # [ 144.956884] nix-grpc-daemon[1577]: time=2026-09-20T10:52:54.181Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6584lb # [ 144.959340] niks3-server[1048]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6585lb # [ 144.963359] niks3-server[1048]: 2026/09/20 10:52:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6586lb # [ 144.964974] niks3-server[1048]: 2026/09/20 10:52:54 INFO Signed narinfos id=56 count=16587worker1 # [ 144.968306] nix-grpc-daemon[1577]: time=2026-09-20T10:52:54.194Z level=INFO msg="Uploading 1 narinfos"6588lb # [ 144.970634] niks3-server[1048]: 2026/09/20 10:52:54 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6589worker1 # [ 144.976253] nix-grpc-daemon[1577]: time=2026-09-20T10:52:54.202Z level=INFO msg="Upload complete. (323ms)"6590lb # [ 144.973616] niks3-server[1048]: 2026/09/20 10:52:54 INFO Completed upload id=566591lb # [ 144.975650] niks3-server[1048]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6592worker1 # [ 144.978213] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=6246593lb # [ 144.977767] niks3-server[1048]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6594worker1 # [ 144.980967] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966595worker1 # [ 144.987475] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6596worker1 # [ 144.990651] nix-daemon[843]: reaped child process 1758, status = succeeded6597worker1 # [ 144.995481] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6598worker1 # [ 145.620274] nix-daemon[843]: reaped child process 1772, status = succeeded6599worker1 # [ 145.775411] nix-daemon[843]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6600worker1 # [ 145.786659] nix-daemon[843]: reaped child process 1790, status = succeeded6601lb # [ 145.800933] niks3-server[1048]: 2026/09/20 10:52:55 INFO Received uploads request method=POST path=/api/pending_closures6602worker1 # [ 145.812155] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.038Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6603worker1 # [ 145.813633] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.039Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6604lb # [ 145.834947] niks3-server[1048]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6605lb # [ 145.843434] niks3-server[1048]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6606lb # [ 145.855873] niks3-server[1048]: 2026/09/20 10:52:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6607lb # [ 145.860735] niks3-server[1048]: 2026/09/20 10:52:55 INFO Signed narinfos id=57 count=16608worker1 # [ 145.866563] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.092Z level=INFO msg="Uploading 1 narinfos"6609lb # [ 145.866043] niks3-server[1048]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6610lb # [ 145.875654] niks3-server[1048]: 2026/09/20 10:52:55 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6611worker1 # [ 145.884745] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.110Z level=INFO msg="Upload complete. (282ms)"6612lb # [ 145.881861] niks3-server[1048]: 2026/09/20 10:52:55 INFO Completed upload id=576613lb # [ 145.884502] niks3-server[1048]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6614worker1 # [ 145.887389] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16615worker2 # [ 145.878591] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:55Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16616worker1 # [ 145.894899] nix-daemon[843]: reaped child process 1770, status = succeeded6617worker1 # [ 145.896375] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966618worker1 # [ 145.904196] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966619worker2 # [ 145.891536] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:55Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06620worker1 # [ 145.910129] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.136Z level=INFO msg="All 2 paths already cached"6621worker1 # [ 145.914188] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966622worker1 # [ 145.918297] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6623worker1 # [ 146.089386] nix-daemon[843]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6624worker1 # [ 146.102447] nix-daemon[843]: reaped child process 1797, status = succeeded6625worker1 # [ 146.265597] nix-daemon[843]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)6626worker1 # [ 146.277931] nix-daemon[843]: reaped child process 1802, status = succeeded6627lb # [ 146.290774] niks3-server[1048]: 2026/09/20 10:52:55 INFO Received uploads request method=POST path=/api/pending_closures6628worker1 # [ 146.302797] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.528Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6629worker1 # [ 146.304171] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.528Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6630lb # [ 146.320071] niks3-server[1048]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6631lb # [ 146.327208] niks3-server[1048]: 2026/09/20 10:52:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6632lb # [ 146.332088] niks3-server[1048]: 2026/09/20 10:52:55 INFO Signed narinfos id=58 count=16633worker1 # [ 146.337634] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.563Z level=INFO msg="Uploading 1 narinfos"6634lb # [ 146.337089] niks3-server[1048]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6635lb # [ 146.344977] niks3-server[1048]: 2026/09/20 10:52:55 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6636lb # [ 146.347899] niks3-server[1048]: 2026/09/20 10:52:55 INFO Completed upload id=586637worker1 # [ 146.350963] nix-grpc-daemon[1577]: time=2026-09-20T10:52:55.577Z level=INFO msg="Upload complete. (426ms)"6638worker1 # [ 146.353031] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=7526639lb # [ 146.350559] niks3-server[1048]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6640worker1 # [ 146.356112] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966641worker1 # [ 146.361458] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6642worker1 # [ 146.365919] nix-daemon[843]: reaped child process 1792, status = succeeded6643worker1 # [ 146.371957] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6644worker1 # [ 147.599655] nix-daemon[843]: reaped child process 1806, status = succeeded6645worker1 # [ 147.760697] nix-daemon[843]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6646worker1 # [ 147.773371] nix-daemon[843]: reaped child process 1824, status = succeeded6647lb # [ 147.787338] niks3-server[1048]: 2026/09/20 10:52:57 INFO Received uploads request method=POST path=/api/pending_closures6648worker1 # [ 147.798799] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.024Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6649worker1 # [ 147.800318] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.026Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6650lb # [ 147.824500] niks3-server[1048]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6651lb # [ 147.834822] niks3-server[1048]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6652lb # [ 147.844888] niks3-server[1048]: 2026/09/20 10:52:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6653worker1 # [ 147.852443] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.078Z level=INFO msg="Uploading 1 narinfos"6654lb # [ 147.849846] niks3-server[1048]: 2026/09/20 10:52:57 INFO Signed narinfos id=59 count=16655lb # [ 147.855632] niks3-server[1048]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6656lb # [ 147.864969] niks3-server[1048]: 2026/09/20 10:52:57 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6657lb # [ 147.870514] niks3-server[1048]: 2026/09/20 10:52:57 INFO Completed upload id=596658worker1 # [ 147.873408] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.099Z level=INFO msg="Upload complete. (292ms)"6659lb # [ 147.872500] niks3-server[1048]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6660worker2 # [ 147.869558] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:57Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16661worker1 # [ 147.879427] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16662worker1 # [ 147.892401] nix-daemon[843]: reaped child process 1804, status = succeeded6663worker1 # [ 147.922886] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966664worker1 # [ 147.935074] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966665worker1 # [ 147.947254] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.173Z level=INFO msg="All 2 paths already cached"6666worker1 # [ 147.954426] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966667worker1 # [ 147.964161] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6668worker1 # [ 148.133581] nix-daemon[843]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)6669worker1 # [ 148.147319] nix-daemon[843]: reaped child process 1831, status = succeeded6670worker1 # [ 148.290321] nix-daemon[843]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6671worker1 # [ 148.303179] nix-daemon[843]: reaped child process 1836, status = succeeded6672lb # [ 148.309596] niks3-server[1048]: 2026/09/20 10:52:57 INFO Received uploads request method=POST path=/api/pending_closures6673worker1 # [ 148.321213] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.547Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6674worker1 # [ 148.323061] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.548Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6675lb # [ 148.337331] niks3-server[1048]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6676lb # [ 148.349104] niks3-server[1048]: 2026/09/20 10:52:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6677lb # [ 148.353614] niks3-server[1048]: 2026/09/20 10:52:57 INFO Signed narinfos id=60 count=16678worker1 # [ 148.359526] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.585Z level=INFO msg="Uploading 1 narinfos"6679lb # [ 148.360324] niks3-server[1048]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6680lb # [ 148.370622] niks3-server[1048]: 2026/09/20 10:52:57 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6681worker1 # [ 148.378497] nix-grpc-daemon[1577]: time=2026-09-20T10:52:57.604Z level=INFO msg="Upload complete. (402ms)"6682lb # [ 148.375564] niks3-server[1048]: 2026/09/20 10:52:57 INFO Completed upload id=606683worker1 # [ 148.380591] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=7526684worker1 # [ 148.383828] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966685lb # [ 148.380750] niks3-server[1048]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6686worker1 # [ 148.389258] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6687worker1 # [ 148.394194] nix-daemon[843]: reaped child process 1826, status = succeeded6688worker1 # [ 148.398910] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6689worker1 # [ 148.811245] nix-daemon[843]: reaped child process 1840, status = succeeded6690worker1 # [ 148.957513] nix-daemon[843]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)6691worker1 # [ 148.970175] nix-daemon[843]: reaped child process 1858, status = succeeded6692lb # [ 148.984229] niks3-server[1048]: 2026/09/20 10:52:58 INFO Received uploads request method=POST path=/api/pending_closures6693worker1 # [ 148.995648] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.220Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6694worker1 # [ 148.997172] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.220Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6695lb # [ 149.012594] niks3-server[1048]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6696lb # [ 149.027124] niks3-server[1048]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6697lb # [ 149.031469] niks3-server[1048]: 2026/09/20 10:52:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6698lb # [ 149.036157] niks3-server[1048]: 2026/09/20 10:52:58 INFO Signed narinfos id=61 count=16699worker1 # [ 149.043119] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.269Z level=INFO msg="Uploading 1 narinfos"6700lb # [ 149.043318] niks3-server[1048]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6701lb # [ 149.052739] niks3-server[1048]: 2026/09/20 10:52:58 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6702worker1 # [ 149.062029] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.288Z level=INFO msg="Upload complete. (258ms)"6703lb # [ 149.059050] niks3-server[1048]: 2026/09/20 10:52:58 INFO Completed upload id=616704lb # [ 149.062315] niks3-server[1048]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6705worker1 # [ 149.064596] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16706worker2 # [ 149.055452] nix-grpc-daemon[1524]: ts=2026-09-20T10:52:58Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16707worker1 # [ 149.070302] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966708worker1 # [ 149.074932] nix-daemon[843]: reaped child process 1838, status = succeeded6709worker1 # [ 149.079258] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581966710worker1 # [ 149.086139] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.312Z level=INFO msg="All 2 paths already cached"6711worker1 # [ 149.090130] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581966712worker1 # [ 149.094162] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6713worker1 # [ 149.255365] nix-daemon[843]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)6714worker1 # [ 149.267902] nix-daemon[843]: reaped child process 1865, status = succeeded6715worker1 # [ 149.431360] nix-daemon[843]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6716worker1 # [ 149.443658] nix-daemon[843]: reaped child process 1870, status = succeeded6717lb # [ 149.456782] niks3-server[1048]: 2026/09/20 10:52:58 INFO Received uploads request method=POST path=/api/pending_closures6718worker1 # [ 149.467535] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.693Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6719worker1 # [ 149.468882] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.693Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6720lb # [ 149.483543] niks3-server[1048]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6721lb # [ 149.493430] niks3-server[1048]: 2026/09/20 10:52:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6722lb # [ 149.499242] niks3-server[1048]: 2026/09/20 10:52:58 INFO Signed narinfos id=62 count=16723worker1 # [ 149.506387] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.732Z level=INFO msg="Uploading 1 narinfos"6724lb # [ 149.505056] niks3-server[1048]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6725lb # [ 149.515523] niks3-server[1048]: 2026/09/20 10:52:58 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6726worker1 # [ 149.524987] nix-grpc-daemon[1577]: time=2026-09-20T10:52:58.751Z level=INFO msg="Upload complete. (425ms)"6727lb # [ 149.522049] niks3-server[1048]: 2026/09/20 10:52:58 INFO Completed upload id=626728worker1 # [ 149.526956] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=0 paths=1 nar_bytes_in=7526729lb # [ 149.525150] niks3-server[1048]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6730worker1 # [ 149.531941] nix-grpc-daemon[1521]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581966731worker1 # [ 149.537560] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6732worker1 # [ 149.539833] nix-daemon[843]: reaped child process 1860, status = succeeded6733worker1 # [ 149.545405] nix-daemon[843]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)6734worker1 # [ 150.759407] nix-daemon[843]: reaped child process 1874, status = succeeded6735worker1 # [ 150.897614] nix-daemon[843]: accepted connection from pid 1889, user nix-grpc-daemon (trusted)6736worker1 # [ 150.910401] nix-daemon[843]: reaped child process 1892, status = succeeded6737lb # [ 150.919670] niks3-server[1048]: 2026/09/20 10:53:00 INFO Received uploads request method=POST path=/api/pending_closures6738worker1 # [ 150.931298] nix-grpc-daemon[1577]: time=2026-09-20T10:53:00.155Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6739worker1 # [ 150.932679] nix-grpc-daemon[1577]: time=2026-09-20T10:53:00.155Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6740lb # [ 150.958095] niks3-server[1048]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6741lb # [ 150.962714] niks3-server[1048]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6742lb # [ 150.970139] niks3-server[1048]: 2026/09/20 10:53:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6743worker1 # [ 150.978187] nix-grpc-daemon[1577]: time=2026-09-20T10:53:00.204Z level=INFO msg="Uploading 1 narinfos"6744lb # [ 150.975077] niks3-server[1048]: 2026/09/20 10:53:00 INFO Signed narinfos id=63 count=16745lb # [ 150.978971] niks3-server[1048]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6746lb # [ 150.987588] niks3-server[1048]: 2026/09/20 10:53:00 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6747lb # [ 150.993504] niks3-server[1048]: 2026/09/20 10:53:00 INFO Completed upload id=636748lb # [ 150.994718] niks3-server[1048]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6749worker1 # [ 150.996635] nix-grpc-daemon[1577]: time=2026-09-20T10:53:00.222Z level=INFO msg="Upload complete. (244ms)"6750worker1 # [ 151.001627] nix-grpc-daemon[1521]: ts=2026-09-20T10:53:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58196 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16751worker1 # [ 151.013459] nix-daemon[843]: reaped child process 1872, status = succeeded6752client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.15 seconds)6753worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6754worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6755client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16756worker2 # [ 151.337489] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506466757worker2 # [ 151.344561] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466758worker2 # [ 151.365344] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:01Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06759client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.28 seconds)6760(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 16.50 seconds)6761subtest: low disk drains a worker and builds go to the other6762worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6763worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.94 seconds)6764worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6765worker1 # [ 152.630938] nix-grpc-daemon[1521]: ts=2026-09-20T10:53:01Z level=info event=unhealthy reason=min_free6766worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6767client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26768client # don't know how to build these paths:6769client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6770worker1 # [ 153.699152] nix-grpc-daemon[1521]: ts=2026-09-20T10:53:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:581966771worker2 # [ 153.692968] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466772worker2 # [ 153.714201] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:03Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06773worker2 # [ 153.716934] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:03Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16774worker2 # [ 153.758192] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466775worker2 # [ 153.771439] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466776client # copying 1 paths to 'lb:50051'...6777client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6778worker2 # [ 153.784326] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506466779worker2 # [ 153.796421] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6780worker2 # [ 153.964818] nix-daemon[845]: accepted connection from pid 1806, user nix-grpc-daemon (trusted)6781worker2 # [ 153.977946] nix-daemon[845]: reaped child process 1809, status = succeeded6782worker2 # [ 154.119621] nix-daemon[845]: accepted connection from pid 1811, user nix-grpc-daemon (trusted)6783worker2 # [ 154.132627] nix-daemon[845]: reaped child process 1814, status = succeeded6784lb # [ 154.153362] niks3-server[1048]: 2026/09/20 10:53:03 INFO Received uploads request method=POST path=/api/pending_closures6785worker2 # [ 154.155503] nix-grpc-daemon[1596]: time=2026-09-20T10:53:03.931Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6786worker2 # [ 154.157164] nix-grpc-daemon[1596]: time=2026-09-20T10:53:03.933Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6787lb # [ 154.184742] niks3-server[1048]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6788lb # [ 154.196199] niks3-server[1048]: 2026/09/20 10:53:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6789lb # [ 154.201367] niks3-server[1048]: 2026/09/20 10:53:03 INFO Signed narinfos id=64 count=16790worker2 # [ 154.197238] nix-grpc-daemon[1596]: time=2026-09-20T10:53:03.972Z level=INFO msg="Uploading 1 narinfos"6791lb # [ 154.208579] niks3-server[1048]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6792lb # [ 154.218633] niks3-server[1048]: 2026/09/20 10:53:03 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6793worker2 # [ 154.218834] nix-grpc-daemon[1596]: time=2026-09-20T10:53:03.994Z level=INFO msg="Upload complete. (410ms)"6794lb # [ 154.226141] niks3-server[1048]: 2026/09/20 10:53:03 INFO Completed upload id=646795worker2 # [ 154.220961] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 paths=1 nar_bytes_in=5126796lb # [ 154.230372] niks3-server[1048]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6797worker2 # [ 154.227646] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466798worker2 # [ 154.239286] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6799worker2 # [ 154.240899] nix-daemon[845]: reaped child process 1804, status = succeeded6800worker2 # [ 154.246502] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6801client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6802client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6803client # farm-a> LOG-farm-a-drain6804worker2 # [ 155.261328] nix-daemon[845]: reaped child process 1818, status = succeeded6805worker2 # [ 155.406452] nix-daemon[845]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6806worker2 # [ 155.419505] nix-daemon[845]: reaped child process 1836, status = succeeded6807lb # [ 155.439874] niks3-server[1048]: 2026/09/20 10:53:04 INFO Received uploads request method=POST path=/api/pending_closures6808worker2 # [ 155.441365] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.217Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6809worker2 # [ 155.443606] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.218Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6810lb # [ 155.474117] niks3-server[1048]: 2026/09/20 10:53:04 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6811lb # [ 155.490297] niks3-server[1048]: 2026/09/20 10:53:04 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6812lb # [ 155.496886] niks3-server[1048]: 2026/09/20 10:53:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6813worker2 # [ 155.493932] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.269Z level=INFO msg="Uploading 1 narinfos"6814lb # [ 155.501158] niks3-server[1048]: 2026/09/20 10:53:04 INFO Signed narinfos id=65 count=16815lb # [ 155.506419] niks3-server[1048]: 2026/09/20 10:53:04 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6816lb # [ 155.513479] niks3-server[1048]: 2026/09/20 10:53:04 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6817lb # [ 155.521400] niks3-server[1048]: 2026/09/20 10:53:04 INFO Completed upload id=656818worker2 # [ 155.513983] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.289Z level=INFO msg="Upload complete. (260ms)"6819lb # [ 155.522955] niks3-server[1048]: 2026/09/20 10:53:04 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6820worker2 # [ 155.519385] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16821worker2 # [ 155.524858] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06822worker2 # [ 155.526751] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16823worker2 # [ 155.531350] nix-daemon[845]: reaped child process 1816, status = succeeded6824worker2 # [ 155.568798] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466825worker2 # [ 155.576904] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466826worker2 # [ 155.585365] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.361Z level=INFO msg="All 1 paths already cached"6827client # copying 1 paths to 'lb:50051'...6828worker2 # [ 155.590824] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506466829client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6830worker2 # [ 155.596270] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6831worker2 # [ 155.740145] nix-daemon[845]: accepted connection from pid 1842, user nix-grpc-daemon (trusted)6832worker2 # [ 155.753193] nix-daemon[845]: reaped child process 1845, status = succeeded6833worker2 # [ 155.914130] nix-daemon[845]: accepted connection from pid 1847, user nix-grpc-daemon (trusted)6834worker2 # [ 155.927652] nix-daemon[845]: reaped child process 1850, status = succeeded6835lb # [ 155.950405] niks3-server[1048]: 2026/09/20 10:53:05 INFO Received uploads request method=POST path=/api/pending_closures6836worker2 # [ 155.951865] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.727Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6837worker2 # [ 155.953233] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.727Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6838lb # [ 155.974708] niks3-server[1048]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6839lb # [ 155.986287] niks3-server[1048]: 2026/09/20 10:53:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6840worker2 # [ 155.984479] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.760Z level=INFO msg="Uploading 1 narinfos"6841lb # [ 155.992318] niks3-server[1048]: 2026/09/20 10:53:05 INFO Signed narinfos id=66 count=16842lb # [ 155.996904] niks3-server[1048]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6843lb # [ 156.008764] niks3-server[1048]: 2026/09/20 10:53:05 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6844worker2 # [ 156.006194] nix-grpc-daemon[1596]: time=2026-09-20T10:53:05.782Z level=INFO msg="Upload complete. (403ms)"6845lb # [ 156.013811] niks3-server[1048]: 2026/09/20 10:53:05 INFO Completed upload id=666846worker2 # [ 156.008385] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 paths=1 nar_bytes_in=6246847lb # [ 156.017552] niks3-server[1048]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6848worker2 # [ 156.014214] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466849worker2 # [ 156.021279] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6850worker2 # [ 156.022618] nix-daemon[845]: reaped child process 1840, status = succeeded6851client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6852client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6853worker2 # [ 156.028090] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6854client # farm-b> LOG-farm-b-drain6855worker2 # [ 157.455718] nix-daemon[845]: reaped child process 1854, status = succeeded6856worker2 # [ 157.612383] nix-daemon[845]: accepted connection from pid 1869, user nix-grpc-daemon (trusted)6857worker2 # [ 157.624263] nix-daemon[845]: reaped child process 1872, status = succeeded6858lb # [ 157.648300] niks3-server[1048]: 2026/09/20 10:53:06 INFO Received uploads request method=POST path=/api/pending_closures6859worker2 # [ 157.646210] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.421Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6860worker2 # [ 157.649058] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.423Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6861lb # [ 157.664211] envoy[910]: conn peer=[2001:db8:1::1]:43924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27094 tx=10574 ms=158946862lb # [ 157.665979] envoy[910]: conn peer=[2001:db8:1::1]:46358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=481 ms=426863lb # [ 157.676961] niks3-server[1048]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6864lb # [ 157.681319] niks3-server[1048]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6865lb # [ 157.685064] niks3-server[1048]: 2026/09/20 10:53:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6866lb # [ 157.688324] niks3-server[1048]: 2026/09/20 10:53:06 INFO Signed narinfos id=67 count=16867worker2 # [ 157.681155] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.456Z level=INFO msg="Uploading 1 narinfos"6868lb # [ 157.693302] niks3-server[1048]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6869lb # [ 157.696231] niks3-server[1048]: 2026/09/20 10:53:06 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6870lb # [ 157.701415] niks3-server[1048]: 2026/09/20 10:53:06 INFO Completed upload id=676871worker2 # [ 157.694109] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.470Z level=INFO msg="Upload complete. (257ms)"6872lb # [ 157.704380] niks3-server[1048]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6873worker2 # [ 157.696958] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16874worker2 # [ 157.702733] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06875worker2 # [ 157.704581] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16876worker2 # [ 157.709803] nix-daemon[845]: reaped child process 1852, status = succeeded6877worker2 # [ 157.746350] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466878worker2 # [ 157.755281] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506466879worker2 # [ 157.764446] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.540Z level=INFO msg="All 2 paths already cached"6880client # copying 1 paths to 'lb:50051'...6881client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6882worker2 # [ 157.770358] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506466883worker2 # [ 157.778960] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6884worker2 # [ 157.920352] nix-daemon[845]: accepted connection from pid 1878, user nix-grpc-daemon (trusted)6885worker2 # [ 157.932938] nix-daemon[845]: reaped child process 1881, status = succeeded6886worker2 # [ 158.094475] nix-daemon[845]: accepted connection from pid 1883, user nix-grpc-daemon (trusted)6887worker2 # [ 158.107084] nix-daemon[845]: reaped child process 1886, status = succeeded6888lb # [ 158.131480] niks3-server[1048]: 2026/09/20 10:53:07 INFO Received uploads request method=POST path=/api/pending_closures6889worker2 # [ 158.135184] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.910Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6890worker2 # [ 158.136572] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.910Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6891lb # [ 158.159480] niks3-server[1048]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6892lb # [ 158.163081] niks3-server[1048]: 2026/09/20 10:53:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6893lb # [ 158.164853] niks3-server[1048]: 2026/09/20 10:53:07 INFO Signed narinfos id=68 count=16894worker2 # [ 158.157660] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.933Z level=INFO msg="Uploading 1 narinfos"6895lb # [ 158.170454] niks3-server[1048]: 2026/09/20 10:53:07 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6896worker2 # [ 158.166322] nix-grpc-daemon[1596]: time=2026-09-20T10:53:07.942Z level=INFO msg="Upload complete. (379ms)"6897lb # [ 158.174452] niks3-server[1048]: 2026/09/20 10:53:07 INFO Completed upload id=686898worker2 # [ 158.168385] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=0 paths=1 nar_bytes_in=7526899lb # [ 158.176580] niks3-server[1048]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6900worker2 # [ 158.171542] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506466901lb # [ 158.179479] niks3-server[1048]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6902worker2 # [ 158.178289] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6903worker2 # [ 158.181151] nix-daemon[845]: reaped child process 1876, status = succeeded6904client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6905client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6906worker2 # [ 158.186312] nix-daemon[845]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)6907client # farm-top> LOG-farm-top-drain6908worker2 # [ 159.411474] nix-daemon[845]: reaped child process 1890, status = succeeded6909worker2 # [ 159.583344] nix-daemon[845]: accepted connection from pid 1905, user nix-grpc-daemon (trusted)6910worker2 # [ 159.596333] nix-daemon[845]: reaped child process 1908, status = succeeded6911lb # [ 159.622250] niks3-server[1048]: 2026/09/20 10:53:08 INFO Received uploads request method=POST path=/api/pending_closures6912worker2 # [ 159.622435] nix-grpc-daemon[1596]: time=2026-09-20T10:53:09.398Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6913worker2 # [ 159.624499] nix-grpc-daemon[1596]: time=2026-09-20T10:53:09.399Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6914lb # [ 159.658607] niks3-server[1048]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6915lb # [ 159.667222] niks3-server[1048]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6916lb # [ 159.674977] niks3-server[1048]: 2026/09/20 10:53:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6917worker2 # [ 159.672065] nix-grpc-daemon[1596]: time=2026-09-20T10:53:09.447Z level=INFO msg="Uploading 1 narinfos"6918lb # [ 159.679635] niks3-server[1048]: 2026/09/20 10:53:08 INFO Signed narinfos id=69 count=16919lb # [ 159.685862] niks3-server[1048]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6920lb # [ 159.693565] niks3-server[1048]: 2026/09/20 10:53:08 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6921lb # [ 159.699896] niks3-server[1048]: 2026/09/20 10:53:08 INFO Completed upload id=696922worker2 # [ 159.692666] nix-grpc-daemon[1596]: time=2026-09-20T10:53:09.468Z level=INFO msg="Upload complete. (297ms)"6923lb # [ 159.705147] niks3-server[1048]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6924worker2 # [ 159.698511] nix-grpc-daemon[1524]: ts=2026-09-20T10:53:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50646 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16925worker2 # [ 159.712414] nix-daemon[845]: reaped child process 1888, status = succeeded6926client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.28 seconds)6927client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6928client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.20 seconds)6929worker1: must succeed: rm /nix/.rw-store/fill6930worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)6931worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6932worker1 # [ 160.638336] nix-grpc-daemon[1521]: ts=2026-09-20T10:53:09Z level=info event=healthy reason=min_free6933worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6934(finished: subtest: low disk drains a worker and builds go to the other, in 9.85 seconds)6935(finished: run the VM test script, in 162.13 seconds)6936test script finished in 162.37s6937cleanup6938kill QemuMachine (pid 49)6939client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6940kill QemuMachine (pid 50)6941lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6942kill QemuMachine (pid 52)6943worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6944kill QemuMachine (pid 51)6945worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6946(finished: cleanup, in 0.94 seconds)6947additionally exposed symbols:6948 client, lb, worker1, worker2,6949 vlan1,6950 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh