vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #235
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2: QEMU running (pid 52)14worker2 # Formatting '/build/vm-state-worker2/tmp.zrhjOA0IeC', fmt=raw size=107374182415worker1 # Disk image does not exist, creating the virtualisation disk image...16worker2 # mke2fs 1.47.4 (6-Mar-2025)17worker1 # Formatting '/build/vm-state-worker1/tmp.tm6CXHgAq4', fmt=raw size=107374182418worker2 # Discarding device blocks: 0/262144 done19worker1 # mke2fs 1.47.4 (6-Mar-2025)20worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes21worker2 # Filesystem UUID: 92859897-176a-4888-8821-d1676036a14c22worker2 # Superblock backups stored on blocks:23worker1 # Discarding device blocks: 0/262144 done24worker1: QEMU running (pid 51)25worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes26worker2 # 32768, 98304, 163840, 22937627client # Disk image does not exist, creating the virtualisation disk image...28worker1 # Filesystem UUID: b5c35149-f2d2-4562-b384-51bc1e7fe9f029client: QEMU running (pid 49)30worker1 # Superblock backups stored on blocks:31worker2 # 32worker1 # 32768, 98304, 163840, 22937633worker2 # Allocating group tables: 0/8 done34worker1 # 35worker2 # Writing inode tables: 0/8 done36worker1 # Allocating group tables: 0/8 done37worker2 # Creating journal (8192 blocks): done38worker1 # Writing inode tables: 0/8 done39worker2 # Writing superblocks and filesystem accounting information: 0/8 done40worker1 # Creating journal (8192 blocks): done41worker2 # 42worker1 # Writing superblocks and filesystem accounting information: 0/8 done43worker2 # Virtualisation disk image created.44worker1 # 45client # Formatting '/build/vm-state-client/tmp.PAgppWZaRA', fmt=raw size=107374182446worker1 # Virtualisation disk image created.47client # mke2fs 1.47.4 (6-Mar-2025)48client # Discarding device blocks: 0/262144 done49client # Creating filesystem with 262144 4k blocks and 65536 inodes50client # Filesystem UUID: 01e73dbf-d412-4765-9f30-4ccedb88bb2051client # Superblock backups stored on blocks:52client # 32768, 98304, 163840, 22937653client # 54client # Allocating group tables: 0/8 done55client # Writing inode tables: 0/8 done56client # Creating journal (8192 blocks): done57client # Writing superblocks and filesystem accounting information: 0/8 done58client # 59client # Virtualisation disk image created.60lb # Disk image does not exist, creating the virtualisation disk image...61lb: QEMU running (pid 50)62lb # Formatting '/build/vm-state-lb/tmp.HReA2MccAb', fmt=raw size=107374182463lb # mke2fs 1.47.4 (6-Mar-2025)64lb # Discarding device blocks: 0/262144 done65lb # Creating filesystem with 262144 4k blocks and 65536 inodes66lb # Filesystem UUID: 679cd9dc-82ad-471a-ae60-a6174036d57067lb # Superblock backups stored on blocks:68lb # 32768, 98304, 163840, 22937669lb # 70lb # Allocating group tables: 0/8 done71(finished: start all VMs, in 0.21 seconds)72lb # Writing inode tables: 0/8 done73client: waiting for unit network-addresses-eth1.service74lb # Creating journal (8192 blocks): done75client: waiting for the VM to finish booting76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086client # 87client # 88client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...90worker2 # 91worker2 # 92worker2 # 93worker2 # 94worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0095client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...96client # 97client # 98client # 99client # 100client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00101worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...102worker2 # 103worker2 # 104client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105client # 106client # 107worker1 # 108lb # 109lb # 110worker1 # 111worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00112lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00113lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...114lb # 115worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...116lb # 117worker1 # 118lb # 119worker1 # 120lb # 121worker1 # 122worker1 # 123lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00124worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00125lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126lb # 127lb # 128worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker1 # 130worker1 # 131worker2 # Booting from ROM...132client # Booting from ROM...133lb # Booting from ROM...134worker1 # Booting from ROM...135client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test/init regInfo=/nix/store/nc269ch11d9y5i5mmzsc7lzql3vkpbc5-closure-info/registration console=ttyS0,115200n8 console=tty0137client # [ 0.000000] BIOS-provided physical RAM map:138worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026139client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable140client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved141client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved142client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable143worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ll48yx5nakx0nblsfrhxnkiaziccsil3-nixos-system-worker2-test/init regInfo=/nix/store/kdc2ki0fvqr7ggp0qnfihfgh6ad20rmc-closure-info/registration console=ttyS0,115200n8 console=tty0144client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved145worker2 # [ 0.000000] BIOS-provided physical RAM map:146client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable148client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved149worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved150client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved151worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved152client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved153worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable154client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved155worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved156client # [ 0.000000] NX (Execute Disable) protection: active157worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved158client # [ 0.000000] APIC: Static calls initialized159lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026160client # [ 0.000000] SMBIOS 2.8 present.161worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved162worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved163client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014164worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026165client # [ 0.000000] DMI: Memory slots populated: 1/1166worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved167client # [ 0.000000] Hypervisor detected: KVM168worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved169client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000170lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0171client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00172worker2 # [ 0.000000] NX (Execute Disable) protection: active173lb # [ 0.000000] BIOS-provided physical RAM map:174worker2 # [ 0.000000] APIC: Static calls initialized175client # [ 0.000000] kvm-clock: using sched offset of 472871255 cycles176worker2 # [ 0.000000] SMBIOS 2.8 present.177lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable178worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/riz6v2gib15fx5cm4zm7zjb2w367l1px-nixos-system-worker1-test/init regInfo=/nix/store/bjbxw5wa82sp3dnlyh9b1k7djicmw95y-closure-info/registration console=ttyS0,115200n8 console=tty0179client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns180lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved181worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014182worker1 # [ 0.000000] BIOS-provided physical RAM map:183worker2 # [ 0.000000] DMI: Memory slots populated: 1/1184client # [ 0.000006] tsc: Detected 2400.012 MHz processor185lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved186worker2 # [ 0.000000] Hypervisor detected: KVM187worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable188client # [ 0.000824] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000189worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000190lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable191worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved192client # [ 0.000853] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs193worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00194lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved195worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved196worker2 # [ 0.000001] kvm-clock: using sched offset of 480161418 cycles197client # [ 0.000856] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT198lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved199worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable200client # [ 0.002780] found SMP MP-table at [mem 0x000f5450-0x000f545f]201lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved202worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns203client # [ 0.002795] Using GB pages for direct mapping204worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved205worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor206client # [ 0.002942] RAMDISK: [mem 0x5e366000-0x5ffcffff]207lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved208worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved209worker2 # [ 0.000807] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000210client # [ 0.002951] ACPI: Early table checksum verification disabled211lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved212worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved213client # [ 0.002956] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )214worker2 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs215lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved216worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved217client # [ 0.002960] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)218worker2 # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT219lb # [ 0.000000] NX (Execute Disable) protection: active220lb # [ 0.000000] APIC: Static calls initialized221worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved222worker2 # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f]223lb # [ 0.000000] SMBIOS 2.8 present.224client # [ 0.002965] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)225worker2 # [ 0.002747] Using GB pages for direct mapping226worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved227worker2 # [ 0.002906] RAMDISK: [mem 0x5e367000-0x5ffcffff]228worker1 # [ 0.000000] NX (Execute Disable) protection: active229lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014230client # [ 0.002973] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)231worker2 # [ 0.002915] ACPI: Early table checksum verification disabled232worker1 # [ 0.000000] APIC: Static calls initialized233lb # [ 0.000000] DMI: Memory slots populated: 1/1234worker1 # [ 0.000000] SMBIOS 2.8 present.235worker2 # [ 0.002919] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )236client # [ 0.002975] ACPI: FACS 0x000000005FFE0000 000040237lb # [ 0.000000] Hypervisor detected: KVM238client # [ 0.002977] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)239lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000240worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014241worker2 # [ 0.002923] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)242lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00243worker1 # [ 0.000000] DMI: Memory slots populated: 1/1244client # [ 0.002978] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)245worker1 # [ 0.000000] Hypervisor detected: KVM246lb # [ 0.000000] kvm-clock: using sched offset of 470270848 cycles247worker2 # [ 0.002928] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)248client # [ 0.002980] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)249worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000250worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00251lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns252worker2 # [ 0.002936] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)253client # [ 0.002981] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)254worker2 # [ 0.002938] ACPI: FACS 0x000000005FFE0000 000040255lb # [ 0.000005] tsc: Detected 2400.012 MHz processor256worker1 # [ 0.000001] kvm-clock: using sched offset of 503717340 cycles257client # [ 0.002983] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]258lb # [ 0.000816] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000259worker2 # [ 0.002940] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)260client # [ 0.002984] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]261worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns262lb # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs263worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor264worker2 # [ 0.002941] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)265client # [ 0.002984] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]266lb # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT267worker1 # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000268worker2 # [ 0.002943] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)269client # [ 0.002985] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]270lb # [ 0.002745] found SMP MP-table at [mem 0x000f5450-0x000f545f]271lb # [ 0.002757] Using GB pages for direct mapping272worker1 # [ 0.000834] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs273client # [ 0.002985] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]274worker2 # [ 0.002945] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)275lb # [ 0.002915] RAMDISK: [mem 0x5e367000-0x5ffcffff]276worker1 # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT277client # [ 0.002986] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]278worker2 # [ 0.002946] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]279lb # [ 0.002923] ACPI: Early table checksum verification disabled280worker1 # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]281client # [ 0.002986] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]282worker1 # [ 0.002744] Using GB pages for direct mapping283worker2 # [ 0.002947] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]284lb # [ 0.002927] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )285client # [ 0.003226] No NUMA configuration found286worker1 # [ 0.002857] RAMDISK: [mem 0x5e367000-0x5ffcffff]287worker2 # [ 0.002948] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]288lb # [ 0.002931] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)289client # [ 0.003227] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]290worker1 # [ 0.002866] ACPI: Early table checksum verification disabled291worker2 # [ 0.002948] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]292lb # [ 0.002935] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)293client # [ 0.003229] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]294worker1 # [ 0.002870] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )295client # [ 0.005581] Zone ranges:296worker2 # [ 0.002948] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]297worker1 # [ 0.002874] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)298client # [ 0.005582] DMA [mem 0x0000000000001000-0x0000000000ffffff]299lb # [ 0.002943] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)300worker2 # [ 0.002949] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]301lb # [ 0.002945] ACPI: FACS 0x000000005FFE0000 000040302client # [ 0.005584] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]303worker1 # [ 0.002879] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)304client # [ 0.005585] Normal empty305worker2 # [ 0.002949] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]306client # [ 0.005586] Device empty307lb # [ 0.002946] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)308worker2 # [ 0.003177] No NUMA configuration found309client # [ 0.005586] Movable zone start for each node310worker1 # [ 0.002886] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)311client # [ 0.005587] Early memory node ranges312lb # [ 0.002948] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)313worker2 # [ 0.003178] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]314worker1 # [ 0.002888] ACPI: FACS 0x000000005FFE0000 000040315client # [ 0.005587] node 0: [mem 0x0000000000001000-0x000000000009efff]316worker2 # [ 0.003181] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]317lb # [ 0.002949] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)318worker2 # [ 0.005523] Zone ranges:319worker1 # [ 0.002889] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)320client # [ 0.005589] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]321worker2 # [ 0.005525] DMA [mem 0x0000000000001000-0x0000000000ffffff]322lb # [ 0.002951] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)323worker1 # [ 0.002891] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)324client # [ 0.005590] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]325worker2 # [ 0.005526] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]326client # [ 0.005611] On node 0, zone DMA: 1 pages in unavailable ranges327lb # [ 0.002952] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]328worker2 # [ 0.005528] Normal empty329worker1 # [ 0.002892] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)330worker2 # [ 0.005529] Device empty331client # [ 0.005902] On node 0, zone DMA: 97 pages in unavailable ranges332lb # [ 0.002953] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]333worker2 # [ 0.005529] Movable zone start for each node334worker1 # [ 0.002894] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)335worker2 # [ 0.005530] Early memory node ranges336client # [ 0.034477] On node 0, zone DMA32: 40 pages in unavailable ranges337lb # [ 0.002954] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]338client # [ 0.034951] ACPI: PM-Timer IO Port: 0x608339worker2 # [ 0.005530] node 0: [mem 0x0000000000001000-0x000000000009efff]340worker1 # [ 0.002895] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]341lb # [ 0.002954] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]342client # [ 0.034966] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])343worker2 # [ 0.005531] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]344worker1 # [ 0.002896] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]345lb # [ 0.002955] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]346client # [ 0.034999] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23347worker2 # [ 0.005533] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]348worker1 # [ 0.002897] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]349lb # [ 0.002955] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]350client # [ 0.035002] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)351worker2 # [ 0.005553] On node 0, zone DMA: 1 pages in unavailable ranges352worker1 # [ 0.002897] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]353lb # [ 0.002956] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]354client # [ 0.035003] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)355worker2 # [ 0.005836] On node 0, zone DMA: 97 pages in unavailable ranges356lb # [ 0.003194] No NUMA configuration found357worker1 # [ 0.002898] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]358client # [ 0.035005] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)359worker2 # [ 0.034703] On node 0, zone DMA32: 40 pages in unavailable ranges360lb # [ 0.003195] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]361worker1 # [ 0.002898] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]362worker2 # [ 0.035189] ACPI: PM-Timer IO Port: 0x608363client # [ 0.035006] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)364lb # [ 0.003198] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]365worker2 # [ 0.035203] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])366worker1 # [ 0.002899] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]367lb # [ 0.005589] Zone ranges:368client # [ 0.035007] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)369worker1 # [ 0.003135] No NUMA configuration found370worker2 # [ 0.035231] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23371lb # [ 0.005591] DMA [mem 0x0000000000001000-0x0000000000ffffff]372client # [ 0.035009] ACPI: Using ACPI (MADT) for SMP configuration information373worker1 # [ 0.003136] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]374worker2 # [ 0.035234] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)375client # [ 0.035010] ACPI: HPET id: 0x8086a201 base: 0xfed00000376lb # [ 0.005592] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]377lb # [ 0.005594] Normal empty378client # [ 0.035016] TSC deadline timer available379worker1 # [ 0.003138] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]380lb # [ 0.005595] Device empty381worker2 # [ 0.035236] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)382worker1 # [ 0.005529] Zone ranges:383client # [ 0.035021] CPU topo: Max. logical packages: 1384lb # [ 0.005595] Movable zone start for each node385worker1 # [ 0.005530] DMA [mem 0x0000000000001000-0x0000000000ffffff]386lb # [ 0.005596] Early memory node ranges387worker2 # [ 0.035237] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)388client # [ 0.035021] CPU topo: Max. logical dies: 1389client # [ 0.035022] CPU topo: Max. dies per package: 1390worker2 # [ 0.035238] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)391lb # [ 0.005596] node 0: [mem 0x0000000000001000-0x000000000009efff]392worker1 # [ 0.005532] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]393client # [ 0.035027] CPU topo: Max. threads per core: 1394worker1 # [ 0.005533] Normal empty395worker1 # [ 0.005534] Device empty396lb # [ 0.005597] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]397worker2 # [ 0.035239] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)398client # [ 0.035028] CPU topo: Num. cores per package: 1399worker1 # [ 0.005535] Movable zone start for each node400client # [ 0.035028] CPU topo: Num. threads per package: 1401worker1 # [ 0.005536] Early memory node ranges402worker2 # [ 0.035242] ACPI: Using ACPI (MADT) for SMP configuration information403lb # [ 0.005598] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]404worker2 # [ 0.035243] ACPI: HPET id: 0x8086a201 base: 0xfed00000405client # [ 0.035028] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs406worker1 # [ 0.005536] node 0: [mem 0x0000000000001000-0x000000000009efff]407lb # [ 0.005619] On node 0, zone DMA: 1 pages in unavailable ranges408worker2 # [ 0.035248] TSC deadline timer available409worker1 # [ 0.005537] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]410client # [ 0.035055] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()411lb # [ 0.005906] On node 0, zone DMA: 97 pages in unavailable ranges412worker2 # [ 0.035253] CPU topo: Max. logical packages: 1413worker2 # [ 0.035254] CPU topo: Max. logical dies: 1414worker1 # [ 0.005538] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]415lb # [ 0.034649] On node 0, zone DMA32: 40 pages in unavailable ranges416client # [ 0.035093] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]417worker2 # [ 0.035254] CPU topo: Max. dies per package: 1418lb # [ 0.035127] ACPI: PM-Timer IO Port: 0x608419worker1 # [ 0.005558] On node 0, zone DMA: 1 pages in unavailable ranges420client # [ 0.035095] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]421worker2 # [ 0.035257] CPU topo: Max. threads per core: 1422lb # [ 0.035142] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])423worker1 # [ 0.005837] On node 0, zone DMA: 97 pages in unavailable ranges424worker2 # [ 0.035258] CPU topo: Num. cores per package: 1425client # [ 0.035097] [mem 0x60000000-0xafffffff] available for PCI devices426lb # [ 0.035175] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23427worker2 # [ 0.035258] CPU topo: Num. threads per package: 1428worker1 # [ 0.034368] On node 0, zone DMA32: 40 pages in unavailable ranges429client # [ 0.035099] Booting paravirtualized kernel on KVM430worker1 # [ 0.034829] ACPI: PM-Timer IO Port: 0x608431lb # [ 0.035178] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)432worker2 # [ 0.035259] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs433worker1 # [ 0.034841] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])434lb # [ 0.035179] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)435client # [ 0.035103] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns436worker2 # [ 0.035285] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()437worker1 # [ 0.034871] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23438lb # [ 0.035181] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)439client # [ 0.039590] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1440worker2 # [ 0.035323] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]441worker1 # [ 0.034874] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)442lb # [ 0.035182] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)443client # [ 0.041940] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152444worker2 # [ 0.035325] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]445worker1 # [ 0.034875] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)446client # [ 0.041984] kvm-guest: PV spinlocks disabled, single CPU447lb # [ 0.035182] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)448worker2 # [ 0.035327] [mem 0x60000000-0xafffffff] available for PCI devices449worker1 # [ 0.034877] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)450lb # [ 0.035185] ACPI: Using ACPI (MADT) for SMP configuration information451worker2 # [ 0.035329] Booting paravirtualized kernel on KVM452lb # [ 0.035186] ACPI: HPET id: 0x8086a201 base: 0xfed00000453worker1 # [ 0.034878] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)454lb # [ 0.035190] TSC deadline timer available455worker2 # [ 0.035333] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns456worker1 # [ 0.034878] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)457lb # [ 0.035194] CPU topo: Max. logical packages: 1458lb # [ 0.035195] CPU topo: Max. logical dies: 1459worker1 # [ 0.034881] ACPI: Using ACPI (MADT) for SMP configuration information460worker2 # [ 0.039888] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1461lb # [ 0.035196] CPU topo: Max. dies per package: 1462worker1 # [ 0.034882] ACPI: HPET id: 0x8086a201 base: 0xfed00000463client # [ 0.041986] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test/init regInfo=/nix/store/nc269ch11d9y5i5mmzsc7lzql3vkpbc5-closure-info/registration console=ttyS0,115200n8 console=tty0464worker2 # [ 0.042411] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152465lb # [ 0.035200] CPU topo: Max. threads per core: 1466worker1 # [ 0.034885] TSC deadline timer available467worker2 # [ 0.042458] kvm-guest: PV spinlocks disabled, single CPU468worker1 # [ 0.034889] CPU topo: Max. logical packages: 1469lb # [ 0.035200] CPU topo: Num. cores per package: 1470lb # [ 0.035201] CPU topo: Num. threads per package: 1471worker1 # [ 0.034890] CPU topo: Max. logical dies: 1472client # [ 0.042086] Unknown kernel command line parameters "regInfo=/nix/store/nc269ch11d9y5i5mmzsc7lzql3vkpbc5-closure-info/registration", will be passed to user space.473worker1 # [ 0.034890] CPU topo: Max. dies per package: 1474client # [ 0.042100] random: crng init done475lb # [ 0.035201] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs476worker1 # [ 0.034896] CPU topo: Max. threads per core: 1477lb # [ 0.035224] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()478client # [ 0.042100] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes479worker1 # [ 0.034897] CPU topo: Num. cores per package: 1480worker1 # [ 0.034897] CPU topo: Num. threads per package: 1481client # [ 0.044393] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)482lb # [ 0.035263] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]483worker1 # [ 0.034897] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs484worker2 # [ 0.042460] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ll48yx5nakx0nblsfrhxnkiaziccsil3-nixos-system-worker2-test/init regInfo=/nix/store/kdc2ki0fvqr7ggp0qnfihfgh6ad20rmc-closure-info/registration console=ttyS0,115200n8 console=tty0485client # [ 0.046048] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)486lb # [ 0.035264] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]487worker1 # [ 0.034927] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()488client # [ 0.046086] Fallback order for Node 0: 0489lb # [ 0.035266] [mem 0x60000000-0xafffffff] available for PCI devices490lb # [ 0.035268] Booting paravirtualized kernel on KVM491client # [ 0.046090] Built 1 zonelists, mobility grouping on. Total pages: 393078492worker2 # [ 0.042563] Unknown kernel command line parameters "regInfo=/nix/store/kdc2ki0fvqr7ggp0qnfihfgh6ad20rmc-closure-info/registration", will be passed to user space.493worker1 # [ 0.034962] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]494client # [ 0.046091] Policy zone: DMA32495worker2 # [ 0.042577] random: crng init done496worker1 # [ 0.034964] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]497lb # [ 0.035272] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns498client # [ 0.048775] mem auto-init: stack:all(zero), heap alloc:on, heap free:off499worker2 # [ 0.042578] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes500worker1 # [ 0.034965] [mem 0x60000000-0xafffffff] available for PCI devices501client # [ 0.052413] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1502lb # [ 0.039781] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1503worker1 # [ 0.034967] Booting paravirtualized kernel on KVM504worker2 # [ 0.045095] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)505client # [ 0.056007] allocated 3145728 bytes of page_ext506lb # [ 0.042399] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152507client # [ 0.066787] ftrace: allocating 48731 entries in 192 pages508worker2 # [ 0.046513] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)509worker1 # [ 0.034970] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns510lb # [ 0.042449] kvm-guest: PV spinlocks disabled, single CPU511worker2 # [ 0.046563] Fallback order for Node 0: 0512client # [ 0.066790] ftrace: allocated 192 pages with 2 groups513client # [ 0.067711] Dynamic Preempt: lazy514worker2 # [ 0.046568] Built 1 zonelists, mobility grouping on. Total pages: 393078515worker1 # [ 0.039454] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1516client # [ 0.067859] rcu: Preemptible hierarchical RCU implementation.517worker2 # [ 0.046570] Policy zone: DMA32518worker1 # [ 0.041782] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152519client # [ 0.067860] rcu: RCU event tracing is enabled.520worker2 # [ 0.049784] mem auto-init: stack:all(zero), heap alloc:on, heap free:off521worker1 # [ 0.041831] kvm-guest: PV spinlocks disabled, single CPU522client # [ 0.067861] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.523worker2 # [ 0.053455] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1524client # [ 0.067863] Trampoline variant of Tasks RCU enabled.525worker2 # [ 0.057262] allocated 3145728 bytes of page_ext526lb # [ 0.042451] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0527client # [ 0.067864] Rude variant of Tasks RCU enabled.528worker2 # [ 0.067965] ftrace: allocating 48731 entries in 192 pages529client # [ 0.067864] Tracing variant of Tasks RCU enabled.530worker2 # [ 0.067968] ftrace: allocated 192 pages with 2 groups531worker2 # [ 0.068878] Dynamic Preempt: lazy532client # [ 0.067865] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.533lb # [ 0.042553] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.534lb # [ 0.042567] random: crng init done535worker2 # [ 0.069067] rcu: Preemptible hierarchical RCU implementation.536client # [ 0.067865] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1537worker1 # [ 0.041833] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/riz6v2gib15fx5cm4zm7zjb2w367l1px-nixos-system-worker1-test/init regInfo=/nix/store/bjbxw5wa82sp3dnlyh9b1k7djicmw95y-closure-info/registration console=ttyS0,115200n8 console=tty0538worker2 # [ 0.069068] rcu: RCU event tracing is enabled.539lb # [ 0.042568] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes540client # [ 0.067882] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.541worker2 # [ 0.069069] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.542lb # [ 0.044865] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)543worker2 # [ 0.069071] Trampoline variant of Tasks RCU enabled.544worker1 # [ 0.041940] Unknown kernel command line parameters "regInfo=/nix/store/bjbxw5wa82sp3dnlyh9b1k7djicmw95y-closure-info/registration", will be passed to user space.545client # [ 0.067884] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.546worker1 # [ 0.041953] random: crng init done547worker2 # [ 0.069072] Rude variant of Tasks RCU enabled.548lb # [ 0.046007] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)549worker2 # [ 0.069072] Tracing variant of Tasks RCU enabled.550lb # [ 0.046041] Fallback order for Node 0: 0551worker1 # [ 0.041954] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes552client # [ 0.067885] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.553worker2 # [ 0.069073] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.554lb # [ 0.046045] Built 1 zonelists, mobility grouping on. Total pages: 393078555client # [ 0.072448] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16556worker1 # [ 0.044503] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)557lb # [ 0.046046] Policy zone: DMA32558worker2 # [ 0.069073] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1559lb # [ 0.048710] mem auto-init: stack:all(zero), heap alloc:on, heap free:off560client # [ 0.072758] rcu: srcu_init: Setting srcu_struct sizes based on contention.561worker1 # [ 0.045650] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)562worker1 # [ 0.045687] Fallback order for Node 0: 0563worker2 # [ 0.069101] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.564lb # [ 0.052246] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1565client # [ 0.072766] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns566worker1 # [ 0.045690] Built 1 zonelists, mobility grouping on. Total pages: 393078567lb # [ 0.056147] allocated 3145728 bytes of page_ext568worker1 # [ 0.045692] Policy zone: DMA32569worker2 # [ 0.069103] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570lb # [ 0.066782] ftrace: allocating 48731 entries in 192 pages571client # [ 0.072882] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)572lb # [ 0.066785] ftrace: allocated 192 pages with 2 groups573worker1 # [ 0.048429] mem auto-init: stack:all(zero), heap alloc:on, heap free:off574client # [ 0.076738] Console: colour VGA+ 80x25575worker2 # [ 0.069104] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.576lb # [ 0.067703] Dynamic Preempt: lazy577worker1 # [ 0.051946] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1578client # [ 0.076741] printk: legacy console [tty0] enabled579worker2 # [ 0.073564] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16580lb # [ 0.067857] rcu: Preemptible hierarchical RCU implementation.581client # [ 0.106213] printk: legacy console [ttyS0] enabled582worker1 # [ 0.055497] allocated 3145728 bytes of page_ext583lb # [ 0.067858] rcu: RCU event tracing is enabled.584worker2 # [ 0.073838] rcu: srcu_init: Setting srcu_struct sizes based on contention.585worker1 # [ 0.066062] ftrace: allocating 48731 entries in 192 pages586client # [ 0.202735] ACPI: Core revision 20250807587lb # [ 0.067858] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.588worker1 # [ 0.066064] ftrace: allocated 192 pages with 2 groups589worker1 # [ 0.067244] Dynamic Preempt: lazy590lb # [ 0.067860] Trampoline variant of Tasks RCU enabled.591worker2 # [ 0.073844] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns592lb # [ 0.067861] Rude variant of Tasks RCU enabled.593worker1 # [ 0.067411] rcu: Preemptible hierarchical RCU implementation.594client # [ 0.203595] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns595worker1 # [ 0.067411] rcu: RCU event tracing is enabled.596lb # [ 0.067861] Tracing variant of Tasks RCU enabled.597worker2 # [ 0.073962] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)598client # [ 0.205096] APIC: Switch to symmetric I/O mode setup599worker2 # [ 0.077476] Console: colour VGA+ 80x25600worker1 # [ 0.067412] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.601lb # [ 0.067862] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.602client # [ 0.206028] x2apic enabled603worker2 # [ 0.077479] printk: legacy console [tty0] enabled604worker1 # [ 0.067413] Trampoline variant of Tasks RCU enabled.605worker2 # [ 0.106880] printk: legacy console [ttyS0] enabled606lb # [ 0.067862] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1607worker1 # [ 0.067414] Rude variant of Tasks RCU enabled.608client # [ 0.206765] APIC: Switched APIC routing to: physical x2apic609worker2 # [ 0.203263] ACPI: Core revision 20250807610worker1 # [ 0.067414] Tracing variant of Tasks RCU enabled.611lb # [ 0.067872] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612worker1 # [ 0.067415] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.613lb # [ 0.067874] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.614worker2 # [ 0.204149] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns615worker1 # [ 0.067416] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1616client # [ 0.208561] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1617lb # [ 0.067875] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.618worker2 # [ 0.205704] APIC: Switch to symmetric I/O mode setup619worker1 # [ 0.067431] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.620lb # [ 0.072439] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16621worker2 # [ 0.206637] x2apic enabled622client # [ 0.209504] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns623worker1 # [ 0.067433] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.624lb # [ 0.072721] rcu: srcu_init: Setting srcu_struct sizes based on contention.625worker2 # [ 0.207373] APIC: Switched APIC routing to: physical x2apic626client # [ 0.211122] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)627worker1 # [ 0.067434] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.628lb # [ 0.072729] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns629worker1 # [ 0.071880] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16630client # [ 0.212209] x86/cpu: User Mode Instruction Prevention (UMIP) activated631lb # [ 0.072843] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)632worker2 # [ 0.209143] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1633worker1 # [ 0.072190] rcu: srcu_init: Setting srcu_struct sizes based on contention.634lb # [ 0.076406] Console: colour VGA+ 80x25635client # [ 0.213246] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127636lb # [ 0.076409] printk: legacy console [tty0] enabled637worker1 # [ 0.072199] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns638lb # [ 0.105873] printk: legacy console [ttyS0] enabled639client # [ 0.214120] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0640worker2 # [ 0.210115] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns641lb # [ 0.200982] ACPI: Core revision 20250807642worker1 # [ 0.072314] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)643worker2 # [ 0.211697] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)644worker1 # [ 0.075858] Console: colour VGA+ 80x25645client # [ 0.215123] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto646worker1 # [ 0.075861] printk: legacy console [tty0] enabled647lb # [ 0.201866] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns648worker2 # [ 0.212779] x86/cpu: User Mode Instruction Prevention (UMIP) activated649worker1 # [ 0.105315] printk: legacy console [ttyS0] enabled650client # [ 0.216119] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl651lb # [ 0.203358] APIC: Switch to symmetric I/O mode setup652worker1 # [ 0.201308] ACPI: Core revision 20250807653worker2 # [ 0.213817] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127654lb # [ 0.204294] x2apic enabled655client # [ 0.217120] Transient Scheduler Attacks: Vulnerable: No microcode656worker2 # [ 0.214694] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0657worker1 # [ 0.202168] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns658client # [ 0.218119] Spectre V2 : Mitigation: Enhanced / Automatic IBRS659lb # [ 0.205024] APIC: Switched APIC routing to: physical x2apic660worker1 # [ 0.203729] APIC: Switch to symmetric I/O mode setup661client # [ 0.219119] Speculative Return Stack Overflow: Mitigation: Safe RET662worker2 # [ 0.215698] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto663worker1 # [ 0.204657] x2apic enabled664lb # [ 0.206817] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1665worker1 # [ 0.205396] APIC: Switched APIC routing to: physical x2apic666worker2 # [ 0.216694] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl667lb # [ 0.207764] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns668worker2 # [ 0.217693] Transient Scheduler Attacks: Vulnerable: No microcode669worker1 # [ 0.207194] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1670worker2 # [ 0.218693] Spectre V2 : Mitigation: Enhanced / Automatic IBRS671lb # [ 0.209357] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)672client # [ 0.220119] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization673worker2 # [ 0.219693] Speculative Return Stack Overflow: Mitigation: Safe RET674client # [ 0.222126] Spectre V2 : Enabling IBPB for BPF675lb # [ 0.210443] x86/cpu: User Mode Instruction Prevention (UMIP) activated676worker1 # [ 0.208134] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns677lb # [ 0.211486] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127678client # [ 0.222835] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier679worker1 # [ 0.209704] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)680client # [ 0.224119] active return thunk: srso_alias_return_thunk681lb # [ 0.212355] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0682worker1 # [ 0.210791] x86/cpu: User Mode Instruction Prevention (UMIP) activated683client # [ 0.225141] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'684worker1 # [ 0.211832] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127685worker2 # [ 0.220693] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization686lb # [ 0.213358] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto687client # [ 0.226119] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'688worker2 # [ 0.222700] Spectre V2 : Enabling IBPB for BPF689worker1 # [ 0.212702] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0690client # [ 0.227119] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'691lb # [ 0.214355] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl692worker2 # [ 0.223694] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier693client # [ 0.228119] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'694lb # [ 0.215355] Transient Scheduler Attacks: Vulnerable: No microcode695worker1 # [ 0.213705] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto696worker2 # [ 0.224693] active return thunk: srso_alias_return_thunk697lb # [ 0.216354] Spectre V2 : Mitigation: Enhanced / Automatic IBRS698client # [ 0.229119] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'699worker1 # [ 0.214701] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl700worker2 # [ 0.225713] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'701lb # [ 0.217354] Speculative Return Stack Overflow: Mitigation: Safe RET702client # [ 0.230119] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'703worker1 # [ 0.215702] Transient Scheduler Attacks: Vulnerable: No microcode704worker2 # [ 0.226693] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'705worker1 # [ 0.216701] Spectre V2 : Mitigation: Enhanced / Automatic IBRS706client # [ 0.231119] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'707worker2 # [ 0.227693] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'708worker1 # [ 0.217701] Speculative Return Stack Overflow: Mitigation: Safe RET709client # [ 0.232119] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256710worker2 # [ 0.228693] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'711client # [ 0.233119] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64712worker2 # [ 0.229693] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'713lb # [ 0.218353] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization714client # [ 0.234119] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512715lb # [ 0.220362] Spectre V2 : Enabling IBPB for BPF716worker2 # [ 0.230693] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'717client # [ 0.235119] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024718lb # [ 0.221355] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier719worker2 # [ 0.231693] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'720worker1 # [ 0.218701] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization721client # [ 0.236119] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8722lb # [ 0.222355] active return thunk: srso_alias_return_thunk723worker1 # [ 0.220708] Spectre V2 : Enabling IBPB for BPF724worker2 # [ 0.232693] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256725client # [ 0.237119] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.726worker2 # [ 0.234414] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64727lb # [ 0.223375] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'728worker1 # [ 0.222219] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier729worker2 # [ 0.235403] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512730worker1 # [ 0.223664] active return thunk: srso_alias_return_thunk731lb # [ 0.224355] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'732worker2 # [ 0.235693] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024733worker1 # [ 0.224331] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'734lb # [ 0.225355] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'735worker2 # [ 0.236693] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8736worker1 # [ 0.225701] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'737lb # [ 0.226354] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'738worker1 # [ 0.226701] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'739worker2 # [ 0.237693] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.740lb # [ 0.227354] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'741worker1 # [ 0.227642] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'742worker1 # [ 0.228447] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'743lb # [ 0.228354] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'744lb # [ 0.229352] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'745worker1 # [ 0.229433] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'746lb # [ 0.229356] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256747worker1 # [ 0.229701] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'748lb # [ 0.230355] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64749worker1 # [ 0.231701] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256750lb # [ 0.231354] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512751worker1 # [ 0.232701] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64752lb # [ 0.232355] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024753worker1 # [ 0.233701] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512754worker1 # [ 0.234701] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024755lb # [ 0.233355] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8756worker1 # [ 0.235630] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8757lb # [ 0.234354] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.758worker1 # [ 0.236415] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759client # [ 0.273446] Freeing SMP alternatives memory: 44K760client # [ 0.274123] pid_max: default: 32768 minimum: 301761client # [ 0.275187] LSM: initializing lsm=capability,landlock,yama,bpf,ima762client # [ 0.276233] landlock: Up and running.763client # [ 0.276894] Yama: becoming mindful.764worker2 # [ 0.274821] Freeing SMP alternatives memory: 44K765client # [ 0.277805] LSM support for eBPF active766worker2 # [ 0.275606] pid_max: default: 32768 minimum: 301767client # [ 0.278250] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)768worker2 # [ 0.276350] LSM: initializing lsm=capability,landlock,yama,bpf,ima769worker2 # [ 0.277550] landlock: Up and running.770client # [ 0.279158] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)771worker2 # [ 0.278158] Yama: becoming mindful.772worker2 # [ 0.278913] LSM support for eBPF active773client # [ 0.282313] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)774worker2 # [ 0.279833] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)775worker2 # [ 0.280732] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)776client # [ 0.283742] Performance Events: Fam17h+ core perfctr, AMD PMU driver.777client # [ 0.284128] ... version: 2778client # [ 0.284883] ... bit width: 48779client # [ 0.285122] ... generic counters: 6780worker2 # [ 0.283494] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)781client # [ 0.285817] ... generic bitmap: 000000000000003f782worker1 # [ 0.273573] Freeing SMP alternatives memory: 44K783client # [ 0.286121] ... fixed-purpose counters: 0784worker2 # [ 0.284229] Performance Events: Fam17h+ core perfctr, AMD PMU driver.785worker1 # [ 0.274258] pid_max: default: 32768 minimum: 301786worker2 # [ 0.284698] ... version: 2787client # [ 0.286906] ... fixed-purpose bitmap: 0000000000000000788worker2 # [ 0.285391] ... bit width: 48789lb # [ 0.274572] Freeing SMP alternatives memory: 44K790worker1 # [ 0.274803] LSM: initializing lsm=capability,landlock,yama,bpf,ima791client # [ 0.287121] ... value mask: 0000ffffffffffff792worker2 # [ 0.285695] ... generic counters: 6793lb # [ 0.275357] pid_max: default: 32768 minimum: 301794worker1 # [ 0.275816] landlock: Up and running.795client # [ 0.288006] ... max period: 00007fffffffffff796worker1 # [ 0.276702] Yama: becoming mindful.797worker2 # [ 0.286372] ... generic bitmap: 000000000000003f798lb # [ 0.276177] LSM: initializing lsm=capability,landlock,yama,bpf,ima799client # [ 0.288767] ... global_ctrl mask: 000000000000003f800worker2 # [ 0.286751] ... fixed-purpose counters: 0801worker1 # [ 0.277708] LSM support for eBPF active802client # [ 0.289223] signal: max sigframe size: 3376803lb # [ 0.277396] landlock: Up and running.804worker2 # [ 0.287451] ... fixed-purpose bitmap: 0000000000000000805worker1 # [ 0.278456] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)806lb # [ 0.278132] Yama: becoming mindful.807client # [ 0.289987] rcu: Hierarchical SRCU implementation.808worker2 # [ 0.287696] ... value mask: 0000ffffffffffff809client # [ 0.290749] rcu: Max phase no-delay instances is 400.810lb # [ 0.279015] LSM support for eBPF active811worker1 # [ 0.279581] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)812worker2 # [ 0.288562] ... max period: 00007fffffffffff813worker2 # [ 0.289366] ... global_ctrl mask: 000000000000003f814lb # [ 0.279498] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)815worker2 # [ 0.289833] signal: max sigframe size: 3376816worker1 # [ 0.281850] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)817lb # [ 0.281255] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)818worker2 # [ 0.290614] rcu: Hierarchical SRCU implementation.819worker2 # [ 0.291268] rcu: Max phase no-delay instances is 400.820worker1 # [ 0.283322] Performance Events: Fam17h+ core perfctr, AMD PMU driver.821worker1 # [ 0.283710] ... version: 2822lb # [ 0.283516] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)823client # [ 0.295830] smp: Bringing up secondary CPUs ...824worker1 # [ 0.284381] ... bit width: 48825client # [ 0.296137] smp: Brought up 1 node, 1 CPU826worker1 # [ 0.284704] ... generic counters: 6827lb # [ 0.285044] Performance Events: Fam17h+ core perfctr, AMD PMU driver.828client # [ 0.296843] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)829worker1 # [ 0.285419] ... generic bitmap: 000000000000003f830lb # [ 0.285363] ... version: 2831worker1 # [ 0.285704] ... fixed-purpose counters: 0832lb # [ 0.286074] ... bit width: 48833worker1 # [ 0.286380] ... fixed-purpose bitmap: 0000000000000000834lb # [ 0.286356] ... generic counters: 6835worker2 # [ 0.296399] smp: Bringing up secondary CPUs ...836client # [ 0.297398] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)837worker1 # [ 0.286703] ... value mask: 0000ffffffffffff838worker2 # [ 0.296710] smp: Brought up 1 node, 1 CPU839lb # [ 0.287073] ... generic bitmap: 000000000000003f840client # [ 0.298401] devtmpfs: initialized841worker1 # [ 0.287560] ... max period: 00007fffffffffff842lb # [ 0.287357] ... fixed-purpose counters: 0843worker2 # [ 0.297352] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)844client # [ 0.299163] x86/mm: Memory block size: 128MB845worker1 # [ 0.288349] ... global_ctrl mask: 000000000000003f846lb # [ 0.288114] ... fixed-purpose bitmap: 0000000000000000847worker1 # [ 0.288810] signal: max sigframe size: 3376848lb # [ 0.288356] ... value mask: 0000ffffffffffff849worker1 # [ 0.289611] rcu: Hierarchical SRCU implementation.850worker2 # [ 0.297910] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)851client # [ 0.301015] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)852lb # [ 0.289287] ... max period: 00007fffffffffff853worker1 # [ 0.290276] rcu: Max phase no-delay instances is 400.854worker2 # [ 0.298977] devtmpfs: initialized855lb # [ 0.290086] ... global_ctrl mask: 000000000000003f856client # [ 0.302009] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).857worker2 # [ 0.299786] x86/mm: Memory block size: 128MB858lb # [ 0.290501] signal: max sigframe size: 3376859client # [ 0.303209] pinctrl core: initialized pinctrl subsystem860lb # [ 0.291401] rcu: Hierarchical SRCU implementation.861client # [ 0.304354] PM: RTC time: 08:15:21, date: 2026-09-20862lb # [ 0.292184] rcu: Max phase no-delay instances is 400.863worker2 # [ 0.301620] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)864worker2 # [ 0.302598] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).865worker1 # [ 0.295513] smp: Bringing up secondary CPUs ...866worker2 # [ 0.303779] pinctrl core: initialized pinctrl subsystem867worker1 # [ 0.296279] smp: Brought up 1 node, 1 CPU868worker2 # [ 0.304923] PM: RTC time: 08:15:21, date: 2026-09-20869client # [ 0.308051] NET: Registered PF_NETLINK/PF_ROUTE protocol family870worker1 # [ 0.296705] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)871client # [ 0.309412] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations872lb # [ 0.297734] smp: Bringing up secondary CPUs ...873worker1 # [ 0.297933] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)874lb # [ 0.298375] smp: Brought up 1 node, 1 CPU875client # [ 0.310154] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations876worker1 # [ 0.298980] devtmpfs: initialized877lb # [ 0.299153] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)878worker2 # [ 0.308907] NET: Registered PF_NETLINK/PF_ROUTE protocol family879worker1 # [ 0.299843] x86/mm: Memory block size: 128MB880client # [ 0.311428] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations881client # [ 0.312136] audit: initializing netlink subsys (disabled)882worker2 # [ 0.310264] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations883worker1 # [ 0.301692] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)884client # [ 0.313313] thermal_sys: Registered thermal governor 'fair_share'885lb # [ 0.300500] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)886worker2 # [ 0.310722] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations887client # [ 0.313315] thermal_sys: Registered thermal governor 'bang_bang'888lb # [ 0.301728] devtmpfs: initialized889worker1 # [ 0.302635] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).890worker2 # [ 0.311992] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations891client # [ 0.314123] thermal_sys: Registered thermal governor 'step_wise'892worker1 # [ 0.303815] pinctrl core: initialized pinctrl subsystem893lb # [ 0.302683] x86/mm: Memory block size: 128MB894worker2 # [ 0.312708] audit: initializing netlink subsys (disabled)895client # [ 0.315095] thermal_sys: Registered thermal governor 'user_space'896worker1 # [ 0.304979] PM: RTC time: 08:15:21, date: 2026-09-20897worker2 # [ 0.313698] audit: type=2000 audit(1789892122.376:1): state=initialized audit_enabled=0 res=1898client # [ 0.315855] audit: type=2000 audit(1789892122.370:1): state=initialized audit_enabled=0 res=1899lb # [ 0.304837] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)900worker2 # [ 0.314916] thermal_sys: Registered thermal governor 'fair_share'901client # [ 0.317125] thermal_sys: Registered thermal governor 'power_allocator'902client # [ 0.317143] cpuidle: using governor menu903worker2 # [ 0.314918] thermal_sys: Registered thermal governor 'bang_bang'904lb # [ 0.305397] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).905worker2 # [ 0.315697] thermal_sys: Registered thermal governor 'step_wise'906worker1 # [ 0.308783] NET: Registered PF_NETLINK/PF_ROUTE protocol family907client # [ 0.319412] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5908lb # [ 0.306471] pinctrl core: initialized pinctrl subsystem909worker2 # [ 0.316685] thermal_sys: Registered thermal governor 'user_space'910worker1 # [ 0.310256] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations911lb # [ 0.307677] PM: RTC time: 08:15:21, date: 2026-09-20912worker2 # [ 0.317437] thermal_sys: Registered thermal governor 'power_allocator'913client # [ 0.320376] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]914worker2 # [ 0.317712] cpuidle: using governor menu915worker1 # [ 0.310730] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations916client # [ 0.321127] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry917client # [ 0.322136] PCI: Using configuration type 1 for base access918worker2 # [ 0.319978] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5919worker1 # [ 0.312008] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations920worker1 # [ 0.312717] audit: initializing netlink subsys (disabled)921client # [ 0.323237] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.922worker2 # [ 0.320948] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]923lb # [ 0.311516] NET: Registered PF_NETLINK/PF_ROUTE protocol family924worker1 # [ 0.313897] thermal_sys: Registered thermal governor 'fair_share'925worker2 # [ 0.321699] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry926worker1 # [ 0.313900] thermal_sys: Registered thermal governor 'bang_bang'927lb # [ 0.312888] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations928worker2 # [ 0.322710] PCI: Using configuration type 1 for base access929worker1 # [ 0.314705] thermal_sys: Registered thermal governor 'step_wise'930lb # [ 0.313387] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations931worker1 # [ 0.315641] thermal_sys: Registered thermal governor 'user_space'932worker2 # [ 0.323844] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.933lb # [ 0.314648] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations934worker1 # [ 0.316403] audit: type=2000 audit(1789892122.389:1): state=initialized audit_enabled=0 res=1935client # [ 0.328275] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages936lb # [ 0.315369] audit: initializing netlink subsys (disabled)937worker1 # [ 0.317708] thermal_sys: Registered thermal governor 'power_allocator'938client # [ 0.329126] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page939worker1 # [ 0.317726] cpuidle: using governor menu940lb # [ 0.316763] thermal_sys: Registered thermal governor 'fair_share'941lb # [ 0.316766] thermal_sys: Registered thermal governor 'bang_bang'942worker1 # [ 0.319970] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5943lb # [ 0.317362] audit: type=2000 audit(1789892122.391:1): state=initialized audit_enabled=0 res=1944worker1 # [ 0.320962] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]945lb # [ 0.319359] thermal_sys: Registered thermal governor 'step_wise'946worker2 # [ 0.330721] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages947worker1 # [ 0.321708] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry948client # [ 0.334124] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages949lb # [ 0.319361] thermal_sys: Registered thermal governor 'user_space'950worker2 # [ 0.331698] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page951worker1 # [ 0.322720] PCI: Using configuration type 1 for base access952client # [ 0.335122] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page953lb # [ 0.320357] thermal_sys: Registered thermal governor 'power_allocator'954lb # [ 0.321394] cpuidle: using governor menu955worker1 # [ 0.323873] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.956lb # [ 0.323713] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5957lb # [ 0.324635] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]958worker2 # [ 0.336697] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages959worker2 # [ 0.337698] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page960lb # [ 0.325361] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry961worker1 # [ 0.328863] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages962lb # [ 0.326373] PCI: Using configuration type 1 for base access963worker1 # [ 0.329706] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page964lb # [ 0.327537] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.965client # [ 0.345510] ACPI: Added _OSI(Module Device)966client # [ 0.346123] ACPI: Added _OSI(Processor Device)967client # [ 0.346921] ACPI: Added _OSI(Processor Aggregator Device)968worker1 # [ 0.334705] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages969lb # [ 0.332509] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages970worker1 # [ 0.335703] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page971lb # [ 0.333358] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page972worker2 # [ 0.348960] ACPI: Added _OSI(Module Device)973worker2 # [ 0.349697] ACPI: Added _OSI(Processor Device)974worker2 # [ 0.350410] ACPI: Added _OSI(Processor Aggregator Device)975lb # [ 0.338358] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages976lb # [ 0.339356] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page977client # [ 0.357755] ACPI: 1 ACPI AML tables successfully acquired and loaded978worker1 # [ 0.346105] ACPI: Added _OSI(Module Device)979worker1 # [ 0.346706] ACPI: Added _OSI(Processor Device)980worker1 # [ 0.347439] ACPI: Added _OSI(Processor Aggregator Device)981client # [ 0.361536] ACPI: Interpreter enabled982worker2 # [ 0.358768] ACPI: 1 ACPI AML tables successfully acquired and loaded983client # [ 0.362138] ACPI: PM: (supports S0 S3 S4 S5)984client # [ 0.362867] ACPI: Using IOAPIC for interrupt routing985worker2 # [ 0.360657] ACPI: Interpreter enabled986worker2 # [ 0.361135] ACPI: PM: (supports S0 S3 S4 S5)987client # [ 0.363201] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug988worker2 # [ 0.361696] ACPI: Using IOAPIC for interrupt routing989client # [ 0.364122] PCI: Using E820 reservations for host bridge windows990lb # [ 0.349978] ACPI: Added _OSI(Module Device)991worker2 # [ 0.362540] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug992lb # [ 0.350358] ACPI: Added _OSI(Processor Device)993lb # [ 0.351201] ACPI: Added _OSI(Processor Aggregator Device)994client # [ 0.367262] ACPI: Enabled 2 GPEs in block 00 to 3F995worker1 # [ 0.356182] ACPI: 1 ACPI AML tables successfully acquired and loaded996worker2 # [ 0.367696] PCI: Using E820 reservations for host bridge windows997worker2 # [ 0.368891] ACPI: Enabled 2 GPEs in block 00 to 3F998worker1 # [ 0.360225] ACPI: Interpreter enabled999worker1 # [ 0.360727] ACPI: PM: (supports S0 S3 S4 S5)1000worker1 # [ 0.361429] ACPI: Using IOAPIC for interrupt routing1001client # [ 0.376283] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1002worker1 # [ 0.363770] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1003lb # [ 0.362615] ACPI: 1 ACPI AML tables successfully acquired and loaded1004worker1 # [ 0.364705] PCI: Using E820 reservations for host bridge windows1005client # [ 0.377563] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1006client # [ 0.378206] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1007worker2 # [ 0.377350] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1008client # [ 0.379251] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1009worker1 # [ 0.367761] ACPI: Enabled 2 GPEs in block 00 to 3F1010lb # [ 0.366777] ACPI: Interpreter enabled1011client # [ 0.380499] PCI host bridge to bus 0000:001012worker2 # [ 0.377705] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1013lb # [ 0.367373] ACPI: PM: (supports S0 S3 S4 S5)1014client # [ 0.381127] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1015worker2 # [ 0.378774] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1016lb # [ 0.368058] ACPI: Using IOAPIC for interrupt routing1017client # [ 0.382123] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1018worker2 # [ 0.379820] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1019client # [ 0.383122] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1020worker2 # [ 0.381041] PCI host bridge to bus 0000:001021client # [ 0.384122] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1022worker2 # [ 0.381701] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1023lb # [ 0.370416] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1024client # [ 0.385122] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1025worker2 # [ 0.382696] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1026lb # [ 0.371357] PCI: Using E820 reservations for host bridge windows1027client # [ 0.386122] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1028worker2 # [ 0.383696] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1029worker1 # [ 0.375709] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1030client # [ 0.387123] pci_bus 0000:00: root bus resource [bus 00-ff]1031worker2 # [ 0.384696] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1032lb # [ 0.374419] ACPI: Enabled 2 GPEs in block 00 to 3F1033worker1 # [ 0.376709] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1034client # [ 0.388049] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1035worker2 # [ 0.385696] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1036worker1 # [ 0.377783] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1037worker2 # [ 0.386696] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1038client # [ 0.389531] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1039worker1 # [ 0.378826] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1040worker2 # [ 0.387696] pci_bus 0000:00: root bus resource [bus 00-ff]1041worker1 # [ 0.380066] PCI host bridge to bus 0000:001042worker2 # [ 0.388718] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1043worker1 # [ 0.380708] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1044worker1 # [ 0.381704] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1045worker2 # [ 0.390196] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1046worker1 # [ 0.382704] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1047worker1 # [ 0.383704] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1048lb # [ 0.382545] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1049worker1 # [ 0.384704] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1050lb # [ 0.383363] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1051worker1 # [ 0.385703] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1052lb # [ 0.384455] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1053worker1 # [ 0.386705] pci_bus 0000:00: root bus resource [bus 00-ff]1054client # [ 0.392294] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1055lb # [ 0.385479] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1056client # [ 0.393135] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1057worker1 # [ 0.387625] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1058lb # [ 0.386699] PCI host bridge to bus 0000:001059client # [ 0.394079] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1060lb # [ 0.387361] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1061worker1 # [ 0.389156] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1062lb # [ 0.388356] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1063client # [ 0.395227] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1064worker2 # [ 0.392855] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1065lb # [ 0.389362] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1066worker2 # [ 0.393709] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1067client # [ 0.396911] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1068lb # [ 0.390357] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1069worker2 # [ 0.394671] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1070lb # [ 0.391386] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1071worker2 # [ 0.396041] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1072lb # [ 0.392356] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1073lb # [ 0.393357] pci_bus 0000:00: root bus resource [bus 00-ff]1074client # [ 0.400131] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1075worker2 # [ 0.397510] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1076client # [ 0.400969] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1077lb # [ 0.394272] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1078client # [ 0.401848] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1079lb # [ 0.395775] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1080worker1 # [ 0.391792] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1081client # [ 0.402128] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1082worker2 # [ 0.400718] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1083worker1 # [ 0.392717] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1084worker2 # [ 0.401573] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1085client # [ 0.403708] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1086worker1 # [ 0.393667] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1087worker2 # [ 0.402480] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1088worker1 # [ 0.394793] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1089worker2 # [ 0.403568] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1090client # [ 0.405130] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1091client # [ 0.405970] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1092worker1 # [ 0.396473] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1093worker2 # [ 0.405303] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1094client # [ 0.406831] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1095client # [ 0.407698] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1096lb # [ 0.398424] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1097worker1 # [ 0.399711] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1098worker2 # [ 0.406723] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1099lb # [ 0.399369] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1100worker1 # [ 0.400583] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1101worker2 # [ 0.407573] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1102worker1 # [ 0.401433] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1103lb # [ 0.400311] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1104worker2 # [ 0.408461] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1105worker1 # [ 0.401710] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1106lb # [ 0.401502] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1107client # [ 0.410129] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1108worker2 # [ 0.409288] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109client # [ 0.410949] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1110worker1 # [ 0.403297] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1111client # [ 0.411850] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1112lb # [ 0.403129] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1113client # [ 0.412707] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1114worker1 # [ 0.405535] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1115worker2 # [ 0.411704] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1116lb # [ 0.405386] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1117worker1 # [ 0.406346] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1118worker2 # [ 0.412571] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1119lb # [ 0.406215] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1120worker1 # [ 0.406725] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1121worker2 # [ 0.413448] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1122lb # [ 0.407069] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1123client # [ 0.415129] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1124lb # [ 0.407362] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1125client # [ 0.415952] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1126worker1 # [ 0.408259] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1127worker2 # [ 0.414278] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1128client # [ 0.416816] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1129lb # [ 0.409231] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1130worker2 # [ 0.415708] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1131worker1 # [ 0.410737] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1132client # [ 0.417690] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133worker2 # [ 0.416566] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1134worker1 # [ 0.411564] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1135lb # [ 0.411372] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1136worker1 # [ 0.412410] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1137lb # [ 0.412248] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1138client # [ 0.419131] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1139worker2 # [ 0.417468] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1140lb # [ 0.413176] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1141client # [ 0.419981] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1142worker1 # [ 0.413290] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143client # [ 0.420826] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1144worker2 # [ 0.419303] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1145lb # [ 0.414864] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1146client # [ 0.421713] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1147worker1 # [ 0.414773] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1148worker2 # [ 0.420708] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1149worker1 # [ 0.415594] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1150worker2 # [ 0.421580] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1151lb # [ 0.417364] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1152worker2 # [ 0.422471] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1153worker1 # [ 0.416412] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1154lb # [ 0.418195] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1155client # [ 0.424151] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1156lb # [ 0.419102] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1157client # [ 0.425062] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1158worker1 # [ 0.417285] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1159worker2 # [ 0.424194] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1160client # [ 0.425823] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1161lb # [ 0.419940] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1162worker1 # [ 0.418711] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1163client # [ 0.426747] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1164worker1 # [ 0.419560] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1165worker2 # [ 0.426708] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1166worker1 # [ 0.420448] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1167lb # [ 0.421387] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1168worker2 # [ 0.427539] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1169lb # [ 0.422231] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1170client # [ 0.428147] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1171worker2 # [ 0.428438] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1172worker1 # [ 0.421319] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1173client # [ 0.428996] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1174lb # [ 0.423081] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1175worker2 # [ 0.429305] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1176client # [ 0.429850] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1177lb # [ 0.423946] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1178client # [ 0.430144] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1179worker2 # [ 0.430706] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1180worker1 # [ 0.424478] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1181worker2 # [ 0.431599] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1182client # [ 0.431638] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1183lb # [ 0.425384] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1184worker1 # [ 0.425323] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1185lb # [ 0.426221] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1186worker1 # [ 0.425726] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1187worker2 # [ 0.432434] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1188client # [ 0.433135] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1189lb # [ 0.427069] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1190worker2 # [ 0.432703] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1191client # [ 0.434058] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1192worker1 # [ 0.427304] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1193lb # [ 0.427965] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1194worker2 # [ 0.434206] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1195client # [ 0.435581] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1196worker1 # [ 0.428711] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1197worker1 # [ 0.429585] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1198worker2 # [ 0.435712] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1199worker1 # [ 0.430449] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1200worker2 # [ 0.436719] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1201worker1 # [ 0.430710] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1202lb # [ 0.430641] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1203client # [ 0.437155] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1204lb # [ 0.431363] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1205client # [ 0.438129] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1206worker2 # [ 0.438237] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1207lb # [ 0.432378] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1208client # [ 0.439143] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1209worker1 # [ 0.432848] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1210lb # [ 0.433916] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1211client # [ 0.440684] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1212worker2 # [ 0.439707] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1213worker1 # [ 0.435522] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1214lb # [ 0.435364] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1215worker2 # [ 0.441347] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1216client # [ 0.442131] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1217worker1 # [ 0.436600] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1218lb # [ 0.436223] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1219worker2 # [ 0.441718] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1220client # [ 0.442980] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1221lb # [ 0.437142] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1222client # [ 0.443830] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1223worker1 # [ 0.438307] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1224worker2 # [ 0.443262] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1225lb # [ 0.438174] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1226client # [ 0.444707] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1227lb # [ 0.440141] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1228worker2 # [ 0.444719] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1229worker2 # [ 0.445624] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1230client # [ 0.445857] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1231worker1 # [ 0.441021] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1232lb # [ 0.442154] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1233worker2 # [ 0.446470] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1234worker1 # [ 0.442322] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1235client # [ 0.446339] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1236lb # [ 0.443079] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1237worker1 # [ 0.442728] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1238client # [ 0.447799] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1239lb # [ 0.443927] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1240worker2 # [ 0.448095] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1241worker1 # [ 0.444389] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1242worker2 # [ 0.450383] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1243lb # [ 0.445389] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1244worker2 # [ 0.450901] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1245lb # [ 0.446236] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1246worker1 # [ 0.447707] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1247worker2 # [ 0.452290] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1248worker1 # [ 0.448604] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1249lb # [ 0.447084] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1250worker1 # [ 0.449484] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1251lb # [ 0.448720] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1252worker1 # [ 0.451746] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1253lb # [ 0.450363] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1254lb # [ 0.451221] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1255worker1 # [ 0.453613] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1256lb # [ 0.452089] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1257worker1 # [ 0.454652] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1258client # [ 0.448318] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1259lb # [ 0.452942] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1260worker1 # [ 0.456528] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1261client # [ 0.450798] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1262lb # [ 0.454001] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1263client # [ 0.451394] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1264lb # [ 0.454761] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1265worker2 # [ 0.452906] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1266client # [ 0.452802] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1267lb # [ 0.455904] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1268worker2 # [ 0.455363] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1269client # [ 0.453414] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1270client # [ 0.454417] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1271worker2 # [ 0.455985] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1272client # [ 0.455418] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1273worker2 # [ 0.457335] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1274client # [ 0.457150] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1275worker2 # [ 0.457942] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1276client # [ 0.457985] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1277worker2 # [ 0.459025] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1278worker1 # [ 0.457610] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1279client # [ 0.459354] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1280worker2 # [ 0.459993] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1281client # [ 0.460840] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1282worker1 # [ 0.459767] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1283worker2 # [ 0.461703] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1284lb # [ 0.456556] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1285worker1 # [ 0.461013] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1286worker2 # [ 0.462568] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1287lb # [ 0.458910] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1288worker1 # [ 0.462463] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1289worker2 # [ 0.464094] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1290client # [ 0.464133] ACPI: PCI: Interrupt link LNKA configured for IRQ 101291lb # [ 0.459632] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1292client # [ 0.465195] ACPI: PCI: Interrupt link LNKB configured for IRQ 101293worker1 # [ 0.463023] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1294worker2 # [ 0.465440] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1295client # [ 0.466222] ACPI: PCI: Interrupt link LNKC configured for IRQ 111296lb # [ 0.460875] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1297worker1 # [ 0.464002] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1298client # [ 0.467217] ACPI: PCI: Interrupt link LNKD configured for IRQ 111299lb # [ 0.461773] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1300client # [ 0.468221] ACPI: PCI: Interrupt link LNKE configured for IRQ 101301worker1 # [ 0.464979] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1302worker2 # [ 0.468651] ACPI: PCI: Interrupt link LNKA configured for IRQ 101303client # [ 0.469218] ACPI: PCI: Interrupt link LNKF configured for IRQ 101304lb # [ 0.462644] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1305client # [ 0.470220] ACPI: PCI: Interrupt link LNKG configured for IRQ 111306worker2 # [ 0.469558] ACPI: PCI: Interrupt link LNKB configured for IRQ 101307lb # [ 0.463673] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1308worker1 # [ 0.467422] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1309client # [ 0.471216] ACPI: PCI: Interrupt link LNKH configured for IRQ 111310worker2 # [ 0.470614] ACPI: PCI: Interrupt link LNKC configured for IRQ 111311worker1 # [ 0.467711] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1312client # [ 0.472155] ACPI: PCI: Interrupt link GSIA configured for IRQ 161313lb # [ 0.465216] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1314worker2 # [ 0.471757] ACPI: PCI: Interrupt link LNKD configured for IRQ 111315client # [ 0.473088] ACPI: PCI: Interrupt link GSIB configured for IRQ 171316lb # [ 0.465993] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1317worker2 # [ 0.472798] ACPI: PCI: Interrupt link LNKE configured for IRQ 101318worker1 # [ 0.469027] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1319client # [ 0.473819] ACPI: PCI: Interrupt link GSIC configured for IRQ 181320worker2 # [ 0.473787] ACPI: PCI: Interrupt link LNKF configured for IRQ 101321client # [ 0.474134] ACPI: PCI: Interrupt link GSID configured for IRQ 191322lb # [ 0.466678] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1323worker1 # [ 0.470426] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1324worker2 # [ 0.474795] ACPI: PCI: Interrupt link LNKG configured for IRQ 111325client # [ 0.475075] ACPI: PCI: Interrupt link GSIE configured for IRQ 201326worker2 # [ 0.475790] ACPI: PCI: Interrupt link LNKH configured for IRQ 111327lb # [ 0.467986] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1328client # [ 0.475868] ACPI: PCI: Interrupt link GSIF configured for IRQ 211329worker2 # [ 0.476732] ACPI: PCI: Interrupt link GSIA configured for IRQ 161330client # [ 0.476137] ACPI: PCI: Interrupt link GSIG configured for IRQ 221331worker2 # [ 0.477708] ACPI: PCI: Interrupt link GSIB configured for IRQ 171332client # [ 0.477136] ACPI: PCI: Interrupt link GSIH configured for IRQ 231333worker1 # [ 0.473893] ACPI: PCI: Interrupt link LNKA configured for IRQ 101334worker2 # [ 0.478715] ACPI: PCI: Interrupt link GSIC configured for IRQ 181335lb # [ 0.471335] ACPI: PCI: Interrupt link LNKA configured for IRQ 101336client # [ 0.479159] iommu: Default domain type: Translated1337worker2 # [ 0.479719] ACPI: PCI: Interrupt link GSID configured for IRQ 191338worker1 # [ 0.474815] ACPI: PCI: Interrupt link LNKB configured for IRQ 101339lb # [ 0.472168] ACPI: PCI: Interrupt link LNKB configured for IRQ 101340client # [ 0.479939] iommu: DMA domain TLB invalidation policy: lazy mode1341worker2 # [ 0.480673] ACPI: PCI: Interrupt link GSIE configured for IRQ 201342client # [ 0.481122] ACPI: bus type USB registered1343lb # [ 0.473169] ACPI: PCI: Interrupt link LNKC configured for IRQ 111344client # [ 0.481861] usbcore: registered new interface driver usbfs1345lb # [ 0.474165] ACPI: PCI: Interrupt link LNKD configured for IRQ 111346worker2 # [ 0.481623] ACPI: PCI: Interrupt link GSIF configured for IRQ 211347lb # [ 0.475176] ACPI: PCI: Interrupt link LNKE configured for IRQ 101348worker1 # [ 0.477221] ACPI: PCI: Interrupt link LNKC configured for IRQ 111349worker2 # [ 0.482714] ACPI: PCI: Interrupt link GSIG configured for IRQ 221350lb # [ 0.476173] ACPI: PCI: Interrupt link LNKF configured for IRQ 101351client # [ 0.482134] usbcore: registered new interface driver hub1352worker1 # [ 0.477868] ACPI: PCI: Interrupt link LNKD configured for IRQ 111353worker2 # [ 0.483684] ACPI: PCI: Interrupt link GSIH configured for IRQ 231354client # [ 0.483757] usbcore: registered new device driver usb1355lb # [ 0.477148] ACPI: PCI: Interrupt link LNKG configured for IRQ 111356worker1 # [ 0.478806] ACPI: PCI: Interrupt link LNKE configured for IRQ 101357lb # [ 0.478332] ACPI: PCI: Interrupt link LNKH configured for IRQ 111358worker2 # [ 0.485576] iommu: Default domain type: Translated1359worker1 # [ 0.479807] ACPI: PCI: Interrupt link LNKF configured for IRQ 101360client # [ 0.485106] NetLabel: Initializing1361lb # [ 0.479152] ACPI: PCI: Interrupt link GSIA configured for IRQ 161362client # [ 0.485578] NetLabel: domain hash size = 1281363worker2 # [ 0.486285] iommu: DMA domain TLB invalidation policy: lazy mode1364worker1 # [ 0.480810] ACPI: PCI: Interrupt link LNKG configured for IRQ 111365lb # [ 0.480058] ACPI: PCI: Interrupt link GSIB configured for IRQ 171366client # [ 0.486121] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1367worker2 # [ 0.486955] ACPI: bus type USB registered1368lb # [ 0.480369] ACPI: PCI: Interrupt link GSIC configured for IRQ 181369client # [ 0.487134] NetLabel: unlabeled traffic allowed by default1370worker2 # [ 0.487679] usbcore: registered new interface driver usbfs1371worker1 # [ 0.481801] ACPI: PCI: Interrupt link LNKH configured for IRQ 111372client # [ 0.488049] PCI: Using ACPI for IRQ routing1373lb # [ 0.481299] ACPI: PCI: Interrupt link GSID configured for IRQ 191374worker1 # [ 0.482747] ACPI: PCI: Interrupt link GSIA configured for IRQ 161375worker2 # [ 0.488467] usbcore: registered new interface driver hub1376lb # [ 0.482050] ACPI: PCI: Interrupt link GSIE configured for IRQ 201377worker1 # [ 0.483720] ACPI: PCI: Interrupt link GSIB configured for IRQ 171378worker2 # [ 0.489726] usbcore: registered new device driver usb1379lb # [ 0.482368] ACPI: PCI: Interrupt link GSIF configured for IRQ 211380worker1 # [ 0.484725] ACPI: PCI: Interrupt link GSIC configured for IRQ 181381lb # [ 0.483371] ACPI: PCI: Interrupt link GSIG configured for IRQ 221382worker2 # [ 0.491554] NetLabel: Initializing1383worker1 # [ 0.485718] ACPI: PCI: Interrupt link GSID configured for IRQ 191384lb # [ 0.484322] ACPI: PCI: Interrupt link GSIH configured for IRQ 231385worker2 # [ 0.492151] NetLabel: domain hash size = 1281386worker1 # [ 0.486691] ACPI: PCI: Interrupt link GSIE configured for IRQ 201387worker2 # [ 0.492696] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1388worker1 # [ 0.487446] ACPI: PCI: Interrupt link GSIF configured for IRQ 211389lb # [ 0.486209] iommu: Default domain type: Translated1390worker2 # [ 0.493647] NetLabel: unlabeled traffic allowed by default1391worker2 # [ 0.494342] PCI: Using ACPI for IRQ routing1392worker1 # [ 0.487717] ACPI: PCI: Interrupt link GSIG configured for IRQ 221393lb # [ 0.486914] iommu: DMA domain TLB invalidation policy: lazy mode1394worker1 # [ 0.488664] ACPI: PCI: Interrupt link GSIH configured for IRQ 231395lb # [ 0.488383] ACPI: bus type USB registered1396lb # [ 0.489153] usbcore: registered new interface driver usbfs1397worker1 # [ 0.490938] iommu: Default domain type: Translated1398lb # [ 0.490135] usbcore: registered new interface driver hub1399worker1 # [ 0.491714] iommu: DMA domain TLB invalidation policy: lazy mode1400lb # [ 0.490367] usbcore: registered new device driver usb1401worker1 # [ 0.493112] ACPI: bus type USB registered1402worker1 # [ 0.493796] usbcore: registered new interface driver usbfs1403lb # [ 0.492107] NetLabel: Initializing1404lb # [ 0.492363] NetLabel: domain hash size = 1281405worker1 # [ 0.494723] usbcore: registered new interface driver hub1406lb # [ 0.493057] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1407worker1 # [ 0.495620] usbcore: registered new device driver usb1408lb # [ 0.493430] NetLabel: unlabeled traffic allowed by default1409lb # [ 0.494325] PCI: Using ACPI for IRQ routing1410worker1 # [ 0.497412] NetLabel: Initializing1411worker1 # [ 0.497705] NetLabel: domain hash size = 1281412worker1 # [ 0.498492] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker1 # [ 0.498752] NetLabel: unlabeled traffic allowed by default1414worker1 # [ 0.499708] PCI: Using ACPI for IRQ routing1415client # [ 0.531531] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416client # [ 0.532118] pci 0000:00:01.0: vgaarb: bridge control possible1417client # [ 0.532118] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418client # [ 0.532127] vgaarb: loaded1419client # [ 0.532852] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420client # [ 0.533123] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker2 # [ 0.537875] pci 0000:00:01.0: vgaarb: setting as boot VGA device1422worker2 # [ 0.538692] pci 0000:00:01.0: vgaarb: bridge control possible1423worker2 # [ 0.538692] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1424client # [ 0.537218] clocksource: Switched to clocksource kvm-clock1425worker2 # [ 0.538703] vgaarb: loaded1426worker2 # [ 0.539475] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01427worker2 # [ 0.539696] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1428client # [ 0.540901] VFS: Disk quotas dquot_6.6.01429client # [ 0.541612] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1430client # [ 0.542941] pnp: PnP ACPI init1431worker2 # [ 0.543803] clocksource: Switched to clocksource kvm-clock1432client # [ 0.543747] ACPI: IRQ 4 override to edge(!), high(!)1433lb # [ 0.537995] pci 0000:00:01.0: vgaarb: setting as boot VGA device1434client # [ 0.544686] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1435lb # [ 0.538352] pci 0000:00:01.0: vgaarb: bridge control possible1436client # [ 0.546181] pnp: PnP ACPI: found 6 devices1437lb # [ 0.538352] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1438lb # [ 0.538361] vgaarb: loaded1439worker2 # [ 0.547692] VFS: Disk quotas dquot_6.6.01440worker1 # [ 0.543650] pci 0000:00:01.0: vgaarb: setting as boot VGA device1441lb # [ 0.539126] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01442worker2 # [ 0.548454] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1443worker1 # [ 0.543700] pci 0000:00:01.0: vgaarb: bridge control possible1444lb # [ 0.539358] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1445worker2 # [ 0.549816] pnp: PnP ACPI init1446worker1 # [ 0.543700] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1447worker2 # [ 0.550679] ACPI: IRQ 4 override to edge(!), high(!)1448worker1 # [ 0.543710] vgaarb: loaded1449worker1 # [ 0.544471] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01450worker2 # [ 0.551673] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1451worker1 # [ 0.544705] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1452worker2 # [ 0.553232] pnp: PnP ACPI: found 6 devices1453lb # [ 0.543456] clocksource: Switched to clocksource kvm-clock1454client # [ 0.553865] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1455client # [ 0.555273] clocksource: Switched to clocksource acpi_pm1456client # [ 0.556220] NET: Registered PF_INET protocol family1457worker1 # [ 0.547812] clocksource: Switched to clocksource kvm-clock1458lb # [ 0.547149] VFS: Disk quotas dquot_6.6.01459client # [ 0.557459] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1460lb # [ 0.547843] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1461lb # [ 0.549140] pnp: PnP ACPI init1462lb # [ 0.549991] ACPI: IRQ 4 override to edge(!), high(!)1463worker1 # [ 0.551718] VFS: Disk quotas dquot_6.6.01464worker2 # [ 0.560899] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1465worker1 # [ 0.552469] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1466lb # [ 0.550941] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1467worker2 # [ 0.562342] clocksource: Switched to clocksource acpi_pm1468worker1 # [ 0.553845] pnp: PnP ACPI init1469lb # [ 0.552453] pnp: PnP ACPI: found 6 devices1470worker2 # [ 0.563311] NET: Registered PF_INET protocol family1471worker1 # [ 0.554767] ACPI: IRQ 4 override to edge(!), high(!)1472worker2 # [ 0.564501] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1473worker1 # [ 0.555817] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1474worker1 # [ 0.557421] pnp: PnP ACPI: found 6 devices1475lb # [ 0.560116] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1476lb # [ 0.561522] clocksource: Switched to clocksource acpi_pm1477lb # [ 0.562470] NET: Registered PF_INET protocol family1478lb # [ 0.563676] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1479worker1 # [ 0.565139] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1480client # [ 0.574595] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1481worker1 # [ 0.566566] clocksource: Switched to clocksource acpi_pm1482worker1 # [ 0.567579] NET: Registered PF_INET protocol family1483client # [ 0.576182] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1484client # [ 0.577472] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1485worker1 # [ 0.568824] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1486client # [ 0.578753] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1487client # [ 0.579940] TCP: Hash tables configured (established 16384 bind 16384)1488client # [ 0.581028] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1489worker2 # [ 0.581831] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1490client # [ 0.582238] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1491client # [ 0.583271] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1492worker2 # [ 0.583463] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1493client # [ 0.584461] NET: Registered PF_UNIX/PF_LOCAL protocol family1494worker2 # [ 0.584794] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1495client # [ 0.585376] NET: Registered PF_XDP protocol family1496client # [ 0.586160] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1497worker2 # [ 0.586194] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1498client # [ 0.587128] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1499worker2 # [ 0.587562] TCP: Hash tables configured (established 16384 bind 16384)1500client # [ 0.588140] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1501worker2 # [ 0.588719] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1502client # [ 0.589189] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1503worker2 # [ 0.590030] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1504client # [ 0.590242] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1505worker2 # [ 0.591145] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1506client # [ 0.591285] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1507lb # [ 0.580862] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1508worker2 # [ 0.592367] NET: Registered PF_UNIX/PF_LOCAL protocol family1509client # [ 0.592933] ACPI: \_SB_.GSIA: Enabled at IRQ 161510worker2 # [ 0.593360] NET: Registered PF_XDP protocol family1511lb # [ 0.582379] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1512worker2 # [ 0.594203] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1513lb # [ 0.583674] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1514client # [ 0.595068] ACPI: \_SB_.GSIB: Enabled at IRQ 171515worker2 # [ 0.595228] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1516lb # [ 0.584985] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1517worker2 # [ 0.596197] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1518worker1 # [ 0.586742] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1519lb # [ 0.586184] TCP: Hash tables configured (established 16384 bind 16384)1520client # [ 0.597083] ACPI: \_SB_.GSIC: Enabled at IRQ 181521worker2 # [ 0.597218] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1522worker1 # [ 0.588132] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1523lb # [ 0.587277] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1524worker2 # [ 0.598258] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1525worker1 # [ 0.589421] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1526client # [ 0.599033] ACPI: \_SB_.GSID: Enabled at IRQ 191527lb # [ 0.588500] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1528worker2 # [ 0.599352] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1529worker1 # [ 0.590751] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1530lb # [ 0.589549] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1531client # [ 0.601023] PCI: CLS 0 bytes, default 641532worker2 # [ 0.601148] ACPI: \_SB_.GSIA: Enabled at IRQ 161533worker1 # [ 0.592002] TCP: Hash tables configured (established 16384 bind 16384)1534lb # [ 0.590812] NET: Registered PF_UNIX/PF_LOCAL protocol family1535lb # [ 0.591707] NET: Registered PF_XDP protocol family1536worker1 # [ 0.593100] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1537client # [ 0.601931] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1538worker2 # [ 0.603279] ACPI: \_SB_.GSIB: Enabled at IRQ 171539lb # [ 0.592511] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1540client # [ 0.603567] Trying to unpack rootfs image as initramfs...1541worker1 # [ 0.594338] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1542lb # [ 0.593477] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1543worker1 # [ 0.595405] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1544lb # [ 0.594451] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1545worker2 # [ 0.605615] ACPI: \_SB_.GSIC: Enabled at IRQ 181546worker1 # [ 0.596682] NET: Registered PF_UNIX/PF_LOCAL protocol family1547lb # [ 0.595572] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1548worker1 # [ 0.597655] NET: Registered PF_XDP protocol family1549lb # [ 0.596654] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1550worker2 # [ 0.607646] ACPI: \_SB_.GSID: Enabled at IRQ 191551worker1 # [ 0.598476] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1552lb # [ 0.597730] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1553worker1 # [ 0.599454] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1554worker2 # [ 0.609343] PCI: CLS 0 bytes, default 641555worker1 # [ 0.600435] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1556lb # [ 0.599485] ACPI: \_SB_.GSIA: Enabled at IRQ 161557worker1 # [ 0.601518] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1558worker2 # [ 0.610249] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1559worker1 # [ 0.602615] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1560worker2 # [ 0.612018] Trying to unpack rootfs image as initramfs...1561lb # [ 0.601766] ACPI: \_SB_.GSIB: Enabled at IRQ 171562worker1 # [ 0.603697] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1563lb # [ 0.603923] ACPI: \_SB_.GSIC: Enabled at IRQ 181564worker1 # [ 0.605466] ACPI: \_SB_.GSIA: Enabled at IRQ 161565lb # [ 0.605870] ACPI: \_SB_.GSID: Enabled at IRQ 191566worker1 # [ 0.608015] ACPI: \_SB_.GSIB: Enabled at IRQ 171567lb # [ 0.607504] PCI: CLS 0 bytes, default 641568worker1 # [ 0.609974] ACPI: \_SB_.GSIC: Enabled at IRQ 181569lb # [ 0.608419] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1570lb # [ 0.610147] Trying to unpack rootfs image as initramfs...1571worker1 # [ 0.612582] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker1 # [ 0.614267] PCI: CLS 0 bytes, default 641573worker1 # [ 0.615142] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574worker1 # [ 0.616860] Trying to unpack rootfs image as initramfs...1575client # [ 0.646849] Initialise system trusted keyrings1576client # [ 0.650429] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker2 # [ 0.659341] Initialise system trusted keyrings1578worker2 # [ 0.660317] workingset: timestamp_bits=40 max_order=19 bucket_order=01579lb # [ 0.656098] Initialise system trusted keyrings1580lb # [ 0.657050] workingset: timestamp_bits=40 max_order=19 bucket_order=01581client # [ 0.671556] Key type asymmetric registered1582worker1 # [ 0.662497] Initialise system trusted keyrings1583client # [ 0.672278] Asymmetric key parser 'x509' registered1584client # [ 0.673131] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1585worker1 # [ 0.665573] workingset: timestamp_bits=40 max_order=19 bucket_order=01586client # [ 0.678511] io scheduler mq-deadline registered1587client # [ 0.679230] io scheduler kyber registered1588client # [ 0.682988] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1589worker2 # [ 0.684085] Key type asymmetric registered1590client # [ 0.684346] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1591worker2 # [ 0.684969] Asymmetric key parser 'x509' registered1592client # [ 0.688000] Linux agpgart interface v0.1031593worker2 # [ 0.687951] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1594client # [ 0.688799] ACPI: bus type drm_connector registered1595worker2 # [ 0.690931] io scheduler mq-deadline registered1596lb # [ 0.680671] Key type asymmetric registered1597worker2 # [ 0.691772] io scheduler kyber registered1598lb # [ 0.681401] Asymmetric key parser 'x509' registered1599client # [ 0.691783] usbcore: registered new interface driver usbserial_generic1600client # [ 0.692863] usbserial: USB Serial support registered for generic1601lb # [ 0.682271] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1602worker2 # [ 0.695887] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1603lb # [ 0.685914] io scheduler mq-deadline registered1604lb # [ 0.686662] io scheduler kyber registered1605client # [ 0.696392] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1606worker2 # [ 0.697353] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1607client # [ 0.696392] Please enable it if your BIOS has the CPPC option.1608worker1 # [ 0.689583] Key type asymmetric registered1609client # [ 0.698655] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1610worker1 # [ 0.690307] Asymmetric key parser 'x509' registered1611lb # [ 0.689277] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1612worker1 # [ 0.691171] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1613lb # [ 0.690588] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1614client # [ 0.701512] drop_monitor: Initializing network drop monitor service1615worker2 # [ 0.702673] Linux agpgart interface v0.1031616client # [ 0.702690] NET: Registered PF_INET6 protocol family1617worker2 # [ 0.703543] ACPI: bus type drm_connector registered1618worker1 # [ 0.695701] io scheduler mq-deadline registered1619worker1 # [ 0.696452] io scheduler kyber registered1620lb # [ 0.696666] Linux agpgart interface v0.1031621client # [ 0.707463] Segment Routing with IPv61622lb # [ 0.697430] ACPI: bus type drm_connector registered1623client # [ 0.708131] In-situ OAM (IOAM) with IPv61624worker2 # [ 0.708466] usbcore: registered new interface driver usbserial_generic1625client # [ 0.709203] IPI shorthand broadcast: enabled1626worker1 # [ 0.700139] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1627worker2 # [ 0.709656] usbserial: USB Serial support registered for generic1628lb # [ 0.700151] usbcore: registered new interface driver usbserial_generic1629worker1 # [ 0.701457] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1630lb # [ 0.701196] usbserial: USB Serial support registered for generic1631worker2 # [ 0.712883] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1632worker2 # [ 0.712883] Please enable it if your BIOS has the CPPC option.1633worker2 # [ 0.715285] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1634worker1 # [ 0.706742] Linux agpgart interface v0.1031635lb # [ 0.704663] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1636lb # [ 0.704663] Please enable it if your BIOS has the CPPC option.1637worker1 # [ 0.707575] ACPI: bus type drm_connector registered1638lb # [ 0.706827] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1639client # [ 0.717536] sched_clock: Marking stable (583013479, 134352128)->(800834105, -83468498)1640worker2 # [ 0.719051] drop_monitor: Initializing network drop monitor service1641worker1 # [ 0.710980] usbcore: registered new interface driver usbserial_generic1642worker2 # [ 0.720359] NET: Registered PF_INET6 protocol family1643worker1 # [ 0.712096] usbserial: USB Serial support registered for generic1644lb # [ 0.710812] drop_monitor: Initializing network drop monitor service1645lb # [ 0.711937] NET: Registered PF_INET6 protocol family1646client # [ 0.722645] registered taskstats version 11647client # [ 0.723613] Loading compiled-in X.509 certificates1648worker2 # [ 0.724382] Segment Routing with IPv61649worker1 # [ 0.715535] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1650lb # [ 0.715162] Segment Routing with IPv61651worker1 # [ 0.715535] Please enable it if your BIOS has the CPPC option.1652worker2 # [ 0.726905] In-situ OAM (IOAM) with IPv61653worker1 # [ 0.717747] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1654worker2 # [ 0.728100] IPI shorthand broadcast: enabled1655lb # [ 0.717676] In-situ OAM (IOAM) with IPv61656lb # [ 0.718772] IPI shorthand broadcast: enabled1657worker1 # [ 0.720696] drop_monitor: Initializing network drop monitor service1658worker1 # [ 0.721925] NET: Registered PF_INET6 protocol family1659worker1 # [ 0.725081] Segment Routing with IPv61660worker1 # [ 0.727554] In-situ OAM (IOAM) with IPv61661worker2 # [ 0.736521] sched_clock: Marking stable (603013962, 132848431)->(815275494, -79413101)1662lb # [ 0.727111] sched_clock: Marking stable (594013598, 132624256)->(806007560, -79369706)1663worker1 # [ 0.729844] IPI shorthand broadcast: enabled1664client # [ 0.741496] Demotion targets for Node 0: null1665worker2 # [ 0.741995] registered taskstats version 11666lb # [ 0.731955] registered taskstats version 11667worker2 # [ 0.743069] Loading compiled-in X.509 certificates1668lb # [ 0.732927] Loading compiled-in X.509 certificates1669client # [ 0.744420] Key type .fscrypt registered1670client # [ 0.745133] Key type fscrypt-provisioning registered1671client # [ 0.746135] ima: No TPM chip found, activating TPM-bypass!1672worker1 # [ 0.738351] sched_clock: Marking stable (605016603, 132501253)->(813183964, -75666108)1673client # [ 0.748381] ima: Allocated hash algorithm: sha11674client # [ 0.749206] ima: No architecture policies found1675worker1 # [ 0.741742] registered taskstats version 11676client # [ 0.751378] PM: Magic number: 10:89:2711677worker1 # [ 0.742810] Loading compiled-in X.509 certificates1678client # [ 0.753070] RAS: Correctable Errors collector initialized.1679worker2 # [ 0.761884] Demotion targets for Node 0: null1680lb # [ 0.751659] Demotion targets for Node 0: null1681worker2 # [ 0.762934] Key type .fscrypt registered1682lb # [ 0.752660] Key type .fscrypt registered1683worker2 # [ 0.763681] Key type fscrypt-provisioning registered1684lb # [ 0.753313] Key type fscrypt-provisioning registered1685client # [ 0.764117] clk: Disabling unused clocks1686worker2 # [ 0.764744] ima: No TPM chip found, activating TPM-bypass!1687lb # [ 0.754243] ima: No TPM chip found, activating TPM-bypass!1688client # [ 0.766387] PM: genpd: Disabling unused power domains1689lb # [ 0.758663] ima: Allocated hash algorithm: sha11690worker2 # [ 0.769876] ima: Allocated hash algorithm: sha11691lb # [ 0.759435] ima: No architecture policies found1692worker2 # [ 0.770763] ima: No architecture policies found1693worker1 # [ 0.762009] Demotion targets for Node 0: null1694lb # [ 0.761656] PM: Magic number: 10:89:2711695worker2 # [ 0.773891] PM: Magic number: 10:89:2711696lb # [ 0.763320] RAS: Correctable Errors collector initialized.1697worker1 # [ 0.765593] Key type .fscrypt registered1698worker1 # [ 0.766293] Key type fscrypt-provisioning registered1699worker2 # [ 0.775678] RAS: Correctable Errors collector initialized.1700worker1 # [ 0.767273] ima: No TPM chip found, activating TPM-bypass!1701worker1 # [ 0.768225] ima: Allocated hash algorithm: sha11702worker1 # [ 0.769040] ima: No architecture policies found1703worker1 # [ 0.773553] PM: Magic number: 10:89:2711704lb # [ 0.773390] clk: Disabling unused clocks1705worker2 # [ 0.784573] clk: Disabling unused clocks1706lb # [ 0.775655] PM: genpd: Disabling unused power domains1707worker1 # [ 0.777709] RAS: Correctable Errors collector initialized.1708worker2 # [ 0.786893] PM: genpd: Disabling unused power domains1709worker1 # [ 0.786824] clk: Disabling unused clocks1710worker1 # [ 0.789543] PM: genpd: Disabling unused power domains1711client # [ 0.945216] Freeing initrd memory: 29096K1712client # [ 0.948552] Freeing unused decrypted memory: 2028K1713client # [ 0.951255] Freeing unused kernel image (initmem) memory: 3644K1714client # [ 0.952301] Write protecting the kernel read-only data: 32768k1715client # [ 0.954162] Freeing unused kernel image (text/rodata gap) memory: 1208K1716client # [ 0.955696] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker2 # [ 0.962153] Freeing initrd memory: 29092K1718lb # [ 0.952116] Freeing initrd memory: 29092K1719worker2 # [ 0.965473] Freeing unused decrypted memory: 2028K1720lb # [ 0.955381] Freeing unused decrypted memory: 2028K1721worker2 # [ 0.968235] Freeing unused kernel image (initmem) memory: 3644K1722lb # [ 0.958127] Freeing unused kernel image (initmem) memory: 3644K1723worker2 # [ 0.969390] Write protecting the kernel read-only data: 32768k1724lb # [ 0.959174] Write protecting the kernel read-only data: 32768k1725worker2 # [ 0.971383] Freeing unused kernel image (text/rodata gap) memory: 1208K1726lb # [ 0.961039] Freeing unused kernel image (text/rodata gap) memory: 1208K1727worker2 # [ 0.972962] Freeing unused kernel image (rodata/data gap) memory: 752K1728lb # [ 0.962537] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker1 # [ 0.977064] Freeing initrd memory: 29092K1730worker1 # [ 0.980599] Freeing unused decrypted memory: 2028K1731worker1 # [ 0.983584] Freeing unused kernel image (initmem) memory: 3644K1732worker1 # [ 0.984671] Write protecting the kernel read-only data: 32768k1733worker1 # [ 0.986682] Freeing unused kernel image (text/rodata gap) memory: 1208K1734worker1 # [ 0.988305] Freeing unused kernel image (rodata/data gap) memory: 752K1735client # [ 1.006985] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736client # [ 1.008035] Run /init as init process1737client # [ 1.018817] systemd[1]: Inserted module 'autofs4'1738worker2 # [ 1.024282] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739lb # [ 1.013964] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740worker2 # [ 1.025431] Run /init as init process1741lb # [ 1.015041] Run /init as init process1742client # [ 1.035276] fuse: init (API version 7.45)1743lb # [ 1.025663] systemd[1]: Inserted module 'autofs4'1744worker2 # [ 1.036485] systemd[1]: Inserted module 'autofs4'1745client # [ 1.041128] ACPI: \_SB_.GSIG: Enabled at IRQ 221746client # [ 1.043536] ACPI: \_SB_.GSIH: Enabled at IRQ 231747client # [ 1.046531] ACPI: \_SB_.GSIE: Enabled at IRQ 201748worker1 # [ 1.039764] x86/mm: Checked W+X mappings: passed, no W+X pages found.1749client # [ 1.049050] ACPI: \_SB_.GSIF: Enabled at IRQ 211750worker1 # [ 1.040866] Run /init as init process1751lb # [ 1.042057] fuse: init (API version 7.45)1752worker2 # [ 1.053172] fuse: init (API version 7.45)1753lb # [ 1.047934] ACPI: \_SB_.GSIG: Enabled at IRQ 221754worker2 # [ 1.059109] ACPI: \_SB_.GSIG: Enabled at IRQ 221755lb # [ 1.050325] ACPI: \_SB_.GSIH: Enabled at IRQ 231756worker1 # [ 1.051928] systemd[1]: Inserted module 'autofs4'1757worker2 # [ 1.061570] ACPI: \_SB_.GSIH: Enabled at IRQ 231758lb # [ 1.053107] ACPI: \_SB_.GSIE: Enabled at IRQ 201759worker2 # [ 1.064567] ACPI: \_SB_.GSIE: Enabled at IRQ 201760lb # [ 1.055332] ACPI: \_SB_.GSIF: Enabled at IRQ 211761worker2 # [ 1.066928] ACPI: \_SB_.GSIF: Enabled at IRQ 211762worker1 # [ 1.069108] fuse: init (API version 7.45)1763client # [ 1.077914] systemd[1]: Successfully made /usr/ read-only.1764worker1 # [ 1.075252] ACPI: \_SB_.GSIG: Enabled at IRQ 221765worker1 # [ 1.078428] ACPI: \_SB_.GSIH: Enabled at IRQ 231766worker1 # [ 1.081942] ACPI: \_SB_.GSIE: Enabled at IRQ 201767worker2 # [ 1.091647] systemd[1]: Successfully made /usr/ read-only.1768lb # [ 1.081472] systemd[1]: Successfully made /usr/ read-only.1769worker1 # [ 1.084417] ACPI: \_SB_.GSIF: Enabled at IRQ 211770worker1 # [ 1.113550] systemd[1]: Successfully made /usr/ read-only.1771client # [ 1.414283] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772client # [ 1.420144] systemd[1]: Detected virtualization kvm.1773client # [ 1.421265] systemd[1]: Detected architecture x86-64.1774client # [ 1.422472] systemd[1]: Running in initrd.1775client # [ 1.423874] systemd[1]: Initializing machine ID from random generator.1776client # [ 1.425409] systemd[1]: Hostname set to <client>.1777worker2 # [ 1.427320] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778lb # [ 1.417134] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1779worker2 # [ 1.432801] systemd[1]: Detected virtualization kvm.1780lb # [ 1.422908] systemd[1]: Detected virtualization kvm.1781worker2 # [ 1.433769] systemd[1]: Detected architecture x86-64.1782worker2 # [ 1.434729] systemd[1]: Running in initrd.1783lb # [ 1.423983] systemd[1]: Detected architecture x86-64.1784lb # [ 1.425079] systemd[1]: Running in initrd.1785worker2 # [ 1.436010] systemd[1]: Initializing machine ID from random generator.1786worker2 # [ 1.437348] systemd[1]: Hostname set to <worker2>.1787lb # [ 1.426512] systemd[1]: Initializing machine ID from random generator.1788lb # [ 1.428094] systemd[1]: Hostname set to <lb>.1789worker1 # [ 1.450429] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker1 # [ 1.463473] systemd[1]: Detected virtualization kvm.1791worker1 # [ 1.465756] systemd[1]: Detected architecture x86-64.1792worker1 # [ 1.467940] systemd[1]: Running in initrd.1793worker1 # [ 1.470614] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.473963] systemd[1]: Hostname set to <worker1>.1795client # [ 1.535735] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796client # [ 1.575030] systemd[1]: Queued start job for default target Initrd Default Target.1797client # [ 1.578719] systemd[1]: Created slice Slice /system/modprobe.1798client # [ 1.579868] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1799client # [ 1.581324] systemd[1]: Expecting device /dev/disk/by-label/nixos...1800client # [ 1.582514] systemd[1]: Reached target Path Units.1801client # [ 1.583401] systemd[1]: Reached target Slice Units.1802client # [ 1.584285] systemd[1]: Reached target Swaps.1803client # [ 1.585099] systemd[1]: Reached target Timer Units.1804client # [ 1.586096] systemd[1]: Listening on D-Bus System Message Bus Socket.1805client # [ 1.587391] systemd[1]: Listening on Journal Socket (/dev/log).1806client # [ 1.588592] systemd[1]: Listening on Journal Sockets.1807client # [ 1.589622] systemd[1]: Listening on udev Control Socket.1808client # [ 1.590645] systemd[1]: Listening on udev Kernel Socket.1809client # [ 1.591623] systemd[1]: Reached target Socket Units.1810worker1 # [ 1.583520] systemd[1]: bpf-restrict-fs: LSM BPF program attached1811client # [ 1.593488] systemd[1]: Starting Create List of Static Device Nodes...1812client # [ 1.597237] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1813client # [ 1.606555] systemd[1]: Starting Load Kernel Module configfs...1814client # [ 1.621556] systemd[1]: Starting Journal Service...1815worker1 # [ 1.623475] systemd[1]: Queued start job for default target Initrd Default Target.1816client # [ 1.634466] systemd[1]: Starting Load Kernel Modules...1817worker1 # [ 1.627933] systemd[1]: Created slice Slice /system/modprobe.1818worker1 # [ 1.629119] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1819worker1 # [ 1.630623] systemd[1]: Expecting device /dev/disk/by-label/nixos...1820worker1 # [ 1.631814] systemd[1]: Reached target Path Units.1821worker1 # [ 1.632695] systemd[1]: Reached target Slice Units.1822worker1 # [ 1.633695] systemd[1]: Reached target Swaps.1823worker1 # [ 1.634549] systemd[1]: Reached target Timer Units.1824worker1 # [ 1.635595] systemd[1]: Listening on D-Bus System Message Bus Socket.1825worker1 # [ 1.636859] systemd[1]: Listening on Journal Socket (/dev/log).1826worker1 # [ 1.638090] systemd[1]: Listening on Journal Sockets.1827worker1 # [ 1.639121] systemd[1]: Listening on udev Control Socket.1828worker1 # [ 1.640201] systemd[1]: Listening on udev Kernel Socket.1829worker2 # [ 1.649266] systemd[1]: bpf-restrict-fs: LSM BPF program attached1830worker1 # [ 1.641182] systemd[1]: Reached target Socket Units.1831client # [ 1.639495] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1832worker1 # [ 1.643266] systemd[1]: Starting Create List of Static Device Nodes...1833client # [ 1.657819] netfs: FS-Cache loaded1834worker1 # [ 1.648596] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1835client # [ 1.662777] 9pnet: Installing 9P2000 support1836worker1 # [ 1.654285] systemd[1]: Starting Load Kernel Module configfs...1837client # [ 1.674241] systemd[1]: Starting Coldplug All udev Devices...1838lb # [ 1.662820] systemd[1]: bpf-restrict-fs: LSM BPF program attached1839worker1 # [ 1.669835] systemd[1]: Starting Journal Service...1840worker2 # [ 1.688336] systemd[1]: Queued start job for default target Initrd Default Target.1841client # [ 1.689783] systemd[1]: Finished Create List of Static Device Nodes.1842worker2 # [ 1.692221] systemd[1]: Created slice Slice /system/modprobe.1843worker1 # [ 1.683422] systemd[1]: Starting Load Kernel Modules...1844worker2 # [ 1.693423] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1845worker2 # [ 1.694869] systemd[1]: Expecting device /dev/disk/by-label/nixos...1846client # [ 1.695049] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1847worker2 # [ 1.696020] systemd[1]: Reached target Path Units.1848worker2 # [ 1.696905] systemd[1]: Reached target Slice Units.1849worker2 # [ 1.697797] systemd[1]: Reached target Swaps.1850worker2 # [ 1.698629] systemd[1]: Reached target Timer Units.1851worker2 # [ 1.699626] systemd[1]: Listening on D-Bus System Message Bus Socket.1852worker2 # [ 1.700895] systemd[1]: Listening on Journal Socket (/dev/log).1853worker2 # [ 1.702026] systemd[1]: Listening on Journal Sockets.1854worker2 # [ 1.703053] systemd[1]: Listening on udev Control Socket.1855client # [ 1.703437] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1856worker2 # [ 1.704079] systemd[1]: Listening on udev Kernel Socket.1857worker2 # [ 1.705035] systemd[1]: Reached target Socket Units.1858worker2 # [ 1.706980] systemd[1]: Starting Create List of Static Device Nodes...1859client # [ 1.709537] systemd-journald[67]: Collecting audit messages is disabled.1860worker1 # [ 1.689667] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1861client # [ 1.711509] systemd[1]: modprobe@configfs.service: Deactivated successfully.1862worker2 # [ 1.712949] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1863worker1 # [ 1.707951] netfs: FS-Cache loaded1864client # [ 1.718687] systemd[1]: Finished Load Kernel Module configfs.1865worker2 # [ 1.719071] systemd[1]: Starting Load Kernel Module configfs...1866worker1 # [ 1.713657] 9pnet: Installing 9P2000 support1867client # [ 1.721859] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1868client # [ 1.724485] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1869lb # [ 1.716324] systemd[1]: Queued start job for default target Initrd Default Target.1870lb # [ 1.721062] systemd[1]: Created slice Slice /system/modprobe.1871lb # [ 1.722345] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1872worker2 # [ 1.733954] systemd[1]: Starting Journal Service...1873client # [ 1.733407] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1874lb # [ 1.723778] systemd[1]: Expecting device /dev/disk/by-label/nixos...1875lb # [ 1.724919] systemd[1]: Reached target Path Units.1876lb # [ 1.725793] systemd[1]: Reached target Slice Units.1877lb # [ 1.726685] systemd[1]: Reached target Swaps.1878client # [ 1.736670] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1879lb # [ 1.727521] systemd[1]: Reached target Timer Units.1880lb # [ 1.728504] systemd[1]: Listening on D-Bus System Message Bus Socket.1881lb # [ 1.729743] systemd[1]: Listening on Journal Socket (/dev/log).1882worker1 # [ 1.731623] systemd[1]: Starting Coldplug All udev Devices...1883lb # [ 1.730872] systemd[1]: Listening on Journal Sockets.1884lb # [ 1.731824] systemd[1]: Listening on udev Control Socket.1885lb # [ 1.732789] systemd[1]: Listening on udev Kernel Socket.1886lb # [ 1.733704] systemd[1]: Reached target Socket Units.1887lb # [ 1.735592] systemd[1]: Starting Create List of Static Device Nodes...1888worker2 # [ 1.748960] systemd[1]: Starting Load Kernel Modules...1889lb # [ 1.739567] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1890worker1 # [ 1.745022] systemd-journald[67]: Collecting audit messages is disabled.1891worker1 # [ 1.747602] systemd[1]: Finished Create List of Static Device Nodes.1892lb # [ 1.748846] systemd[1]: Starting Load Kernel Module configfs...1893worker1 # [ 1.752456] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1894worker2 # [ 1.755961] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1895client # [ 1.767980] systemd[1]: Finished Load Kernel Modules.1896worker1 # [ 1.759025] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1897worker2 # [ 1.771498] netfs: FS-Cache loaded1898worker1 # [ 1.763884] systemd[1]: modprobe@configfs.service: Deactivated successfully.1899lb # [ 1.764890] systemd[1]: Starting Journal Service...1900client # [ 1.775606] systemd[1]: Starting Apply Kernel Variables...1901worker2 # [ 1.776574] 9pnet: Installing 9P2000 support1902worker1 # [ 1.771901] systemd[1]: Finished Load Kernel Module configfs.1903lb # [ 1.776137] systemd[1]: Starting Load Kernel Modules...1904worker1 # [ 1.777992] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1905client # [ 1.787510] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1906worker2 # [ 1.788980] systemd[1]: Starting Coldplug All udev Devices...1907worker1 # [ 1.782752] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1908worker1 # [ 1.788747] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1909worker1 # [ 1.791555] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1910client # [ 1.801608] systemd[1]: Starting Create Static Device Nodes in /dev...1911worker2 # [ 1.804950] systemd[1]: Finished Create List of Static Device Nodes.1912lb # [ 1.782757] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1913lb # [ 1.799412] netfs: FS-Cache loaded1914worker2 # [ 1.810566] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1915lb # [ 1.804640] 9pnet: Installing 9P2000 support1916worker2 # [ 1.819356] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1917client # [ 1.820468] systemd[1]: Finished Apply Kernel Variables.1918worker2 # [ 1.823583] systemd-journald[67]: Collecting audit messages is disabled.1919worker2 # [ 1.826335] systemd[1]: modprobe@configfs.service: Deactivated successfully.1920lb # [ 1.821548] systemd[1]: Starting Coldplug All udev Devices...1921worker1 # [ 1.824160] systemd[1]: Finished Load Kernel Modules.1922worker2 # [ 1.833269] systemd[1]: Finished Load Kernel Module configfs.1923client # [ 1.698482] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.834605] systemd[1]: Started Journal Service.1924client # 1925client # [ 1.703379] systemd-modules-load[68]: Inserted module 'virtio_balloon'1926client # [ 1.704426] systemd-modules-load[68]: Inserted module 'virtio_gpu'1927worker2 # [ 1.838470] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1928worker1 # [ 1.832720] systemd[1]: Starting Apply Kernel Variables...1929worker2 # [ 1.843052] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1930client # [ 1.713933] systemd[1]: Finished Create Static Device Nodes in /dev.1931lb # [ 1.838128] systemd[1]: Finished Create List of Static Device Nodes.1932worker1 # [ 1.841685] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1933client # [ 1.717081] systemd[1]: Reached target Preparation for Local File Systems.1934worker2 # [ 1.851122] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1935client # [ 1.718137] systemd[1]: Reached target Local File Systems.1936worker2 # [ 1.852682] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1937lb # [ 1.843399] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1938client # [ 1.720751] systemd[1]: Starting Create System Files and Directories...1939lb # [ 1.846812] systemd-journald[67]: Collecting audit messages is disabled.1940lb # [ 1.851103] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1941worker1 # [ 1.853045] systemd[1]: Starting Create Static Device Nodes in /dev...1942client # [ 1.728071] systemd[1]: Starting Rule-based Manager for Device Events and Files...1943lb # [ 1.858117] systemd[1]: modprobe@configfs.service: Deactivated successfully.1944lb # [ 1.863117] systemd[1]: Finished Load Kernel Module configfs.1945worker1 # [ 1.732826] systemd-modules-load[68]: Inserted module 'dm_mod'1946worker1 # [ 1.735175] systemd-modules-load[68]: Inserted module 'virtio_balloon'1947worker1 # [ 1.736254] systemd-modules-load[68]: Inserted module 'virtio_gpu'1948worker1 # [ 1.869944] systemd[1]: Started Journal Service.1949lb # [ 1.868206] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1950lb # [ 1.872644] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1951worker2 # [ 1.887468] systemd[1]: Finished Load Kernel Modules.1952client # [ 1.754219] systemd[1]: Finished Create System Files and Directories.1953worker1 # [ 1.747329] systemd[1]: Finished Apply Kernel Variables.1954lb # [ 1.881690] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1955lb # [ 1.883423] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1956worker2 # [ 1.895104] systemd[1]: Starting Apply Kernel Variables...1957worker1 # [ 1.762218] systemd[1]: Finished Create Static Device Nodes in /dev.1958worker2 # [ 1.906034] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1959worker1 # [ 1.765072] systemd[1]: Reached target Preparation for Local File Systems.1960worker1 # [ 1.765980] systemd[1]: Reached target Local File Systems.1961worker1 # [ 1.769063] systemd[1]: Starting Create System Files and Directories...1962worker1 # [ 1.772358] systemd[1]: Starting Rule-based Manager for Device Events and Files...1963client # [ 1.781398] systemd-udevd[83]: Using default interface naming scheme 'v261'.1964worker2 # [ 1.917383] systemd[1]: Starting Create Static Device Nodes in /dev...1965lb # [ 1.916326] systemd[1]: Finished Load Kernel Modules.1966lb # [ 1.925924] systemd[1]: Starting Apply Kernel Variables...1967worker2 # [ 1.940539] systemd[1]: Finished Apply Kernel Variables.1968client # [ 1.808088] systemd[1]: Started Rule-based Manager for Device Events and Files.1969worker1 # [ 1.804450] systemd[1]: Finished Create System Files and Directories.1970worker2 # [ 1.816287] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.950247] systemd[1]: Started Journal Service.1971worker2 # 1972worker2 # [ 1.819312] systemd-modules-load[68]: Inserted module 'virtio_balloon'1973worker2 # [ 1.821307] systemd-modules-load[68]: Inserted module 'virtio_gpu'1974lb # [ 1.942991] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1975worker2 # [ 1.828139] systemd[1]: Finished Create Static Device Nodes in /dev.1976lb # [ 1.953994] systemd[1]: Starting Create Static Device Nodes in /dev...1977worker2 # [ 1.832935] systemd[1]: Reached target Preparation for Local File Systems.1978worker1 # [ 1.825295] systemd-udevd[83]: Using default interface naming scheme 'v261'.1979worker2 # [ 1.836064] systemd[1]: Reached target Local File Systems.1980worker2 # [ 1.839102] systemd[1]: Starting Create System Files and Directories...1981worker2 # [ 1.843960] systemd[1]: Starting Rule-based Manager for Device Events and Files...1982lb # [ 1.968787] systemd[1]: Finished Apply Kernel Variables.1983lb # [ 1.838479] systemd-modules-load[68]: Inserted module 'dm_mod'1984lb # [ 1.841632] systemd-modules-load[68]: Inserted module 'virtio_balloon'1985lb # [ 1.842720] systemd-modules-load[68]: Inserted module 'virtio_gpu'1986client # [ 1.852141] systemd[1]: Finished Coldplug All udev Devices.1987lb # [ 1.976527] systemd[1]: Started Journal Service.1988client # [ 1.854120] systemd[1]: Reached target System Initialization.1989client # [ 1.855121] systemd[1]: Reached target Basic System.1990worker1 # [ 1.850370] systemd[1]: Started Rule-based Manager for Device Events and Files.1991lb # [ 1.867173] systemd[1]: Finished Create Static Device Nodes in /dev.1992lb # [ 1.868320] systemd[1]: Reached target Preparation for Local File Systems.1993worker2 # [ 1.878732] systemd[1]: Finished Create System Files and Directories.1994lb # [ 1.869307] systemd[1]: Reached target Local File Systems.1995lb # [ 1.871574] systemd[1]: Starting Create System Files and Directories...1996lb # [ 1.876544] systemd[1]: Starting Rule-based Manager for Device Events and Files...1997worker2 # [ 1.900805] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998worker1 # [ 1.906358] systemd[1]: Finished Coldplug All udev Devices.1999worker1 # [ 1.907728] systemd[1]: Reached target System Initialization.2000worker1 # [ 1.908944] systemd[1]: Reached target Basic System.
loading 1,904 hidden lines…
3905client # [ 11.738765] systemd[1]: Reached target Login Prompts.3906worker1 # [ 11.948701] dhcpcd[695]: eth0: soliciting an IPv6 router3907worker1 # [ 11.950357] dhcpcd[695]: eth0: Router Advertisement from fe80::23908worker1 # [ 11.951202] dhcpcd[695]: eth0: adding address fec0::5054:ff:fe12:3456/643909worker1 # [ 11.952069] dhcpcd[695]: eth0: adding route to fec0::/643910worker1 # [ 11.952825] dhcpcd[695]: eth0: adding default route via fe80::23911client # [ 12.216324] dhcpcd[569]: eth0: soliciting a DHCP lease3912client # [ 12.363463] NET: Registered PF_PACKET protocol family3913client # [ 12.233438] dhcpcd[569]: eth0: offered 10.0.2.15 from 10.0.2.23914client # [ 12.236163] dhcpcd[569]: eth0: probing address 10.0.2.15/243915lb # [ 12.275956] dhcpcd[771]: eth0: soliciting a DHCP lease3916lb # [ 12.426186] NET: Registered PF_PACKET protocol family3917lb # [ 12.297485] dhcpcd[771]: eth0: offered 10.0.2.15 from 10.0.2.23918lb # [ 12.300140] dhcpcd[771]: eth0: probing address 10.0.2.15/243919client # [ 12.441568] dhcpcd[569]: eth0: soliciting an IPv6 router3920client # [ 12.443210] dhcpcd[569]: eth0: Router Advertisement from fe80::23921client # [ 12.444035] dhcpcd[569]: eth0: adding address fec0::5054:ff:fe12:3456/643922client # [ 12.444855] dhcpcd[569]: eth0: adding route to fec0::/643923client # [ 12.445653] dhcpcd[569]: eth0: adding default route via fe80::23924lb # [ 12.564435] dhcpcd[771]: eth0: soliciting an IPv6 router3925lb # [ 12.565657] dhcpcd[771]: eth0: Router Advertisement from fe80::23926lb # [ 12.567109] dhcpcd[771]: eth0: adding address fec0::5054:ff:fe12:3456/643927lb # [ 12.567945] dhcpcd[771]: eth0: adding route to fec0::/643928lb # [ 12.568707] dhcpcd[771]: eth0: adding default route via fe80::23929worker2 # [ 12.683628] dhcpcd[751]: eth0: soliciting a DHCP lease3930worker2 # [ 12.843310] NET: Registered PF_PACKET protocol family3931worker2 # [ 12.718210] dhcpcd[751]: eth0: offered 10.0.2.15 from 10.0.2.23932worker2 # [ 12.722467] dhcpcd[751]: eth0: probing address 10.0.2.15/243933lb # [ 12.739923] postgresql-pre-start[793]: selecting default time zone ... UTC3934lb # [ 12.744849] postgresql-pre-start[793]: creating configuration files ... ok3935lb # [ 12.988059] postgresql-pre-start[793]: running bootstrap script ... ok3936lb # [ 13.543094] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok3937lb # [ 13.667307] postgresql-pre-start[793]: syncing data to disk ... ok3938lb # [ 13.669091] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections3939lb # [ 13.670280] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3940lb # [ 13.672084] postgresql-pre-start[793]: Success. You can now start the database server using:3941lb # [ 13.673089] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3942worker2 # [ 13.746760] dhcpcd[751]: eth0: soliciting an IPv6 router3943worker2 # [ 13.749654] dhcpcd[751]: eth0: Router Advertisement from fe80::23944worker2 # [ 13.751951] dhcpcd[751]: eth0: adding address fec0::5054:ff:fe12:3456/643945worker2 # [ 13.754353] dhcpcd[751]: eth0: adding route to fec0::/643946worker2 # [ 13.756209] dhcpcd[751]: eth0: adding default route via fe80::23947lb # [ 13.767400] postgres[861]: [861] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3948lb # [ 13.771836] postgres[861]: [861] LOG: listening on IPv6 address "::1", port 54323949lb # [ 13.772872] postgres[861]: [861] LOG: listening on IPv4 address "127.0.0.1", port 54323950lb # [ 13.775869] postgres[861]: [861] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3951lb # [ 13.791590] postgres[873]: [873] LOG: database system was shut down at 2026-09-20 08:15:35 GMT3952lb # [ 13.796576] postgres[861]: [861] LOG: database system is ready to accept connections3953lb # [ 13.802902] systemd[1]: Started PostgreSQL Server.3954lb # [ 13.812564] systemd[1]: Starting PostgreSQL Setup Scripts...3955lb # [ 14.034483] postgresql-setup-start[891]: CREATE DATABASE3956lb # [ 14.077593] postgresql-setup-start[896]: CREATE ROLE3957lb # [ 14.095377] postgresql-setup-start[898]: ALTER DATABASE3958lb # [ 14.100920] systemd[1]: Finished PostgreSQL Setup Scripts.3959lb # [ 14.102791] systemd[1]: Reached target PostgreSQL.3960worker1 # [ 16.391660] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds3961worker1 # [ 16.392910] dhcpcd[695]: eth0: adding route to 10.0.2.0/243962worker1 # [ 16.393770] dhcpcd[695]: eth0: adding default route via 10.0.2.23963worker1 # [ 16.518564] systemd[1]: Started DHCP Client.3964worker1 # [ 16.520699] systemd[1]: Reached target Multi-User System.3965worker1 # [ 16.521882] systemd[1]: Startup finished in 912ms (kernel) + 4.004s (initrd) + 11.605s (userspace) = 16.521s.3966lb # [ 17.253367] dhcpcd[771]: eth0: leased 10.0.2.15 for 86400 seconds3967lb # [ 17.254706] dhcpcd[771]: eth0: adding route to 10.0.2.0/243968lb # [ 17.257088] dhcpcd[771]: eth0: adding default route via 10.0.2.23969lb # [ 17.372853] systemd[1]: Started DHCP Client.3970lb # [ 17.374707] systemd[1]: Reached target Network is Online.3971lb # [ 17.379125] systemd[1]: Started Envoy reverse proxy.3972lb # [ 17.383431] systemd[1]: Started mock-oidc.service.3973lb # [ 17.467287] mock-oidc-server[990]: Mock OIDC Server running3974lb # [ 17.468260] mock-oidc-server[990]: OIDC Address: 192.168.1.2:80803975lb # [ 17.469456] mock-oidc-server[990]: Issue Address: 0.0.0.0:80813976lb # [ 17.470351] mock-oidc-server[990]: Issuer: http://192.168.1.2:8080/oidc3977lb # [ 17.471315] mock-oidc-server[990]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3978lb # [ 17.472690] mock-oidc-server[990]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3979lb # [ 17.474672] mock-oidc-server[990]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3980client # [ 17.553684] dhcpcd[569]: eth0: leased 10.0.2.15 for 86400 seconds3981client # [ 17.556443] dhcpcd[569]: eth0: adding route to 10.0.2.0/243982client # [ 17.558876] dhcpcd[569]: eth0: adding default route via 10.0.2.23983client # [ 17.673778] systemd[1]: Started DHCP Client.3984client # [ 17.675840] systemd[1]: Reached target Multi-User System.3985client # [ 17.676743] systemd[1]: Startup finished in 877ms (kernel) + 4.796s (initrd) + 12.003s (userspace) = 17.676s.3986lb # [ 17.872599] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3987lb # [ 17.874343] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:469] statically linked extensions:3988lb # [ 17.875680] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3989lb # [ 17.878448] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3990lb # [ 17.891992] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3991lb # [ 17.898216] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3992lb # [ 17.903710] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3993lb # [ 17.906178] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3994lb # [ 17.908969] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3995worker2 # [ 17.920781] dhcpcd[751]: eth0: leased 10.0.2.15 for 86400 seconds3996worker2 # [ 17.921921] dhcpcd[751]: eth0: adding route to 10.0.2.0/243997worker2 # [ 17.922757] dhcpcd[751]: eth0: adding default route via 10.0.2.23998lb # [ 17.911317] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3999lb # [ 17.913337] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4000lb # [ 17.915298] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4001lb # [ 17.917480] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4002lb # [ 17.919315] envoy[989]: [2026-09-20 08:15:39.529][989][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4003lb # [ 17.923728] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4004lb # [ 17.927507] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4005lb # [ 17.929143] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14006lb # [ 17.931276] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4007lb # [ 17.933273] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4008lb # [ 17.935653] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4009lb # [ 17.947191] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4010lb # [ 17.949592] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4011lb # [ 17.951259] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4012lb # [ 17.952927] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4013lb # [ 17.954808] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4014lb # [ 17.957639] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4015lb # [ 17.959437] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4016lb # [ 17.960911] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4017lb # [ 17.963456] envoy[989]: [2026-09-20 08:15:39.535][989][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4018lb # [ 17.965183] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4019lb # [ 17.971159] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4020lb # [ 17.973537] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24021lb # [ 17.975609] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4022lb # [ 17.977945] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4023lb # [ 17.980576] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4024lb # [ 17.982950] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4025lb # [ 17.990361] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4026lb # [ 17.992220] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4027lb # [ 17.993723] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4028lb # [ 17.995404] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4029lb # [ 17.997071] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4030lb # [ 17.998725] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4031lb # [ 18.000153] envoy[989]: [2026-09-20 08:15:39.542][989][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24032lb # [ 18.001831] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4033lb # [ 18.003765] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4034lb # [ 18.005438] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4035lb # [ 18.006981] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4036lb # [ 18.008688] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4037lb # [ 18.013495] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4038lb # [ 18.015273] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4039lb # [ 18.017395] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4040lb # [ 18.019381] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4041lb # [ 18.021300] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4042lb # [ 18.024260] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4043lb # [ 18.025937] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4044lb # [ 18.031727] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24045lb # [ 18.033356] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4046worker2 # [ 18.046467] systemd[1]: Started DHCP Client.4047lb # [ 18.035136] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4048worker2 # [ 18.048283] systemd[1]: Reached target Multi-User System.4049lb # [ 18.037046] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4050worker2 # [ 18.049248] systemd[1]: Startup finished in 896ms (kernel) + 4.968s (initrd) + 12.183s (userspace) = 18.048s.4051lb # [ 18.040066] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4052lb # [ 18.041837] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4053lb # [ 18.067497] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4054lb # [ 18.069204] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4055lb # [ 18.071408] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84056lb # [ 18.073207] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4057lb # [ 18.075845] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4058lb # [ 18.078129] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4059lb # [ 18.084186] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4060lb # [ 18.085965] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4061lb # [ 18.088391] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4062lb # [ 18.090840] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4063lb # [ 18.093339] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4064lb # [ 18.097195] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4065lb # [ 18.101605] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4066lb # [ 18.104185] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4067lb # [ 18.108067] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4068lb # [ 18.110232] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4069lb # [ 18.112346] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4070lb # [ 18.115175] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4071lb # [ 18.117830] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4072lb # [ 18.126625] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4073lb # [ 18.129510] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4074lb # [ 18.134719] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4075lb # [ 18.136649] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4076lb # [ 18.139916] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4077lb # [ 18.142559] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4078lb # [ 18.146703] envoy[989]: [2026-09-20 08:15:39.543][989][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4079lb # [ 18.149987] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4080lb # [ 18.152327] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4081lb # [ 18.155200] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4082lb # [ 18.157156] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4083lb # [ 18.159161] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4084lb # [ 18.161141] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4085lb # [ 18.163314] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4086lb # [ 18.165807] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4087lb # [ 18.167551] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4088lb # [ 18.170905] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4089lb # [ 18.173588] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4090lb # [ 18.176158] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4091lb # [ 18.178877] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4092lb # [ 18.180606] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4093lb # [ 18.182451] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4094lb # [ 18.185354] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4095lb # [ 18.187259] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4096lb # [ 18.191208] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4097lb # [ 18.193211] envoy[989]: [2026-09-20 08:15:39.544][989][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4098lb # [ 18.196151] envoy[989]: [2026-09-20 08:15:39.678][989][info][main] [source/server/server.cc:531] HTTP header map info:4099lb # [ 18.197522] envoy[989]: [2026-09-20 08:15:39.748][989][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4100lb # [ 18.210349] envoy[989]: [2026-09-20 08:15:39.748][989][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4101lb # [ 18.211737] envoy[989]: [2026-09-20 08:15:39.748][989][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4102lb # [ 18.219395] envoy[989]: [2026-09-20 08:15:39.748][989][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4103lb # [ 18.260829] envoy[989]: [2026-09-20 08:15:39.918][989][info][main] [source/server/server.cc:968] runtime: {}4104lb # [ 18.266452] envoy[989]: [2026-09-20 08:15:39.923][989][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4105lb # [ 18.268623] envoy[989]: [2026-09-20 08:15:39.925][989][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014106lb # [ 18.271385] envoy[989]: [2026-09-20 08:15:39.928][989][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014107lb # [ 18.274272] envoy[989]: [2026-09-20 08:15:39.931][989][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4108lb # [ 18.275854] envoy[989]: [2026-09-20 08:15:39.933][989][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4109lb # [ 18.277428] envoy[989]: [2026-09-20 08:15:39.933][989][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4110lb # [ 18.319370] envoy[989]: [2026-09-20 08:15:39.976][989][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4111worker2 # [ 18.336784] systemd[1]: Starting Nix worker-protocol over gRPC...4112worker1 # [ 18.328486] systemd[1]: Starting Nix worker-protocol over gRPC...4113lb # [ 18.335773] envoy[989]: [2026-09-20 08:15:39.993][989][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4114lb # [ 18.338034] envoy[989]: [2026-09-20 08:15:39.995][989][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4115lb # [ 18.340923] envoy[989]: [2026-09-20 08:15:39.995][989][info][main] [source/server/server.cc:1077] starting main dispatch loop4116worker2 # [ 18.520926] nix-grpc-daemon[853]: ts=2026-09-20T08:15:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4117worker1 # [ 18.518069] nix-grpc-daemon[787]: ts=2026-09-20T08:15:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4118worker2 # [ 18.533844] nix-grpc-daemon[853]: ts=2026-09-20T08:15:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14119worker1 # [ 18.528675] nix-grpc-daemon[787]: ts=2026-09-20T08:15:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14120worker2 # [ 18.572483] nix-grpc-daemon[853]: ts=2026-09-20T08:15:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4121worker1 # [ 18.563582] nix-grpc-daemon[787]: ts=2026-09-20T08:15:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4122worker1 # [ 18.567579] systemd[1]: Started Nix worker-protocol over gRPC.4123worker2 # [ 18.576415] systemd[1]: Started Nix worker-protocol over gRPC.4124lb # [ 18.610589] envoy[989]: [2026-09-20 08:15:40.267][989][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4125lb # [ 18.612572] envoy[989]: [2026-09-20 08:15:40.267][989][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4126lb # [ 18.614170] envoy[989]: [2026-09-20 08:15:40.267][989][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4127lb # [ 18.615790] envoy[989]: [2026-09-20 08:15:40.267][989][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4128worker2 # [ 18.639795] nix-grpc-daemon[853]: ts=2026-09-20T08:15:40Z level=info event=scheduler_connected addr=lb:500514129worker1 # [ 18.633386] nix-grpc-daemon[787]: ts=2026-09-20T08:15:40Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 18.648269] nix-grpc-daemon[787]: ts=2026-09-20T08:15:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4131worker2 # [ 18.657760] nix-grpc-daemon[853]: ts=2026-09-20T08:15:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4132worker2 # [ 18.858518] nix-grpc-daemon[853]: ts=2026-09-20T08:15:40Z level=info event=scheduler_connected addr=lb:500514133worker1 # [ 18.849512] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 18.861304] nix-grpc-daemon[853]: ts=2026-09-20T08:15:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4135worker1 # [ 18.856589] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker2 # [ 19.062451] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514137worker1 # [ 19.056906] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514138worker2 # [ 19.067784] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4139worker1 # [ 19.060914] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker2 # [ 19.268286] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 19.261401] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514142worker1 # [ 19.263610] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker2 # [ 19.273129] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker1 # [ 19.464334] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514145worker2 # [ 19.473867] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514146worker1 # [ 19.466969] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4147worker2 # [ 19.476089] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 19.668902] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514149worker2 # [ 19.677829] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514150worker1 # [ 19.674815] nix-grpc-daemon[787]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4151worker2 # [ 19.683104] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 19.874772] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514153worker2 # [ 19.883863] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_connected addr=lb:500514154worker1 # [ 19.879656] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4155worker2 # [ 19.889533] nix-grpc-daemon[853]: ts=2026-09-20T08:15:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 20.080535] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514157worker2 # [ 20.089818] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514158worker1 # [ 20.083771] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4159worker2 # [ 20.092788] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker2 # [ 20.293836] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 20.285177] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514162worker2 # [ 20.298720] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4163worker1 # [ 20.290416] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker2 # [ 20.499465] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514165worker2 # [ 20.502357] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker1 # [ 20.491185] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514167worker1 # [ 20.496422] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker2 # [ 20.703856] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 20.697841] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514170worker2 # [ 20.708485] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4171worker1 # [ 20.701771] nix-grpc-daemon[787]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker2 # [ 20.908940] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 20.902398] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514174worker2 # [ 20.912313] nix-grpc-daemon[853]: ts=2026-09-20T08:15:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4175worker1 # [ 20.904579] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker2 # [ 21.113317] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 21.105241] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514178worker1 # [ 21.107975] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4179worker2 # [ 21.117088] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 21.308580] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 21.317772] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 21.311759] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4183worker2 # [ 21.321940] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker2 # [ 21.522645] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 21.512856] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514186worker2 # [ 21.525110] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4187worker1 # [ 21.518422] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker2 # [ 21.726210] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 21.720273] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514190worker2 # [ 21.729445] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4191worker1 # [ 21.722267] nix-grpc-daemon[787]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker2 # [ 21.930175] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 21.922752] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 21.924783] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4195worker2 # [ 21.934202] nix-grpc-daemon[853]: ts=2026-09-20T08:15:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 22.125457] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514197worker2 # [ 22.134829] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514198worker1 # [ 22.128413] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4199worker2 # [ 22.137359] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 22.329154] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 22.338290] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 22.331761] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4203worker2 # [ 22.340815] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 22.532414] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514205worker2 # [ 22.541450] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 22.535921] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4207worker2 # [ 22.545109] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker2 # [ 22.746074] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514209worker2 # [ 22.748343] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4210worker1 # [ 22.738074] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 22.742442] nix-grpc-daemon[787]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker2 # [ 22.949338] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 22.942576] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 22.944816] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4215worker2 # [ 22.954143] nix-grpc-daemon[853]: ts=2026-09-20T08:15:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker2 # [ 23.154404] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 23.145896] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514218worker2 # [ 23.159583] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4219worker1 # [ 23.151382] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker2 # [ 23.360218] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514221worker1 # [ 23.351950] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514222worker2 # [ 23.366269] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker1 # [ 23.357130] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker1 # [ 23.557115] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 23.567527] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 23.560253] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4227worker2 # [ 23.572426] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 23.763841] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514229worker2 # [ 23.775742] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 23.767406] nix-grpc-daemon[787]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4231worker2 # [ 23.778818] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker2 # [ 23.975814] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 23.968083] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514234worker2 # [ 23.981688] nix-grpc-daemon[853]: ts=2026-09-20T08:15:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235worker1 # [ 23.972541] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker1 # [ 24.173445] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 24.184414] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514238worker1 # [ 24.178673] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4239worker2 # [ 24.189738] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker2 # [ 24.390316] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514241worker1 # [ 24.379665] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514242worker2 # [ 24.392646] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243worker1 # [ 24.384713] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker2 # [ 24.593653] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514245worker1 # [ 24.585983] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514246worker2 # [ 24.599499] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4247worker1 # [ 24.591122] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 24.792406] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 24.801348] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 24.796932] nix-grpc-daemon[787]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4251worker2 # [ 24.806128] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker2 # [ 25.006672] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_connected addr=lb:500514253worker1 # [ 24.997887] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514254worker2 # [ 25.009443] nix-grpc-daemon[853]: ts=2026-09-20T08:15:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4255worker1 # [ 25.003206] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker2 # [ 25.210202] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514257worker1 # [ 25.203648] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514258worker2 # [ 25.216963] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4259worker1 # [ 25.208721] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker2 # [ 25.418170] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514261worker1 # [ 25.409687] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514262worker2 # [ 25.423505] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4263worker1 # [ 25.414861] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker1 # [ 25.615081] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514265worker2 # [ 25.624494] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 25.620985] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4267worker2 # [ 25.630852] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker1 # [ 25.822411] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 25.832676] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 25.825347] nix-grpc-daemon[787]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4271worker2 # [ 25.838465] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker1 # [ 26.027066] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514273worker2 # [ 26.039582] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_connected addr=lb:500514274worker1 # [ 26.033795] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4275worker2 # [ 26.044770] nix-grpc-daemon[853]: ts=2026-09-20T08:15:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker1 # [ 26.233460] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514277worker1 # [ 26.236114] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4278worker2 # [ 26.245371] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514279worker2 # [ 26.247762] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4280worker1 # [ 26.436804] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514281worker1 # [ 26.439091] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4282worker2 # [ 26.448386] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514283worker2 # [ 26.451844] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4284worker1 # [ 26.639839] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514285worker2 # [ 26.652737] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 26.645278] nix-grpc-daemon[787]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287worker2 # [ 26.657706] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4288worker1 # [ 26.849097] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514289worker2 # [ 26.861149] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_connected addr=lb:500514290worker1 # [ 26.852503] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4291worker2 # [ 26.864285] nix-grpc-daemon[853]: ts=2026-09-20T08:15:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4292worker1 # [ 27.049655] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514293worker2 # [ 27.061441] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514294worker1 # [ 27.054654] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4295worker2 # [ 27.066445] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4296worker1 # [ 27.255811] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514297worker2 # [ 27.267323] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514298worker1 # [ 27.260616] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4299worker2 # [ 27.271473] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4300worker1 # [ 27.461262] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514301worker2 # [ 27.472076] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514302worker2 # [ 27.474514] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4303worker1 # [ 27.466102] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304worker2 # [ 27.674971] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514305worker2 # [ 27.677161] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4306worker1 # [ 27.666641] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514307worker1 # [ 27.671513] nix-grpc-daemon[787]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4308worker2 # [ 27.878129] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_connected addr=lb:500514309worker2 # [ 27.883085] nix-grpc-daemon[853]: ts=2026-09-20T08:15:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4310worker1 # [ 27.873710] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514311worker1 # [ 27.877596] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4312worker2 # [ 28.083756] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514313worker2 # [ 28.085937] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4314worker1 # [ 28.077964] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514315worker1 # [ 28.079612] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4316worker1 # [ 28.280218] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514317worker2 # [ 28.286931] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514318worker1 # [ 28.283606] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4319worker2 # [ 28.292706] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4320worker1 # [ 28.484412] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514321worker2 # [ 28.493463] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514322worker1 # [ 28.487391] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4323worker2 # [ 28.499574] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4324worker1 # [ 28.688109] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514325worker2 # [ 28.699841] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514326worker1 # [ 28.690964] nix-grpc-daemon[787]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4327worker2 # [ 28.702395] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4328worker2 # [ 28.903464] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_connected addr=lb:500514329worker1 # [ 28.892972] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514330worker2 # [ 28.906325] nix-grpc-daemon[853]: ts=2026-09-20T08:15:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4331worker1 # [ 28.897690] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4332worker2 # [ 29.106975] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514333worker2 # [ 29.109291] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4334worker1 # [ 29.098926] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514335worker1 # [ 29.103584] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4336worker2 # [ 29.309691] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514337worker2 # [ 29.311836] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4338worker1 # [ 29.304599] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514339worker1 # [ 29.307646] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4340worker2 # [ 29.512479] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514341worker2 # [ 29.515225] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4342worker1 # [ 29.508165] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514343worker1 # [ 29.510178] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4344worker2 # [ 29.716204] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514345worker1 # [ 29.710870] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514346worker2 # [ 29.721114] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4347worker1 # [ 29.715256] nix-grpc-daemon[787]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4348worker2 # [ 29.922189] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_connected addr=lb:500514349worker1 # [ 29.916700] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514350worker2 # [ 29.927322] nix-grpc-daemon[853]: ts=2026-09-20T08:15:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4351worker1 # [ 29.920671] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4352worker2 # [ 30.128434] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514353worker1 # [ 30.121710] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514354worker1 # [ 30.126549] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4355worker2 # [ 30.135536] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4356worker1 # [ 30.327342] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514357worker2 # [ 30.336659] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514358worker1 # [ 30.330508] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4359worker2 # [ 30.342140] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4360worker1 # [ 30.531936] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514361worker2 # [ 30.542623] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514362worker1 # [ 30.537546] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4363worker2 # [ 30.547700] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4364worker1 # [ 30.739988] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514365worker2 # [ 30.748636] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514366worker1 # [ 30.745515] nix-grpc-daemon[787]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4367worker2 # [ 30.754635] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4368lb # [ 30.834563] rustfs-bucket-start[1118]: mb s3://farm4369lb # [ 30.840943] systemd[1]: Finished rustfs-bucket.service.4370lb # [ 30.847134] systemd[1]: Starting niks3 server...4371worker2 # [ 30.955504] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_connected addr=lb:500514372worker2 # [ 30.957659] nix-grpc-daemon[853]: ts=2026-09-20T08:15:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4373worker1 # [ 30.948913] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514374worker1 # [ 30.952819] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4375lb # [ 31.041767] postgres[1134]: [1134] ERROR: relation "goose_db_version" does not exist at character 364376lb # [ 31.042967] postgres[1134]: [1134] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4377lb # [ 31.108785] niks3-server[1127]: 2026/09/20 08:15:52 OK 20241026095416_initial_model.sql (18.41ms)4378lb # [ 31.112321] niks3-server[1127]: 2026/09/20 08:15:52 OK 20251210153512_drop_unused_gin_index.sql (3.77ms)4379lb # [ 31.117961] niks3-server[1127]: 2026/09/20 08:15:52 OK 20251218171726_add_pins.sql (4.2ms)4380lb # [ 31.122680] niks3-server[1127]: 2026/09/20 08:15:52 OK 20260628120000_add_object_size_and_stats.sql (4.76ms)4381lb # [ 31.127764] niks3-server[1127]: 2026/09/20 08:15:52 OK 20260905000000_add_claims.sql (3.7ms)4382lb # [ 31.131672] niks3-server[1127]: 2026/09/20 08:15:52 OK 20260920000000_drop_claims.sql (3.79ms)4383lb # [ 31.132830] niks3-server[1127]: 2026/09/20 08:15:52 goose: successfully migrated database to version: 202609200000004384lb # [ 31.137841] niks3-server[1127]: 2026/09/20 08:15:52 OK 1_commit_pending_closure.sql (6.24ms)4385lb # [ 31.140432] niks3-server[1127]: 2026/09/20 08:15:52 OK 2_object_stats_trigger.sql (1.39ms)4386lb # [ 31.141895] niks3-server[1127]: 2026/09/20 08:15:52 goose: up to current file version: 24387worker2 # [ 31.158051] nix-grpc-daemon[853]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514388lb # [ 31.148260] niks3-server[1127]: 2026/09/20 08:15:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4389worker2 # [ 31.160957] nix-grpc-daemon[853]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4390worker1 # [ 31.153408] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514391worker1 # [ 31.157478] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4392lb # [ 31.223684] niks3-server[1127]: 2026/09/20 08:15:52 INFO Read proxy enabled — serving cache objects from S34393lb # [ 31.225497] niks3-server[1127]: 2026/09/20 08:15:52 INFO Using socket-activated listener address=0.0.0.0:57514394lb # [ 31.230811] niks3-server[1127]: 2026/09/20 08:15:52 INFO systemd watchdog enabled interval=15s4395lb # [ 31.232074] systemd[1]: Started niks3 server.4396lb # [ 31.232743] systemd[1]: Reached target Multi-User System.4397lb # [ 31.234700] niks3-server[1127]: 2026/09/20 08:15:52 INFO Starting HTTP server address=0.0.0.0:57514398lb # [ 31.236371] systemd[1]: Startup finished in 885ms (kernel) + 4.065s (initrd) + 26.285s (userspace) = 31.236s.4399lb # [ 31.240813] niks3-server[1127]: 2026/09/20 08:15:52 INFO lead: acquired remote=192.168.1.3:438464400worker1 # [ 31.247986] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_take_over4401worker2 # [ 31.362316] nix-grpc-daemon[853]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514402worker1 # [ 31.356383] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04403worker1 # [ 31.363197] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514404worker1 # [ 31.366864] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4405worker1 # [ 31.567801] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=scheduler_connected addr=lb:500514406worker1 # [ 31.572473] nix-grpc-daemon[787]: ts=2026-09-20T08:15:53Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04407lb: (finished: waiting for unit niks3.service, in 20.64 seconds)4408lb: waiting for TCP port 5751 on localhost4409lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4410lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4411lb: waiting for unit envoy.service4412lb: (finished: waiting for unit envoy.service, in 0.04 seconds)4413lb: waiting for TCP port 50051 on localhost4414lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4415lb # [ 32.404270] envoy[989]: conn peer=[::1]:39494 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24416lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4417lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4418??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4419 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284420lb: must succeed: curl -sf localhost:9901/clusters4421lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4422lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds)4423subtest: one node schedules and both builders hold a WorkerSession on it4424lb: must succeed: curl -sf localhost:9901/clusters4425lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4426worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4427worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4428(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.09 seconds)4429subtest: balancer auth: client cert, bearer token, nothing, unknown CN4430worker2 # [ 32.933489] nix-grpc-daemon[853]: ts=2026-09-20T08:15:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456924431worker2 # [ 32.944797] systemd[1]: Started Nix Daemon.4432worker2 # [ 33.159696] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4433worker2 # [ 33.217560] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)4434worker2 # [ 33.305575] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 2/5)4435worker2 # [ 33.432872] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 3/5)4436worker2 # [ 33.603674] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 440 ms (attempt 4/5)4437worker2 # [ 34.052193] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4438worker2 # [ 34.075303] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456924439worker2 # [ 34.085200] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4440worker2 # [ 34.088870] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456924441worker2 # [ 34.092601] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4442client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4443client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4444client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4445client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4446worker2 # [ 34.408196] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=info event=oidc_jwks provider=mock keys=14447worker2 # [ 34.410732] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:456924448worker2 # [ 34.419101] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:456924449worker2 # [ 34.424195] nix-grpc-daemon[853]: ts=2026-09-20T08:15:56Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4450worker1 # [ 34.438506] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=info event=oidc_jwks provider=mock keys=14451worker1 # [ 34.440002] nix-grpc-daemon[787]: ts=2026-09-20T08:15:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:480484452worker1 # [ 34.446481] systemd[1]: Started Nix Daemon.4453worker1 # [ 34.639617] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4454worker1 # [ 34.665656] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5)4455worker1 # [ 34.683079] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 2/5)4456worker1 # [ 34.779675] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 3/5)4457worker1 # [ 34.922145] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 4/5)4458worker1 # [ 35.022384] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4459worker1 # [ 35.034425] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=debug event=path_info_miss path=knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test error="error: path '/nix/store/knc5d9v0d2ggk4vcmsnwk7zxcc5bw9nm-nixos-system-client-test' is required, but there is no substituter that can build it"4460client: must succeed: rm -r /var/lib/nix-grpc-store4461client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4462worker1 # [ 35.279200] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=info event=denied method=QueryMissing cn=- role=none4463worker2 # [ 35.488386] nix-grpc-daemon[853]: ts=2026-09-20T08:15:57Z level=info event=denied method=QueryMissing cn=stranger role=none4464(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.85 seconds)4465subtest: DAG build is scheduled across workers and lands in the cache4466client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24467worker2 # [ 35.737658] nix-grpc-daemon[853]: ts=2026-09-20T08:15:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456924468client # don't know how to build these paths:4469client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4470worker1 # [ 35.761780] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04471worker1 # [ 35.765535] nix-grpc-daemon[787]: ts=2026-09-20T08:15:57Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14472worker2 # [ 35.820378] nix-grpc-daemon[853]: ts=2026-09-20T08:15:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924473worker2 # [ 35.843236] nix-grpc-daemon[853]: ts=2026-09-20T08:15:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924474client # copying 1 paths to 'lb:50051'...4475worker2 # [ 35.857302] nix-grpc-daemon[853]: ts=2026-09-20T08:15:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456924476client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4477worker2 # [ 35.883422] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4478worker2 # [ 35.916682] nix-grpc-daemon[853]: ts=2026-09-20T08:15:57Z level=info event=niks3_push_started pid=9214479worker2 # [ 36.396203] nix-daemon[911]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4480worker2 # [ 36.412941] nix-daemon[911]: reaped child process 936, status = succeeded4481worker2 # [ 36.571934] nix-daemon[911]: accepted connection from pid 938, user nix-grpc-daemon (trusted)4482worker2 # [ 36.584870] nix-daemon[911]: reaped child process 941, status = succeeded4483lb # [ 36.585571] niks3-server[1127]: 2026/09/20 08:15:58 INFO Received uploads request method=POST path=/api/pending_closures4484worker2 # [ 36.623595] nix-grpc-daemon[921]: time=2026-09-20T08:15:58.570Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4485worker2 # [ 36.626383] nix-grpc-daemon[921]: time=2026-09-20T08:15:58.573Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4486lb # [ 36.658994] niks3-server[1127]: 2026/09/20 08:15:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4487lb # [ 36.663890] niks3-server[1127]: 2026/09/20 08:15:58 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4488lb # [ 36.674940] niks3-server[1127]: 2026/09/20 08:15:58 INFO Signed narinfos id=1 count=14489worker2 # [ 36.687607] nix-grpc-daemon[921]: time=2026-09-20T08:15:58.635Z level=INFO msg="Uploading 1 narinfos"4490lb # [ 36.686228] niks3-server[1127]: 2026/09/20 08:15:58 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4491lb # [ 36.688272] niks3-server[1127]: 2026/09/20 08:15:58 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4492lb # [ 36.693254] niks3-server[1127]: 2026/09/20 08:15:58 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4493lb # [ 36.701737] niks3-server[1127]: 2026/09/20 08:15:58 INFO Completed upload id=14494worker2 # [ 36.715943] nix-grpc-daemon[921]: time=2026-09-20T08:15:58.661Z level=INFO msg="Upload complete. (490ms)"4495worker2 # [ 36.720073] nix-grpc-daemon[853]: ts=2026-09-20T08:15:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_in=5044496worker2 # [ 36.727995] nix-grpc-daemon[853]: ts=2026-09-20T08:15:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924497worker2 # [ 36.740461] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4498worker2 # [ 36.755127] nix-daemon[911]: reaped child process 919, status = succeeded4499client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4500client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4501worker2 # [ 36.760972] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4502client # farm-a> LOG-farm-a-t14503worker2 # [ 37.575661] nix-daemon[911]: reaped child process 945, status = succeeded4504worker2 # [ 37.708481] nix-daemon[911]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4505worker2 # [ 37.721336] nix-daemon[911]: reaped child process 964, status = succeeded4506lb # [ 37.721279] niks3-server[1127]: 2026/09/20 08:15:59 INFO Received uploads request method=POST path=/api/pending_closures4507worker2 # [ 37.741395] nix-grpc-daemon[921]: time=2026-09-20T08:15:59.689Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4508worker2 # [ 37.742895] nix-grpc-daemon[921]: time=2026-09-20T08:15:59.690Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4509lb # [ 37.774253] niks3-server[1127]: 2026/09/20 08:15:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4510worker2 # [ 37.794245] nix-grpc-daemon[921]: time=2026-09-20T08:15:59.741Z level=INFO msg="Uploading 1 narinfos"4511lb # [ 37.784078] niks3-server[1127]: 2026/09/20 08:15:59 INFO Signed narinfos id=2 count=14512lb # [ 37.789090] niks3-server[1127]: 2026/09/20 08:15:59 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4513lb # [ 37.793146] niks3-server[1127]: 2026/09/20 08:15:59 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4514lb # [ 37.799650] niks3-server[1127]: 2026/09/20 08:15:59 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4515lb # [ 37.805789] niks3-server[1127]: 2026/09/20 08:15:59 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4516lb # [ 37.811923] niks3-server[1127]: 2026/09/20 08:15:59 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4517lb # [ 37.815133] niks3-server[1127]: 2026/09/20 08:15:59 INFO Completed upload id=24518worker2 # [ 37.825974] nix-grpc-daemon[921]: time=2026-09-20T08:15:59.773Z level=INFO msg="Upload complete. (255ms)"4519worker2 # [ 37.832626] nix-grpc-daemon[853]: ts=2026-09-20T08:15:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14520worker2 # [ 37.844892] nix-daemon[911]: reaped child process 943, status = succeeded4521worker1 # [ 37.841879] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04522worker1 # [ 37.845906] nix-grpc-daemon[787]: ts=2026-09-20T08:16:00Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14523worker2 # [ 37.900878] nix-grpc-daemon[853]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924524worker2 # [ 37.914139] nix-grpc-daemon[853]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924525worker2 # [ 37.926901] nix-grpc-daemon[921]: time=2026-09-20T08:15:59.874Z level=INFO msg="All 1 paths already cached"4526client # copying 1 paths to 'lb:50051'...4527worker2 # [ 37.934832] nix-grpc-daemon[853]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456924528client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4529worker2 # [ 37.961167] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4530worker2 # [ 38.104118] nix-daemon[911]: accepted connection from pid 969, user nix-grpc-daemon (trusted)4531worker2 # [ 38.117570] nix-daemon[911]: reaped child process 972, status = succeeded4532worker2 # [ 38.267562] nix-daemon[911]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4533worker2 # [ 38.280158] nix-daemon[911]: reaped child process 977, status = succeeded4534lb # [ 38.283724] niks3-server[1127]: 2026/09/20 08:15:59 INFO Received uploads request method=POST path=/api/pending_closures4535worker2 # [ 38.307696] nix-grpc-daemon[921]: time=2026-09-20T08:16:00.255Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4536worker2 # [ 38.309696] nix-grpc-daemon[921]: time=2026-09-20T08:16:00.257Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4537lb # [ 38.316196] niks3-server[1127]: 2026/09/20 08:15:59 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4538lb # [ 38.327317] envoy[989]: conn peer=[2001:db8:1::1]:40862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=364 ms=12054539lb # [ 38.332613] envoy[989]: conn peer=[2001:db8:1::1]:40864 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2630 tx=421 ms=6584540lb # [ 38.336604] envoy[989]: conn peer=[2001:db8:1::1]:40876 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=124541worker2 # [ 38.353544] nix-grpc-daemon[921]: time=2026-09-20T08:16:00.301Z level=INFO msg="Uploading 1 narinfos"4542lb # [ 38.343230] envoy[989]: conn peer=[2001:db8:1::1]:40884 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84543lb # [ 38.346602] niks3-server[1127]: 2026/09/20 08:15:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4544lb # [ 38.349891] niks3-server[1127]: 2026/09/20 08:15:59 INFO Signed narinfos id=3 count=14545lb # [ 38.356180] niks3-server[1127]: 2026/09/20 08:16:00 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4546lb # [ 38.363156] niks3-server[1127]: 2026/09/20 08:16:00 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4547lb # [ 38.367302] niks3-server[1127]: 2026/09/20 08:16:00 INFO Completed upload id=34548worker2 # [ 38.378216] nix-grpc-daemon[921]: time=2026-09-20T08:16:00.326Z level=INFO msg="Upload complete. (403ms)"4549lb # [ 38.369271] niks3-server[1127]: 2026/09/20 08:16:00 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4550worker2 # [ 38.383144] nix-grpc-daemon[853]: ts=2026-09-20T08:16:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_in=6244551worker2 # [ 38.389336] nix-grpc-daemon[853]: ts=2026-09-20T08:16:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924552worker2 # [ 38.398075] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4553worker2 # [ 38.408107] nix-daemon[911]: reaped child process 966, status = succeeded4554client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4555client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4556worker2 # [ 38.416653] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4557client # farm-b> LOG-farm-b-t14558worker2 # [ 40.032191] nix-daemon[911]: reaped child process 981, status = succeeded4559worker2 # [ 40.178120] nix-daemon[911]: accepted connection from pid 997, user nix-grpc-daemon (trusted)4560worker2 # [ 40.191417] nix-daemon[911]: reaped child process 1000, status = succeeded4561lb # [ 40.196711] niks3-server[1127]: 2026/09/20 08:16:01 INFO Received uploads request method=POST path=/api/pending_closures4562worker2 # [ 40.218783] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.166Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4563worker2 # [ 40.220340] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.166Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4564lb # [ 40.234786] niks3-server[1127]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4565lb # [ 40.244574] niks3-server[1127]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4566lb # [ 40.251956] niks3-server[1127]: 2026/09/20 08:16:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4567lb # [ 40.257215] niks3-server[1127]: 2026/09/20 08:16:01 INFO Signed narinfos id=4 count=14568worker2 # [ 40.270462] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.218Z level=INFO msg="Uploading 1 narinfos"4569lb # [ 40.267587] niks3-server[1127]: 2026/09/20 08:16:01 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4570lb # [ 40.276697] niks3-server[1127]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4571lb # [ 40.280152] niks3-server[1127]: 2026/09/20 08:16:01 INFO Completed upload id=44572worker2 # [ 40.291031] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.239Z level=INFO msg="Upload complete. (266ms)"4573lb # [ 40.283109] niks3-server[1127]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4574worker2 # [ 40.294318] nix-grpc-daemon[853]: ts=2026-09-20T08:16:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14575worker2 # [ 40.300600] nix-daemon[911]: reaped child process 979, status = succeeded4576worker1 # [ 40.292898] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04577worker1 # [ 40.297415] nix-grpc-daemon[787]: ts=2026-09-20T08:16:02Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14578worker2 # [ 40.347968] nix-grpc-daemon[853]: ts=2026-09-20T08:16:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924579worker2 # [ 40.354591] nix-grpc-daemon[853]: ts=2026-09-20T08:16:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924580worker2 # [ 40.366602] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.314Z level=INFO msg="All 2 paths already cached"4581client # copying 1 paths to 'lb:50051'...4582client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4583worker2 # [ 40.373943] nix-grpc-daemon[853]: ts=2026-09-20T08:16:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456924584worker2 # [ 40.387134] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4585worker2 # [ 40.554413] nix-daemon[911]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4586worker2 # [ 40.567406] nix-daemon[911]: reaped child process 1007, status = succeeded4587worker2 # [ 40.728494] nix-daemon[911]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4588worker2 # [ 40.741082] nix-daemon[911]: reaped child process 1012, status = succeeded4589lb # [ 40.745282] niks3-server[1127]: 2026/09/20 08:16:02 INFO Received uploads request method=POST path=/api/pending_closures4590worker2 # [ 40.764813] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.712Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4591worker2 # [ 40.766680] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.714Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4592lb # [ 40.777137] niks3-server[1127]: 2026/09/20 08:16:02 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4593lb # [ 40.787830] niks3-server[1127]: 2026/09/20 08:16:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4594worker2 # [ 40.805412] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.753Z level=INFO msg="Uploading 1 narinfos"4595lb # [ 40.794884] niks3-server[1127]: 2026/09/20 08:16:02 INFO Signed narinfos id=5 count=14596lb # [ 40.799208] niks3-server[1127]: 2026/09/20 08:16:02 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4597lb # [ 40.809178] niks3-server[1127]: 2026/09/20 08:16:02 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4598lb # [ 40.815493] niks3-server[1127]: 2026/09/20 08:16:02 INFO Completed upload id=54599worker2 # [ 40.826121] nix-grpc-daemon[921]: time=2026-09-20T08:16:02.774Z level=INFO msg="Upload complete. (426ms)"4600lb # [ 40.819728] niks3-server[1127]: 2026/09/20 08:16:02 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4601worker2 # [ 40.830327] nix-grpc-daemon[853]: ts=2026-09-20T08:16:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_in=7524602worker2 # [ 40.834904] nix-grpc-daemon[853]: ts=2026-09-20T08:16:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924603worker2 # [ 40.845110] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4604worker2 # [ 40.849560] nix-daemon[911]: reaped child process 1002, status = succeeded4605worker2 # [ 40.854546] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4606client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4607client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4608client # farm-top> LOG-farm-top-t14609worker2 # [ 41.673784] nix-daemon[911]: reaped child process 1016, status = succeeded4610worker2 # [ 41.825669] nix-daemon[911]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4611worker2 # [ 41.838487] nix-daemon[911]: reaped child process 1034, status = succeeded4612lb # [ 41.844228] niks3-server[1127]: 2026/09/20 08:16:03 INFO Received uploads request method=POST path=/api/pending_closures4613worker2 # [ 41.871659] nix-grpc-daemon[921]: time=2026-09-20T08:16:03.819Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4614worker2 # [ 41.875227] nix-grpc-daemon[921]: time=2026-09-20T08:16:03.821Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4615lb # [ 41.889113] niks3-server[1127]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4616lb # [ 41.901334] niks3-server[1127]: 2026/09/20 08:16:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4617lb # [ 41.908732] niks3-server[1127]: 2026/09/20 08:16:03 INFO Signed narinfos id=6 count=14618worker2 # [ 41.919892] nix-grpc-daemon[921]: time=2026-09-20T08:16:03.867Z level=INFO msg="Uploading 1 narinfos"4619lb # [ 41.915084] niks3-server[1127]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4620lb # [ 41.920219] niks3-server[1127]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4621lb # [ 41.928338] niks3-server[1127]: 2026/09/20 08:16:03 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4622lb # [ 41.931577] niks3-server[1127]: 2026/09/20 08:16:03 INFO Completed upload id=64623lb # [ 41.934134] niks3-server[1127]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4624worker2 # [ 41.943817] nix-grpc-daemon[921]: time=2026-09-20T08:16:03.891Z level=INFO msg="Upload complete. (281ms)"4625worker2 # [ 41.949948] nix-grpc-daemon[853]: ts=2026-09-20T08:16:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14626worker2 # [ 41.964109] nix-daemon[911]: reaped child process 1014, status = succeeded4627client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.49 seconds)4628client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4629client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4630client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4631client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4632client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4633client # copying 3 paths...4634client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4635client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4636client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4637client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4638(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.00 seconds)4639subtest: repeat is answered Cached by the scheduler without building4640worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4641worker1 # finding garbage collector roots...4642worker1 # deleting specified paths...4643worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4644worker1 # deleting unused links...4645worker1 # note: hard linking is currently saving 0.0 KiB4646worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4647worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4648worker2 # finding garbage collector roots...4649worker2 # deleting specified paths...4650worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4651worker2 # deleting unused links...4652worker2 # note: hard linking is currently saving 0.0 KiB4653worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4654client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24655worker2 # [ 43.194507] nix-grpc-daemon[853]: ts=2026-09-20T08:16:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456924656client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4657client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4658worker1 # [ 43.202986] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14659worker1 # [ 43.208446] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14660worker1 # [ 43.215991] nix-grpc-daemon[787]: ts=2026-09-20T08:16:05Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14661client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.26 seconds)4662client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4663client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.16 seconds)4664lb: must succeed: curl -sf localhost:9901/clusters4665lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4666lb: must succeed: curl -sf localhost:9901/clusters4667lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4668worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4669worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.07 seconds)4670(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.14 seconds)4671subtest: two clients wanting the same drv build it once4672client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4673client # [ 43.698911] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4674client # Running as unit: dedup1.service; invocation ID: ea8c3642d44d4896946bc265778524834675client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4676client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4677worker1 # [ 43.875459] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:480484678client # [ 43.893297] nix[876]: don't know how to build these paths:4679client # [ 43.894163] nix[876]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4680worker1 # [ 43.891806] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04681worker1 # [ 43.897488] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14682worker1 # [ 43.903421] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:480484683worker1 # [ 43.917949] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:480484684client # [ 43.933705] nix[876]: copying 1 paths to 'lb:50051'...4685client # [ 43.934560] nix[876]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4686worker1 # [ 43.926998] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:480484687worker1 # [ 43.939654] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4688worker1 # [ 43.958417] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=niks3_push_started pid=8954689worker1 # [ 44.396892] nix-daemon[851]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4690worker1 # [ 44.413413] nix-daemon[851]: reaped child process 911, status = succeeded4691worker1 # [ 44.568085] nix-daemon[851]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4692worker1 # [ 44.582254] nix-daemon[851]: reaped child process 916, status = succeeded4693lb # [ 44.592711] niks3-server[1127]: 2026/09/20 08:16:06 INFO Received uploads request method=POST path=/api/pending_closures4694worker1 # [ 44.610822] nix-grpc-daemon[895]: time=2026-09-20T08:16:06.774Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4695worker1 # [ 44.613893] nix-grpc-daemon[895]: time=2026-09-20T08:16:06.777Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4696lb # [ 44.627771] niks3-server[1127]: 2026/09/20 08:16:06 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4697lb # [ 44.631784] niks3-server[1127]: 2026/09/20 08:16:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4698lb # [ 44.633694] niks3-server[1127]: 2026/09/20 08:16:06 INFO Signed narinfos id=7 count=14699worker1 # [ 44.637554] nix-grpc-daemon[895]: time=2026-09-20T08:16:06.802Z level=INFO msg="Uploading 1 narinfos"4700lb # [ 44.637846] niks3-server[1127]: 2026/09/20 08:16:06 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4701lb # [ 44.643166] niks3-server[1127]: 2026/09/20 08:16:06 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4702lb # [ 44.646527] niks3-server[1127]: 2026/09/20 08:16:06 INFO Completed upload id=74703worker1 # [ 44.648247] nix-grpc-daemon[895]: time=2026-09-20T08:16:06.813Z level=INFO msg="Upload complete. (424ms)"4704lb # [ 44.648307] niks3-server[1127]: 2026/09/20 08:16:06 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4705worker1 # [ 44.650884] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=0 paths=1 nar_bytes_in=4324706worker1 # [ 44.654782] nix-grpc-daemon[787]: ts=2026-09-20T08:16:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:480484707worker1 # [ 44.660852] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4708worker1 # [ 44.666382] nix-daemon[851]: reaped child process 893, status = succeeded4709worker1 # [ 44.671454] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4710client # [ 44.676870] nix[876]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4711client # [ 44.776704] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4712client # Running as unit: dedup2.service; invocation ID: 695cb051877548e4b994374a1199d08b4713client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4714worker1 # [ 45.012344] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:480484715client # [ 45.033077] nix[892]: this derivation will be built:4716worker1 # [ 45.026825] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:480484717client # [ 45.040367] nix[892]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4718worker1 # [ 45.040757] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04719client # [ 45.053602] nix[892]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4720worker1 # [ 45.045950] nix-grpc-daemon[787]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:480484721client: must succeed: sleep 24722client: (finished: must succeed: sleep 2, in 2.04 seconds)4723??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4724 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394725client: waiting for success: ! systemctl is-active dedup1 dedup24726??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4727 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394728worker1 # [ 48.305823] nix-daemon[851]: reaped child process 920, status = succeeded4729lb # [ 48.327548] envoy[989]: conn peer=[2001:db8:1::1]:40890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9329 tx=3810 ms=62974730lb # [ 48.332226] envoy[989]: conn peer=[2001:db8:1::1]:34732 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=480 ms=414731worker1 # [ 48.476590] nix-daemon[851]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4732worker1 # [ 48.489924] nix-daemon[851]: reaped child process 954, status = succeeded4733lb # [ 48.504068] niks3-server[1127]: 2026/09/20 08:16:10 INFO Received uploads request method=POST path=/api/pending_closures4734worker1 # [ 48.511032] nix-grpc-daemon[895]: time=2026-09-20T08:16:10.675Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4735worker1 # [ 48.512776] nix-grpc-daemon[895]: time=2026-09-20T08:16:10.677Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4736lb # [ 48.534805] niks3-server[1127]: 2026/09/20 08:16:10 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4737lb # [ 48.539446] niks3-server[1127]: 2026/09/20 08:16:10 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4738lb # [ 48.545807] niks3-server[1127]: 2026/09/20 08:16:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4739lb # [ 48.548165] niks3-server[1127]: 2026/09/20 08:16:10 INFO Signed narinfos id=8 count=14740worker1 # [ 48.550793] nix-grpc-daemon[895]: time=2026-09-20T08:16:10.715Z level=INFO msg="Uploading 1 narinfos"4741lb # [ 48.551658] niks3-server[1127]: 2026/09/20 08:16:10 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4742lb # [ 48.557800] niks3-server[1127]: 2026/09/20 08:16:10 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4743lb # [ 48.562951] niks3-server[1127]: 2026/09/20 08:16:10 INFO Completed upload id=84744worker1 # [ 48.564776] nix-grpc-daemon[895]: time=2026-09-20T08:16:10.729Z level=INFO msg="Upload complete. (278ms)"4745lb # [ 48.564744] niks3-server[1127]: 2026/09/20 08:16:10 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4746worker1 # [ 48.569224] nix-grpc-daemon[787]: ts=2026-09-20T08:16:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14747worker1 # [ 48.571895] nix-grpc-daemon[787]: ts=2026-09-20T08:16:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14748worker1 # [ 48.579306] nix-daemon[851]: reaped child process 918, status = succeeded4749client # [ 48.625142] systemd[1]: dedup2.service: Deactivated successfully.4750client # [ 48.629186] systemd[1]: dedup2.service: Consumed 134ms CPU time over 3.851s wall clock time, 31.1M memory peak, 7.7K incoming IP traffic, 6.7K outgoing IP traffic.4751client # [ 48.635348] systemd[1]: dedup1.service: Deactivated successfully.4752client # [ 48.638540] systemd[1]: dedup1.service: Consumed 107ms CPU time over 4.940s wall clock time, 39.3M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4753client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds)4754client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4755client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds)4756worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4757worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4758worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4759worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4760worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4761worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.04 seconds)4762worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4763worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4764(finished: subtest: two clients wanting the same drv build it once, in 5.84 seconds)4765subtest: build hook: nix-daemon with builders = grpc://lb4766client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4767client # [ 49.607440] systemd[1]: Started Nix Daemon.4768client # [ 49.738206] nix-daemon[934]: accepted connection from pid 931, user root (trusted)4769worker1 # [ 49.882721] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:480484770worker1 # [ 49.887724] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:480484771worker1 # [ 49.899685] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04772worker1 # [ 49.901838] nix-grpc-daemon[787]: ts=2026-09-20T08:16:12Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14773worker2 # [ 49.915438] nix-grpc-daemon[853]: ts=2026-09-20T08:16:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924774worker2 # [ 49.927779] nix-grpc-daemon[853]: ts=2026-09-20T08:16:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924775worker2 # [ 49.939859] nix-grpc-daemon[853]: ts=2026-09-20T08:16:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456924776worker2 # [ 49.950628] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4777worker2 # [ 50.113515] nix-daemon[911]: accepted connection from pid 1075, user nix-grpc-daemon (trusted)4778worker2 # [ 50.127500] nix-daemon[911]: reaped child process 1078, status = succeeded4779worker2 # [ 50.274306] nix-daemon[911]: accepted connection from pid 1080, user nix-grpc-daemon (trusted)4780worker2 # [ 50.285413] nix-daemon[911]: reaped child process 1083, status = succeeded4781lb # [ 50.289299] niks3-server[1127]: 2026/09/20 08:16:11 INFO Received uploads request method=POST path=/api/pending_closures4782worker2 # [ 50.308256] nix-grpc-daemon[921]: time=2026-09-20T08:16:12.256Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4783worker2 # [ 50.310208] nix-grpc-daemon[921]: time=2026-09-20T08:16:12.257Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4784lb # [ 50.323062] niks3-server[1127]: 2026/09/20 08:16:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4785worker2 # [ 50.341316] nix-grpc-daemon[921]: time=2026-09-20T08:16:12.289Z level=INFO msg="Uploading 1 narinfos"4786lb # [ 50.330544] niks3-server[1127]: 2026/09/20 08:16:11 INFO Signed narinfos id=9 count=14787lb # [ 50.344447] niks3-server[1127]: 2026/09/20 08:16:12 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4788lb # [ 50.441648] niks3-server[1127]: 2026/09/20 08:16:12 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4789lb # [ 50.454142] niks3-server[1127]: 2026/09/20 08:16:12 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4790lb # [ 50.458710] niks3-server[1127]: 2026/09/20 08:16:12 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4791lb # [ 50.465845] niks3-server[1127]: 2026/09/20 08:16:12 INFO Completed upload id=94792worker2 # [ 50.479395] nix-grpc-daemon[921]: time=2026-09-20T08:16:12.427Z level=INFO msg="Upload complete. (517ms)"4793worker2 # [ 50.482074] nix-grpc-daemon[853]: ts=2026-09-20T08:16:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_in=5124794worker2 # [ 50.484644] nix-grpc-daemon[853]: ts=2026-09-20T08:16:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924795worker2 # [ 50.489089] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4796worker2 # [ 50.495511] nix-daemon[911]: reaped child process 1073, status = succeeded4797worker2 # [ 50.499642] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4798worker2 # [ 51.932838] nix-daemon[911]: reaped child process 1087, status = succeeded4799worker2 # [ 52.080092] nix-daemon[911]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4800worker2 # [ 52.092385] nix-daemon[911]: reaped child process 1105, status = succeeded4801lb # [ 52.092862] niks3-server[1127]: 2026/09/20 08:16:13 INFO Received uploads request method=POST path=/api/pending_closures4802worker2 # [ 52.112176] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.059Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4803worker2 # [ 52.115490] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.061Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4804lb # [ 52.124714] niks3-server[1127]: 2026/09/20 08:16:13 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4805lb # [ 52.138121] niks3-server[1127]: 2026/09/20 08:16:13 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4806lb # [ 52.143269] niks3-server[1127]: 2026/09/20 08:16:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4807lb # [ 52.146377] niks3-server[1127]: 2026/09/20 08:16:13 INFO Signed narinfos id=10 count=14808worker2 # [ 52.159467] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.107Z level=INFO msg="Uploading 1 narinfos"4809lb # [ 52.150932] niks3-server[1127]: 2026/09/20 08:16:13 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4810lb # [ 52.157653] niks3-server[1127]: 2026/09/20 08:16:13 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4811lb # [ 52.163569] niks3-server[1127]: 2026/09/20 08:16:13 INFO Completed upload id=104812worker2 # [ 52.174469] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.122Z level=INFO msg="Upload complete. (266ms)"4813lb # [ 52.165046] niks3-server[1127]: 2026/09/20 08:16:13 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4814worker2 # [ 52.180233] nix-grpc-daemon[853]: ts=2026-09-20T08:16:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14815worker1 # [ 52.175463] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:480484816worker2 # [ 52.190157] nix-daemon[911]: reaped child process 1085, status = succeeded4817worker1 # [ 52.187406] nix-grpc-daemon[787]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4818worker1 # [ 52.224705] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:480484819worker1 # [ 52.227594] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=0 paths=1 nar_bytes_out=1284820worker2 # [ 52.495885] nix-grpc-daemon[853]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:456924821worker2 # [ 52.502977] nix-grpc-daemon[853]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924822worker2 # [ 52.508337] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.455Z level=INFO msg="All 1 paths already cached"4823worker1 # [ 52.510446] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04824worker1 # [ 52.515408] nix-grpc-daemon[787]: ts=2026-09-20T08:16:14Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14825worker2 # [ 52.525973] nix-grpc-daemon[853]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924826worker2 # [ 52.537476] nix-grpc-daemon[853]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924827worker2 # [ 52.548939] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.496Z level=INFO msg="All 1 paths already cached"4828worker2 # [ 52.555457] nix-grpc-daemon[853]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456924829worker2 # [ 52.566142] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4830worker2 # [ 52.735578] nix-daemon[911]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4831worker2 # [ 52.751590] nix-daemon[911]: reaped child process 1112, status = succeeded4832worker2 # [ 52.910818] nix-daemon[911]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)4833worker2 # [ 52.924606] nix-daemon[911]: reaped child process 1117, status = succeeded4834lb # [ 52.926601] niks3-server[1127]: 2026/09/20 08:16:14 INFO Received uploads request method=POST path=/api/pending_closures4835worker2 # [ 52.995680] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.943Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4836worker2 # [ 52.997689] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.945Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4837lb # [ 52.997087] niks3-server[1127]: 2026/09/20 08:16:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4838lb # [ 52.999285] niks3-server[1127]: 2026/09/20 08:16:14 INFO Signed narinfos id=11 count=14839worker2 # [ 53.010209] nix-grpc-daemon[921]: time=2026-09-20T08:16:14.958Z level=INFO msg="Uploading 1 narinfos"4840lb # [ 53.006576] niks3-server[1127]: 2026/09/20 08:16:14 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4841lb # [ 53.018093] niks3-server[1127]: 2026/09/20 08:16:14 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4842lb # [ 53.040572] niks3-server[1127]: 2026/09/20 08:16:14 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4843lb # [ 53.051823] niks3-server[1127]: 2026/09/20 08:16:14 INFO Completed upload id=114844worker2 # [ 53.062510] nix-grpc-daemon[921]: time=2026-09-20T08:16:15.010Z level=INFO msg="Upload complete. (484ms)"4845worker2 # [ 53.065087] nix-grpc-daemon[853]: ts=2026-09-20T08:16:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_in=6244846worker2 # [ 53.067573] nix-grpc-daemon[853]: ts=2026-09-20T08:16:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924847lb # [ 53.062858] niks3-server[1127]: 2026/09/20 08:16:14 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4848worker2 # [ 53.076391] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4849worker2 # [ 53.078744] nix-daemon[911]: reaped child process 1107, status = succeeded4850worker2 # [ 53.084035] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4851worker2 # [ 54.511763] nix-daemon[911]: reaped child process 1121, status = succeeded4852worker2 # [ 54.651562] nix-daemon[911]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4853worker2 # [ 54.665650] nix-daemon[911]: reaped child process 1139, status = succeeded4854lb # [ 54.665756] niks3-server[1127]: 2026/09/20 08:16:16 INFO Received uploads request method=POST path=/api/pending_closures4855worker2 # [ 54.683929] nix-grpc-daemon[921]: time=2026-09-20T08:16:16.631Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4856worker2 # [ 54.685423] nix-grpc-daemon[921]: time=2026-09-20T08:16:16.633Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4857lb # [ 54.707291] niks3-server[1127]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4858lb # [ 54.719557] niks3-server[1127]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4859lb # [ 54.727275] niks3-server[1127]: 2026/09/20 08:16:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4860lb # [ 54.732338] niks3-server[1127]: 2026/09/20 08:16:16 INFO Signed narinfos id=12 count=14861worker2 # [ 54.745383] nix-grpc-daemon[921]: time=2026-09-20T08:16:16.693Z level=INFO msg="Uploading 1 narinfos"4862lb # [ 54.739117] niks3-server[1127]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4863lb # [ 54.748247] niks3-server[1127]: 2026/09/20 08:16:16 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4864lb # [ 54.751568] niks3-server[1127]: 2026/09/20 08:16:16 INFO Completed upload id=124865lb # [ 54.754585] niks3-server[1127]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4866worker2 # [ 54.764098] nix-grpc-daemon[921]: time=2026-09-20T08:16:16.710Z level=INFO msg="Upload complete. (268ms)"4867worker2 # [ 54.768784] nix-grpc-daemon[853]: ts=2026-09-20T08:16:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14868worker2 # [ 54.774965] nix-grpc-daemon[853]: ts=2026-09-20T08:16:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456924869worker2 # [ 54.781219] nix-daemon[911]: reaped child process 1119, status = succeeded4870worker2 # [ 54.787147] nix-grpc-daemon[853]: ts=2026-09-20T08:16:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:456924871worker2 # [ 54.789673] nix-grpc-daemon[853]: ts=2026-09-20T08:16:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_out=1764872worker1 # [ 55.032831] nix-grpc-daemon[787]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:480484873worker2 # [ 55.044816] nix-grpc-daemon[853]: ts=2026-09-20T08:16:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924874worker2 # [ 55.050343] nix-grpc-daemon[921]: time=2026-09-20T08:16:16.998Z level=INFO msg="All 2 paths already cached"4875worker2 # [ 55.065741] nix-grpc-daemon[853]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924876worker1 # [ 55.054469] nix-grpc-daemon[787]: ts=2026-09-20T08:16:17Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04877worker1 # [ 55.058858] nix-grpc-daemon[787]: ts=2026-09-20T08:16:17Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14878worker2 # [ 55.074367] nix-grpc-daemon[853]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924879worker2 # [ 55.081195] nix-grpc-daemon[921]: time=2026-09-20T08:16:17.029Z level=INFO msg="All 2 paths already cached"4880worker2 # [ 55.085023] nix-grpc-daemon[853]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456924881worker2 # [ 55.089836] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4882worker2 # [ 55.234276] nix-daemon[911]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4883worker2 # [ 55.248260] nix-daemon[911]: reaped child process 1146, status = succeeded4884worker2 # [ 55.411580] nix-daemon[911]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4885worker2 # [ 55.424209] nix-daemon[911]: reaped child process 1151, status = succeeded4886lb # [ 55.423463] niks3-server[1127]: 2026/09/20 08:16:17 INFO Received uploads request method=POST path=/api/pending_closures4887worker2 # [ 55.441743] nix-grpc-daemon[921]: time=2026-09-20T08:16:17.389Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4888worker2 # [ 55.443119] nix-grpc-daemon[921]: time=2026-09-20T08:16:17.389Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4889lb # [ 55.441486] niks3-server[1127]: 2026/09/20 08:16:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4890lb # [ 55.443038] niks3-server[1127]: 2026/09/20 08:16:17 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4891worker2 # [ 55.457972] nix-grpc-daemon[921]: time=2026-09-20T08:16:17.405Z level=INFO msg="Uploading 1 narinfos"4892lb # [ 55.447119] niks3-server[1127]: 2026/09/20 08:16:17 INFO Signed narinfos id=13 count=14893lb # [ 55.450795] niks3-server[1127]: 2026/09/20 08:16:17 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4894lb # [ 55.456055] niks3-server[1127]: 2026/09/20 08:16:17 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4895lb # [ 55.459277] niks3-server[1127]: 2026/09/20 08:16:17 INFO Completed upload id=134896worker2 # [ 55.469878] nix-grpc-daemon[921]: time=2026-09-20T08:16:17.417Z level=INFO msg="Upload complete. (375ms)"4897worker2 # [ 55.471883] nix-grpc-daemon[853]: ts=2026-09-20T08:16:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_in=7524898lb # [ 55.461813] niks3-server[1127]: 2026/09/20 08:16:17 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4899worker2 # [ 55.474545] nix-grpc-daemon[853]: ts=2026-09-20T08:16:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456924900worker2 # [ 55.481319] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4901worker2 # [ 55.486108] nix-daemon[911]: reaped child process 1141, status = succeeded4902worker2 # [ 55.489468] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4903worker2 # [ 56.312218] nix-daemon[911]: reaped child process 1155, status = succeeded4904worker2 # [ 56.458260] nix-daemon[911]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)4905worker2 # [ 56.469288] nix-daemon[911]: reaped child process 1173, status = succeeded4906lb # [ 56.473942] niks3-server[1127]: 2026/09/20 08:16:18 INFO Received uploads request method=POST path=/api/pending_closures4907worker2 # [ 56.502481] nix-grpc-daemon[921]: time=2026-09-20T08:16:18.450Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4908worker2 # [ 56.504308] nix-grpc-daemon[921]: time=2026-09-20T08:16:18.452Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4909lb # [ 56.524137] niks3-server[1127]: 2026/09/20 08:16:18 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4910lb # [ 56.535413] niks3-server[1127]: 2026/09/20 08:16:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4911worker2 # [ 56.551400] nix-grpc-daemon[921]: time=2026-09-20T08:16:18.499Z level=INFO msg="Uploading 1 narinfos"4912lb # [ 56.540808] niks3-server[1127]: 2026/09/20 08:16:18 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4913lb # [ 56.544718] niks3-server[1127]: 2026/09/20 08:16:18 INFO Signed narinfos id=14 count=14914lb # [ 56.556426] niks3-server[1127]: 2026/09/20 08:16:18 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4915lb # [ 56.560603] niks3-server[1127]: 2026/09/20 08:16:18 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4916lb # [ 56.932964] niks3-server[1127]: 2026/09/20 08:16:18 INFO Completed upload id=144917worker2 # [ 56.944079] nix-grpc-daemon[921]: time=2026-09-20T08:16:18.891Z level=INFO msg="Upload complete. (648ms)"4918lb # [ 56.941759] niks3-server[1127]: 2026/09/20 08:16:18 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4919worker2 # [ 56.950465] nix-grpc-daemon[853]: ts=2026-09-20T08:16:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14920worker2 # [ 56.964061] nix-daemon[911]: reaped child process 1153, status = succeeded4921worker2 # [ 56.995546] nix-grpc-daemon[853]: ts=2026-09-20T08:16:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456924922worker2 # [ 57.010139] nix-grpc-daemon[853]: ts=2026-09-20T08:16:18Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:456924923worker2 # [ 57.014519] nix-grpc-daemon[853]: ts=2026-09-20T08:16:18Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_out=2324924client # [ 57.113074] nix-daemon[934]: reaped child process 936, status = succeeded4925client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.64 seconds)4926client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4927client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4928client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4929client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4930client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4931client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4932(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.73 seconds)4933subtest: an input only one worker has still reaches the builder4934client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4935client # this derivation will be built:4936client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4937client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4938client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.39 seconds)4939client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4940client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.15 seconds)4941worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4942worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4943worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4944worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4945client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24946client # [ 58.142540] nix-daemon[934]: accepted connection from pid 1017, user root (trusted)4947client # this derivation will be built:4948client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4949lb # [ 58.327252] envoy[989]: conn peer=[2001:db8:1::1]:34740 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1370 ms=47124950lb # [ 58.331129] envoy[989]: conn peer=[2001:db8:1::1]:34742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1576 tx=1374 ms=35774951lb # [ 58.334705] envoy[989]: conn peer=[2001:db8:1::1]:34764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=604952lb # [ 58.338205] envoy[989]: conn peer=[2001:db8:1::1]:34750 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3384 tx=1775 ms=23974953lb # [ 58.341925] envoy[989]: conn peer=[2001:db8:1::1]:34770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1850 ms=23484954lb # [ 58.345528] envoy[989]: conn peer=[2001:db8:1::1]:43908 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=554955lb # [ 58.349621] envoy[989]: conn peer=[2001:db8:1::1]:43930 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=574956lb # [ 58.353279] envoy[989]: conn peer=[2001:db8:1::1]:43924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4328 tx=2104 ms=20274957worker1 # [ 58.382180] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:480484958worker2 # [ 58.394135] nix-grpc-daemon[853]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456924959client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4960client # copying 1 paths...4961client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4962worker1 # [ 58.393890] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:480484963worker1 # [ 58.398396] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4964worker1 # [ 58.545594] nix-daemon[851]: accepted connection from pid 981, user nix-grpc-daemon (trusted)4965worker1 # [ 58.558762] nix-daemon[851]: reaped child process 984, status = succeeded4966lb # [ 58.570045] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received uploads request method=POST path=/api/pending_closures4967worker1 # [ 58.575946] nix-grpc-daemon[895]: time=2026-09-20T08:16:20.740Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4968worker1 # [ 58.577947] nix-grpc-daemon[895]: time=2026-09-20T08:16:20.742Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4969lb # [ 58.584878] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4970lb # [ 58.587643] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4971lb # [ 58.589316] niks3-server[1127]: 2026/09/20 08:16:20 INFO Signed narinfos id=15 count=14972worker1 # [ 58.592532] nix-grpc-daemon[895]: time=2026-09-20T08:16:20.757Z level=INFO msg="Uploading 1 narinfos"4973lb # [ 58.595066] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4974lb # [ 58.598166] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4975lb # [ 58.600670] niks3-server[1127]: 2026/09/20 08:16:20 INFO Completed upload id=154976worker1 # [ 58.603629] nix-grpc-daemon[895]: time=2026-09-20T08:16:20.768Z level=INFO msg="Upload complete. (199ms)"4977lb # [ 58.603075] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4978worker1 # [ 58.605585] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=0 paths=1 nar_bytes_in=1204979worker1 # [ 58.612596] nix-daemon[851]: reaped child process 979, status = succeeded4980worker1 # [ 58.615922] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04981worker1 # [ 58.618230] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14982worker1 # [ 58.659766] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:480484983worker1 # [ 58.669937] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:480484984client # copying 2 paths to 'lb:50051'...4985client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4986worker1 # [ 58.684672] nix-grpc-daemon[787]: ts=2026-09-20T08:16:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:480484987client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4988worker1 # [ 58.695701] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4989worker1 # [ 58.862870] nix-daemon[851]: accepted connection from pid 990, user nix-grpc-daemon (trusted)4990worker1 # [ 58.876995] nix-daemon[851]: reaped child process 993, status = succeeded4991worker1 # [ 59.022850] nix-daemon[851]: accepted connection from pid 995, user nix-grpc-daemon (trusted)4992worker1 # [ 59.034471] nix-daemon[851]: reaped child process 998, status = succeeded4993lb # [ 59.043220] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received uploads request method=POST path=/api/pending_closures4994lb # [ 59.194995] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received uploads request method=POST path=/api/pending_closures4995worker1 # [ 59.214583] nix-grpc-daemon[895]: time=2026-09-20T08:16:21.379Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4996worker1 # [ 59.216363] nix-grpc-daemon[895]: time=2026-09-20T08:16:21.381Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4997worker1 # [ 59.219241] nix-grpc-daemon[895]: time=2026-09-20T08:16:21.383Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4998lb # [ 59.235547] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4999lb # [ 59.237596] niks3-server[1127]: 2026/09/20 08:16:20 INFO Signed narinfos id=17 count=25000lb # [ 59.239933] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5001lb # [ 59.242616] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5002lb # [ 59.245455] niks3-server[1127]: 2026/09/20 08:16:20 INFO Signed narinfos id=16 count=15003worker1 # [ 59.247512] nix-grpc-daemon[895]: time=2026-09-20T08:16:21.412Z level=INFO msg="Uploading 3 narinfos"5004lb # [ 59.250571] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5005lb # [ 59.260273] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5006lb # [ 59.262633] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5007lb # [ 59.269733] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5008lb # [ 59.277742] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5009lb # [ 59.285379] niks3-server[1127]: 2026/09/20 08:16:20 INFO Completed upload id=165010lb # [ 59.286799] niks3-server[1127]: 2026/09/20 08:16:20 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5011lb # [ 59.292843] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5012lb # [ 59.298315] niks3-server[1127]: 2026/09/20 08:16:20 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5013lb # [ 59.302236] niks3-server[1127]: 2026/09/20 08:16:20 INFO Completed upload id=175014worker1 # [ 59.305728] nix-grpc-daemon[895]: time=2026-09-20T08:16:21.470Z level=INFO msg="Upload complete. (597ms)"5015worker1 # [ 59.311334] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=0 paths=2 nar_bytes_in=9765016worker1 # [ 59.318315] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:480485017worker1 # [ 59.331125] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5018worker1 # [ 59.344413] nix-daemon[851]: reaped child process 988, status = succeeded5019client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5020client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5021worker1 # [ 59.352229] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5022worker1 # [ 60.366886] nix-daemon[851]: reaped child process 1002, status = succeeded5023worker1 # [ 60.502567] nix-daemon[851]: accepted connection from pid 1017, user nix-grpc-daemon (trusted)5024worker1 # [ 60.515764] nix-daemon[851]: reaped child process 1020, status = succeeded5025lb # [ 60.523678] niks3-server[1127]: 2026/09/20 08:16:22 INFO Received uploads request method=POST path=/api/pending_closures5026worker1 # [ 60.649941] nix-grpc-daemon[895]: time=2026-09-20T08:16:22.812Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5027lb # [ 60.669704] niks3-server[1127]: 2026/09/20 08:16:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5028lb # [ 60.676872] niks3-server[1127]: 2026/09/20 08:16:22 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5029lb # [ 60.682971] niks3-server[1127]: 2026/09/20 08:16:22 INFO Signed narinfos id=18 count=15030worker1 # [ 60.685089] nix-grpc-daemon[895]: time=2026-09-20T08:16:22.849Z level=INFO msg="Uploading 1 narinfos"5031lb # [ 60.693816] niks3-server[1127]: 2026/09/20 08:16:22 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5032lb # [ 60.706752] niks3-server[1127]: 2026/09/20 08:16:22 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5033lb # [ 60.713718] niks3-server[1127]: 2026/09/20 08:16:22 INFO Completed upload id=185034worker1 # [ 60.715386] nix-grpc-daemon[895]: time=2026-09-20T08:16:22.880Z level=INFO msg="Upload complete. (356ms)"5035lb # [ 60.717667] niks3-server[1127]: 2026/09/20 08:16:22 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5036worker1 # [ 60.721875] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=15037client # copying 1 paths...5038worker1 # [ 60.731967] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:480485039client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5040worker1 # [ 60.742753] nix-daemon[851]: reaped child process 1000, status = succeeded5041worker2 # [ 60.756223] nix-grpc-daemon[853]: ts=2026-09-20T08:16:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:456925042worker2 # [ 60.765493] nix-grpc-daemon[853]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5043worker2 # [ 60.776404] nix-grpc-daemon[853]: ts=2026-09-20T08:16:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_out=1205044client # [ 60.881830] nix-daemon[934]: reaped child process 1020, status = succeeded5045client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.91 seconds)5046client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25047client # [ 61.073993] nix-daemon[934]: accepted connection from pid 1039, user root (trusted)5048client # this derivation will be built:5049client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5050worker2 # [ 61.261159] nix-grpc-daemon[853]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:456925051client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5052worker2 # [ 61.268194] nix-grpc-daemon[853]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456925053worker1 # [ 61.282236] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05054worker1 # [ 61.287836] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15055worker2 # [ 61.298768] nix-grpc-daemon[853]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456925056worker2 # [ 61.310519] nix-grpc-daemon[853]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456925057client # copying 1 paths to 'lb:50051'...5058client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5059worker2 # [ 61.323322] nix-grpc-daemon[853]: ts=2026-09-20T08:16:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456925060worker2 # [ 61.334184] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)5061worker2 # [ 61.350234] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5)5062worker2 # [ 61.419857] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 2/5)5063worker2 # [ 61.567437] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 3/5)5064worker2 # [ 61.873770] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 334 ms (attempt 4/5)5065worker2 # [ 62.213503] nix-grpc-daemon[853]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5066worker2 # [ 62.215998] nix-grpc-daemon[853]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5067worker2 # [ 62.382478] nix-daemon[911]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)5068worker2 # [ 62.395446] nix-daemon[911]: reaped child process 1188, status = succeeded5069worker2 # [ 62.542113] nix-daemon[911]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)5070worker2 # [ 62.554495] nix-daemon[911]: reaped child process 1193, status = succeeded5071lb # [ 62.557886] niks3-server[1127]: 2026/09/20 08:16:24 INFO Received uploads request method=POST path=/api/pending_closures5072worker2 # [ 62.588340] nix-grpc-daemon[921]: time=2026-09-20T08:16:24.536Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5073worker2 # [ 62.589911] nix-grpc-daemon[921]: time=2026-09-20T08:16:24.537Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5074lb # [ 62.607307] niks3-server[1127]: 2026/09/20 08:16:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5075lb # [ 62.612844] niks3-server[1127]: 2026/09/20 08:16:24 INFO Signed narinfos id=19 count=15076worker2 # [ 62.627533] nix-grpc-daemon[921]: time=2026-09-20T08:16:24.575Z level=INFO msg="Uploading 1 narinfos"5077lb # [ 62.618365] niks3-server[1127]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5078lb # [ 62.636948] niks3-server[1127]: 2026/09/20 08:16:24 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5079lb # [ 62.876465] niks3-server[1127]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5080lb # [ 62.902294] niks3-server[1127]: 2026/09/20 08:16:24 INFO Completed upload id=195081worker2 # [ 62.913082] nix-grpc-daemon[921]: time=2026-09-20T08:16:24.860Z level=INFO msg="Upload complete. (683ms)"5082worker2 # [ 62.918623] nix-grpc-daemon[853]: ts=2026-09-20T08:16:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 paths=1 nar_bytes_in=5605083worker2 # [ 62.924805] nix-grpc-daemon[853]: ts=2026-09-20T08:16:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456925084lb # [ 62.915894] niks3-server[1127]: 2026/09/20 08:16:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5085worker2 # [ 62.937159] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)5086worker2 # [ 62.953324] nix-daemon[911]: reaped child process 1179, status = succeeded5087worker2 # [ 62.959218] nix-grpc-daemon[853]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5088client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5089worker2 # [ 62.977250] nix-daemon[911]: accepted connection from pid 853, user nix-grpc-daemon (trusted)5090client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5091worker2 # [ 64.397703] nix-daemon[911]: reaped child process 1198, status = succeeded5092worker2 # [ 64.537456] nix-daemon[911]: accepted connection from pid 1213, user nix-grpc-daemon (trusted)5093worker2 # [ 64.549668] nix-daemon[911]: reaped child process 1216, status = succeeded5094lb # [ 64.555777] niks3-server[1127]: 2026/09/20 08:16:26 INFO Received uploads request method=POST path=/api/pending_closures5095worker2 # [ 64.574833] nix-grpc-daemon[921]: time=2026-09-20T08:16:26.522Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5096lb # [ 64.588539] niks3-server[1127]: 2026/09/20 08:16:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5097worker2 # [ 64.608160] nix-grpc-daemon[921]: time=2026-09-20T08:16:26.556Z level=INFO msg="Uploading 1 narinfos"5098lb # [ 64.598221] niks3-server[1127]: 2026/09/20 08:16:26 INFO Signed narinfos id=20 count=15099lb # [ 64.604133] niks3-server[1127]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5100lb # [ 64.609147] niks3-server[1127]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5101lb # [ 64.622720] niks3-server[1127]: 2026/09/20 08:16:26 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5102worker2 # [ 64.639994] nix-grpc-daemon[921]: time=2026-09-20T08:16:26.587Z level=INFO msg="Upload complete. (249ms)"5103lb # [ 64.628891] niks3-server[1127]: 2026/09/20 08:16:26 INFO Completed upload id=205104worker2 # [ 64.641761] nix-grpc-daemon[853]: ts=2026-09-20T08:16:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15105lb # [ 64.631905] niks3-server[1127]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5106worker2 # [ 64.648920] nix-daemon[911]: reaped child process 1195, status = succeeded5107client # copying 1 paths...5108worker1 # [ 64.680614] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:480485109worker1 # [ 64.691847] nix-grpc-daemon[787]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5110client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5111worker1 # [ 64.718729] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:480485112worker1 # [ 64.720915] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=0 paths=1 nar_bytes_out=1205113client # [ 64.835861] nix-daemon[934]: reaped child process 1042, status = succeeded5114client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.95 seconds)5115client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25116client # [ 65.022725] nix-daemon[934]: accepted connection from pid 1061, user root (trusted)5117client # this derivation will be built:5118client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5119worker2 # [ 65.206693] nix-grpc-daemon[853]: ts=2026-09-20T08:16:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:456925120client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5121worker2 # [ 65.212375] nix-grpc-daemon[853]: ts=2026-09-20T08:16:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456925122worker2 # [ 65.217331] nix-grpc-daemon[921]: time=2026-09-20T08:16:27.164Z level=INFO msg="All 1 paths already cached"5123worker1 # [ 65.215684] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05124worker1 # [ 65.220523] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15125worker1 # [ 65.225295] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:480485126worker1 # [ 65.233934] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:480485127worker1 # [ 65.246679] nix-grpc-daemon[895]: time=2026-09-20T08:16:27.411Z level=INFO msg="All 1 paths already cached"5128client # copying 1 paths to 'lb:50051'...5129client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5130worker1 # [ 65.255191] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:480485131worker1 # [ 65.264768] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5132worker1 # [ 65.420795] nix-daemon[851]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)5133worker1 # [ 65.434239] nix-daemon[851]: reaped child process 1032, status = succeeded5134worker1 # [ 65.597421] nix-daemon[851]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)5135worker1 # [ 65.609198] nix-daemon[851]: reaped child process 1037, status = succeeded5136lb # [ 65.619465] niks3-server[1127]: 2026/09/20 08:16:27 INFO Received uploads request method=POST path=/api/pending_closures5137worker1 # [ 65.626150] nix-grpc-daemon[895]: time=2026-09-20T08:16:27.791Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5138worker1 # [ 65.627632] nix-grpc-daemon[895]: time=2026-09-20T08:16:27.792Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5139lb # [ 65.643609] niks3-server[1127]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5140lb # [ 65.656828] niks3-server[1127]: 2026/09/20 08:16:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5141worker1 # [ 65.664518] nix-grpc-daemon[895]: time=2026-09-20T08:16:27.829Z level=INFO msg="Uploading 1 narinfos"5142lb # [ 65.662751] niks3-server[1127]: 2026/09/20 08:16:27 INFO Signed narinfos id=21 count=15143lb # [ 65.667132] niks3-server[1127]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5144lb # [ 65.679561] niks3-server[1127]: 2026/09/20 08:16:27 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5145worker1 # [ 65.687313] nix-grpc-daemon[895]: time=2026-09-20T08:16:27.852Z level=INFO msg="Upload complete. (408ms)"5146lb # [ 65.685842] niks3-server[1127]: 2026/09/20 08:16:27 INFO Completed upload id=215147worker1 # [ 65.689646] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=0 paths=1 nar_bytes_in=5605148lb # [ 65.688870] niks3-server[1127]: 2026/09/20 08:16:27 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5149worker1 # [ 65.694690] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:480485150worker1 # [ 65.700277] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5151worker1 # [ 65.702496] nix-daemon[851]: reaped child process 1027, status = succeeded5152worker1 # [ 65.708378] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5153client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5154client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5155worker1 # [ 66.922617] nix-daemon[851]: reaped child process 1041, status = succeeded5156worker1 # [ 67.041294] nix-daemon[851]: accepted connection from pid 1056, user nix-grpc-daemon (trusted)5157worker1 # [ 67.055072] nix-daemon[851]: reaped child process 1059, status = succeeded5158lb # [ 67.059662] niks3-server[1127]: 2026/09/20 08:16:28 INFO Received uploads request method=POST path=/api/pending_closures5159worker1 # [ 67.065332] nix-grpc-daemon[895]: time=2026-09-20T08:16:29.230Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5160lb # [ 67.077479] niks3-server[1127]: 2026/09/20 08:16:28 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5161lb # [ 67.085302] niks3-server[1127]: 2026/09/20 08:16:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5162lb # [ 67.089760] niks3-server[1127]: 2026/09/20 08:16:28 INFO Signed narinfos id=22 count=15163worker1 # [ 67.092683] nix-grpc-daemon[895]: time=2026-09-20T08:16:29.257Z level=INFO msg="Uploading 1 narinfos"5164lb # [ 67.092204] niks3-server[1127]: 2026/09/20 08:16:28 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5165lb # [ 67.101605] niks3-server[1127]: 2026/09/20 08:16:28 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5166worker1 # [ 67.108800] nix-grpc-daemon[895]: time=2026-09-20T08:16:29.273Z level=INFO msg="Upload complete. (193ms)"5167lb # [ 67.107365] niks3-server[1127]: 2026/09/20 08:16:28 INFO Completed upload id=225168lb # [ 67.109786] niks3-server[1127]: 2026/09/20 08:16:28 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5169worker1 # [ 67.111929] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48048 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15170client # copying 1 paths...5171worker1 # [ 67.118741] nix-daemon[851]: reaped child process 1039, status = succeeded5172worker2 # [ 67.128298] nix-grpc-daemon[853]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456925173worker2 # [ 67.136745] nix-grpc-daemon[853]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5174client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5175worker2 # [ 67.155607] nix-grpc-daemon[853]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:456925176worker2 # [ 67.157848] nix-grpc-daemon[853]: ts=2026-09-20T08:16:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45692 duration_s=0 paths=1 nar_bytes_out=1205177client # [ 67.254646] nix-daemon[934]: reaped child process 1064, status = succeeded5178client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.41 seconds)5179(finished: subtest: an input only one worker has still reaches the builder, in 10.05 seconds)5180subtest: upload whose reference the worker lacks is completed from the cache5181client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5182client # this derivation will be built:5183client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5184client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5185client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.41 seconds)5186client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5187client # this derivation will be built:5188client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5189client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5190client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.37 seconds)5191client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5192client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5193worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5194lb # [ 68.328528] envoy[989]: conn peer=[2001:db8:1::1]:43936 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4201 tx=1723 ms=24385195lb # [ 68.332910] envoy[989]: conn peer=[2001:db8:1::1]:43940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=715196lb # [ 68.336655] envoy[989]: conn peer=[2001:db8:1::1]:60518 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=535197lb # [ 68.340240] envoy[989]: conn peer=[2001:db8:1::1]:43944 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1918 ms=35215198lb # [ 68.343797] envoy[989]: conn peer=[2001:db8:1::1]:60534 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=505199lb # [ 68.347261] envoy[989]: conn peer=[2001:db8:1::1]:60524 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3686 tx=1916 ms=20055200worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5201worker2 # [ 68.495855] systemd[1]: Stopping Nix worker-protocol over gRPC...5202worker2 # [ 68.595482] nix-grpc-daemon[853]: ts=2026-09-20T08:16:30Z level=info event=signal_exit5203worker2 # [ 69.851505] nix-grpc-daemon[853]: ts=2026-09-20T08:16:31Z level=info event=scheduler_restarting5204worker1 # [ 69.849261] nix-grpc-daemon[787]: ts=2026-09-20T08:16:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:475325205worker1 # [ 69.853153] nix-grpc-daemon[787]: ts=2026-09-20T08:16:32Z level=info event=worker_gone addr=192.168.1.4:500515206worker2 # [ 69.872434] nix-grpc-daemon[853]: ts=2026-09-20T08:16:31Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5207worker2 # [ 69.891886] nix-daemon[911]: reaped child process 913, status = succeeded5208worker2 # [ 70.705527] nix-grpc-daemon[853]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5209worker2 # [ 70.709148] nix-grpc-daemon[853]: E0000 00:00:1789892192.652960 896 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5210worker2 # [ 70.713808] nix-grpc-daemon[853]: E0000 00:00:1789892192.653524 896 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5211worker2 # [ 71.534709] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5212worker2 # [ 71.537905] systemd[1]: Stopped Nix worker-protocol over gRPC.5213worker2 # [ 71.542240] systemd[1]: nix-grpc-daemon.service: Consumed 2.311s CPU time over 53.197s wall clock time, 60.8M memory peak, 79K incoming IP traffic, 145.1K outgoing IP traffic.5214worker2 # [ 71.553208] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5215worker2 # [ 71.557425] systemd[1]: Closed Nix worker-protocol over gRPC.5216worker2 # [ 71.560821] systemd[1]: nix-grpc-daemon.socket: Consumed 437us CPU time over 1min 1.605s wall clock time, 256K memory peak, 100.2K incoming IP traffic, 76.1K outgoing IP traffic.5217lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5218lb: must succeed: curl -sf localhost:9901/clusters5219lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5220lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5221client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25222worker1 # [ 71.816600] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:480485223worker1 # [ 71.824112] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:480485224client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5225client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5226worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5227worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5228worker2 # [ 71.931797] systemd[1]: Listening on Nix worker-protocol over gRPC.5229worker1 # [ 71.990653] systemd[1]: Stopping Nix worker-protocol over gRPC...5230worker2 # [ 72.521985] systemd[1]: Starting Nix worker-protocol over gRPC...5231worker1 # [ 72.588230] nix-grpc-daemon[787]: ts=2026-09-20T08:16:34Z level=info event=signal_exit5232worker2 # [ 72.673511] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5233worker2 # [ 72.677382] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15234worker2 # [ 72.683477] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5235worker2 # [ 72.687343] systemd[1]: Started Nix worker-protocol over gRPC.5236worker2 # [ 72.715075] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:34Z level=info event=scheduler_connected addr=lb:500515237worker1 # [ 72.708487] nix-grpc-daemon[787]: ts=2026-09-20T08:16:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05238worker1 # [ 72.845199] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_yield5239worker1 # [ 72.847849] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:475325240worker2 # [ 72.856560] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:34Z level=info event=scheduler_restarting addr=lb:500515241worker1 # [ 72.850063] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=worker_gone addr=192.168.1.4:500515242worker1 # [ 72.851335] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_restarting addr=lb:500515243lb # [ 72.850205] niks3-server[1127]: 2026/09/20 08:16:34 INFO lead: released remote=192.168.1.3:438465244worker1 # [ 72.855240] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:475325245worker1 # [ 72.856870] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=worker_gone addr=192.168.1.3:500515246worker2 # [ 73.056668] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515247worker1 # [ 73.051161] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515248worker2 # [ 73.061108] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5249worker1 # [ 73.058989] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5250worker2 # [ 73.262165] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515251worker2 # [ 73.267796] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5252worker1 # [ 73.260159] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515253worker1 # [ 73.265812] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5254worker2 # [ 73.468705] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515255worker2 # [ 73.473689] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5256worker1 # [ 73.467060] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515257worker1 # [ 73.472268] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5258worker2 # [ 73.677605] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515259worker1 # [ 73.673116] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515260worker2 # [ 73.681168] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5261worker1 # [ 73.675697] nix-grpc-daemon[787]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5262worker1 # [ 73.851773] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=info event=scheduler_restarting5263worker2 # [ 73.878675] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_connected addr=lb:500515264worker2 # [ 73.883538] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5265worker1 # [ 73.892842] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5266worker1 # [ 73.904729] nix-daemon[851]: reaped child process 853, status = succeeded5267worker2 # [ 74.084717] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:36Z level=info event=scheduler_connected addr=lb:500515268worker1 # [ 74.078506] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5269worker1 # [ 74.080290] nix-grpc-daemon[787]: E0000 00:00:1789892196.242977 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5270worker1 # [ 74.725643] nix-grpc-daemon[787]: E0000 00:00:1789892196.890393 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5271worker1 # [ 74.730590] nix-grpc-daemon[787]: E0000 00:00:1789892196.890547 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5272worker2 # [ 75.466289] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:37Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5273worker1 # [ 75.473615] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5274worker1 # [ 75.480232] systemd[1]: Stopped Nix worker-protocol over gRPC.5275worker1 # [ 75.482365] systemd[1]: nix-grpc-daemon.service: Consumed 1.589s CPU time over 57.145s wall clock time, 53.1M memory peak, 61.6K incoming IP traffic, 113.6K outgoing IP traffic.5276worker1 # [ 75.492796] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5277worker1 # [ 75.496320] systemd[1]: Closed Nix worker-protocol over gRPC.5278worker1 # [ 75.499256] systemd[1]: nix-grpc-daemon.socket: Consumed 309us CPU time over 1min 6.203s wall clock time, 256K memory peak, 107K incoming IP traffic, 88.6K outgoing IP traffic.5279lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5280lb: must succeed: curl -sf localhost:9901/clusters5281lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5282lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5283client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25284worker2 # [ 75.666764] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:37Z level=info event=scheduler_connected addr=lb:500515285worker2 # [ 75.672451] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5286worker2 # [ 75.805745] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419065287worker2 # [ 75.818708] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5288worker2 # [ 75.835325] nix-grpc-daemon[1238]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)5289worker2 # [ 75.851958] nix-grpc-daemon[1238]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 2/5)5290worker2 # [ 75.873436] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:37Z level=info event=scheduler_connected addr=lb:500515291worker2 # [ 75.877363] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:37Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5292worker2 # [ 75.969790] nix-grpc-daemon[1238]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 3/5)5293worker2 # [ 76.058251] nix-grpc-daemon[1238]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 578 ms (attempt 4/5)5294worker2 # [ 76.077938] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_connected addr=lb:500515295worker2 # [ 76.080625] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5296worker2 # [ 76.281808] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_connected addr=lb:500515297worker2 # [ 76.285961] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5298worker2 # [ 76.489597] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_connected addr=lb:500515299worker2 # [ 76.492794] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5300worker2 # [ 76.642889] nix-grpc-daemon[1238]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5301client # copying 2 paths...5302client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5303worker2 # [ 76.664586] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419065304client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5305worker2 # [ 76.677163] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5306worker2 # [ 76.689713] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_connected addr=lb:500515307worker2 # [ 76.693763] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5308worker2 # [ 76.707427] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=niks3_push_started pid=12945309worker2 # [ 76.900693] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_connected addr=lb:500515310worker2 # [ 76.904644] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5311worker2 # [ 77.056237] nix-daemon[911]: accepted connection from pid 1307, user nix-grpc-daemon (trusted)5312worker2 # [ 77.067395] nix-daemon[911]: reaped child process 1310, status = succeeded5313lb # [ 77.075822] niks3-server[1127]: 2026/09/20 08:16:38 INFO Received uploads request method=POST path=/api/pending_closures5314lb # [ 77.084585] niks3-server[1127]: 2026/09/20 08:16:38 INFO Received uploads request method=POST path=/api/pending_closures5315worker2 # [ 77.103060] nix-grpc-daemon[1294]: time=2026-09-20T08:16:39.050Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5316worker2 # [ 77.106880] nix-grpc-daemon[1294]: time=2026-09-20T08:16:39.052Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5317worker2 # [ 77.109650] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:39Z level=info event=scheduler_connected addr=lb:500515318worker2 # [ 77.111038] nix-grpc-daemon[1294]: time=2026-09-20T08:16:39.053Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5319worker2 # [ 77.112910] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:39Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5320lb # [ 77.128225] niks3-server[1127]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5321lb # [ 77.151617] niks3-server[1127]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5322lb # [ 77.154266] niks3-server[1127]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5323lb # [ 77.157439] niks3-server[1127]: 2026/09/20 08:16:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5324lb # [ 77.159249] niks3-server[1127]: 2026/09/20 08:16:38 INFO Signed narinfos id=23 count=15325lb # [ 77.161538] niks3-server[1127]: 2026/09/20 08:16:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5326lb # [ 77.163557] niks3-server[1127]: 2026/09/20 08:16:38 INFO Signed narinfos id=24 count=25327worker2 # [ 77.175244] nix-grpc-daemon[1294]: time=2026-09-20T08:16:39.122Z level=INFO msg="Uploading 3 narinfos"5328lb # [ 77.165751] niks3-server[1127]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5329lb # [ 77.175239] niks3-server[1127]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5330lb # [ 77.182991] niks3-server[1127]: 2026/09/20 08:16:38 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5331lb # [ 77.186520] niks3-server[1127]: 2026/09/20 08:16:38 INFO Completed upload id=235332lb # [ 77.188249] niks3-server[1127]: 2026/09/20 08:16:38 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5333lb # [ 77.191810] niks3-server[1127]: 2026/09/20 08:16:38 INFO Completed upload id=245334lb # [ 77.193687] niks3-server[1127]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5335worker2 # [ 77.203876] nix-grpc-daemon[1294]: time=2026-09-20T08:16:39.151Z level=INFO msg="Upload complete. (309ms)"5336lb # [ 77.195886] niks3-server[1127]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5337worker2 # [ 77.207836] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=0 paths=2 nar_bytes_in=3125338worker2 # [ 77.218994] nix-daemon[911]: reaped child process 1292, status = succeeded5339client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.67 seconds)5340worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5341worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5342worker2 # [ 77.310073] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:39Z level=info event=scheduler_connected addr=lb:500515343worker2 # [ 77.314830] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5344worker1 # [ 77.325615] systemd[1]: Listening on Nix worker-protocol over gRPC.5345worker1 # [ 77.332975] systemd[1]: Starting Nix worker-protocol over gRPC...5346worker1 # [ 77.500563] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5347worker1 # [ 77.504634] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15348worker2 # [ 77.516904] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:39Z level=info event=scheduler_connected addr=lb:500515349worker1 # [ 77.511866] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5350worker1 # [ 77.513492] systemd[1]: Started Nix worker-protocol over gRPC.5351lb # [ 77.523333] niks3-server[1127]: 2026/09/20 08:16:39 INFO lead: acquired remote=192.168.1.3:504085352worker1 # [ 77.525686] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:39Z level=info event=scheduler_take_over5353worker1 # [ 77.528175] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05354lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5355lb: must succeed: curl -sf localhost:9901/clusters5356worker1 # [ 77.550779] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:39Z level=info event=scheduler_connected addr=lb:500515357worker1 # [ 77.552443] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05358lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5359lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5360(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.34 seconds)5361subtest: scheduler down: the other node takes the lock and keeps it5362lb: must succeed: curl -sf localhost:9901/clusters5363lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5364lb: must succeed: curl -sf localhost:9901/clusters5365lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5366lb: must succeed: curl -sf localhost:9901/clusters5367lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5368lb: must succeed: curl -sf localhost:9901/clusters5369lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5370worker1 # [ 77.833245] systemd[1]: Stopping Nix worker-protocol over gRPC...5371lb # [ 78.328816] envoy[989]: conn peer=[2001:db8:1::4]:44246 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=13901 tx=2840 ms=512275372lb # [ 78.332773] envoy[989]: conn peer=[2001:db8:1::1]:60544 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=225373lb # [ 78.336442] envoy[989]: conn peer=[2001:db8:1::3]:40504 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=14556 tx=2829 ms=552535374lb # [ 78.340168] envoy[989]: conn peer=[2001:db8:1::1]:37202 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=282 ms=14165375worker1 # [ 78.516865] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=signal_exit5376worker1 # [ 78.527214] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=scheduler_yield5377lb # [ 78.527803] niks3-server[1127]: 2026/09/20 08:16:40 INFO lead: released remote=192.168.1.3:504085378worker1 # [ 78.532278] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=scheduler_restarting addr=lb:500515379worker1 # [ 78.536835] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:525025380worker2 # [ 78.547625] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:40Z level=info event=scheduler_restarting addr=lb:500515381worker1 # [ 78.541667] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=worker_gone addr=192.168.1.3:500515382worker1 # [ 78.544809] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:525025383worker1 # [ 78.548101] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=worker_gone addr=192.168.1.4:500515384worker1 # [ 78.732307] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=scheduler_connected addr=lb:500515385worker1 # [ 78.736285] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5386worker2 # [ 78.746810] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:40Z level=info event=scheduler_connected addr=lb:500515387worker2 # [ 78.753345] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5388worker1 # [ 78.936929] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:41Z level=info event=scheduler_connected addr=lb:500515389worker1 # [ 78.941095] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5390worker2 # [ 78.954134] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:40Z level=info event=scheduler_connected addr=lb:500515391worker2 # [ 78.956657] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5392worker1 # [ 79.141806] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:41Z level=info event=scheduler_connected addr=lb:500515393worker2 # [ 79.156937] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:41Z level=info event=scheduler_connected addr=lb:500515394worker1 # [ 79.145887] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5395worker2 # [ 79.159886] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5396worker1 # [ 79.346686] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:41Z level=info event=scheduler_connected addr=lb:500515397worker1 # [ 79.350784] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5398worker2 # [ 79.360918] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:41Z level=info event=scheduler_connected addr=lb:500515399worker2 # [ 79.365187] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5400worker1 # [ 79.528304] nix-grpc-daemon[1082]: ts=2026-09-20T08:16:41Z level=info event=scheduler_restarting5401worker1 # [ 79.537319] nix-grpc-daemon[1082]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5402worker1 # [ 79.540696] nix-grpc-daemon[1082]: E0000 00:00:1789892201.702187 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5403worker1 # [ 79.545727] nix-grpc-daemon[1082]: E0000 00:00:1789892201.710521 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5404worker2 # [ 79.567933] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:41Z level=info event=scheduler_connected addr=lb:500515405worker2 # [ 79.571824] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5406worker2 # [ 79.772366] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:41Z level=info event=scheduler_connected addr=lb:500515407worker1 # [ 79.765151] nix-grpc-daemon[1082]: E0000 00:00:1789892201.929924 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5408worker2 # [ 81.530062] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5409worker1 # [ 81.533501] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5410worker1 # [ 81.535754] systemd[1]: Stopped Nix worker-protocol over gRPC.5411worker1 # [ 81.536648] systemd[1]: nix-grpc-daemon.service: Consumed 135ms CPU time over 4.201s wall clock time, 12.3M memory peak, 7.5K incoming IP traffic, 7.4K outgoing IP traffic.5412worker1 # [ 81.540852] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5413worker1 # [ 81.542597] systemd[1]: Closed Nix worker-protocol over gRPC.5414worker1 # [ 81.543815] systemd[1]: nix-grpc-daemon.socket: Consumed 522us CPU time over 4.224s wall clock time, 256K memory peak, 18.8K incoming IP traffic, 15.2K outgoing IP traffic.5415worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5416worker2 # [ 81.730029] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:43Z level=info event=scheduler_connected addr=lb:500515417worker2 # [ 81.734378] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5418worker2 # [ 81.935303] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:43Z level=info event=scheduler_connected addr=lb:500515419worker2 # [ 81.939217] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5420worker2 # [ 82.139912] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_connected addr=lb:500515421worker2 # [ 82.144866] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5422worker2 # [ 82.345544] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_connected addr=lb:500515423worker2 # [ 82.347566] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5424worker2 # [ 82.548628] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_connected addr=lb:500515425worker2 # [ 82.550917] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5426lb # [ 82.684885] niks3-server[1127]: 2026/09/20 08:16:44 INFO lead: acquired remote=192.168.1.4:500545427worker2 # [ 82.695522] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_take_over5428worker2 # [ 82.751720] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=scheduler_connected addr=lb:500515429worker2 # [ 82.755959] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05430worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.18 seconds)5431worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5432worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5433client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25434client # don't know how to build these paths:5435client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5436worker2 # [ 83.995819] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:419065437worker2 # [ 84.006987] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:45Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05438worker2 # [ 84.012347] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:45Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=15439worker2 # [ 84.051288] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065440worker2 # [ 84.062663] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419065441client # copying 1 paths to 'lb:50051'...5442client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5443worker2 # [ 84.073463] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419065444worker2 # [ 84.084191] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5445worker2 # [ 84.238310] nix-daemon[911]: accepted connection from pid 1342, user nix-grpc-daemon (trusted)5446worker2 # [ 84.250726] nix-daemon[911]: reaped child process 1345, status = succeeded5447worker2 # [ 84.386729] nix-daemon[911]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)5448worker2 # [ 84.399108] nix-daemon[911]: reaped child process 1350, status = succeeded5449lb # [ 84.405651] niks3-server[1127]: 2026/09/20 08:16:46 INFO Received uploads request method=POST path=/api/pending_closures5450worker2 # [ 84.424622] nix-grpc-daemon[1294]: time=2026-09-20T08:16:46.372Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5451worker2 # [ 84.426071] nix-grpc-daemon[1294]: time=2026-09-20T08:16:46.372Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5452lb # [ 84.434760] niks3-server[1127]: 2026/09/20 08:16:46 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5453lb # [ 84.444516] niks3-server[1127]: 2026/09/20 08:16:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5454lb # [ 84.458085] niks3-server[1127]: 2026/09/20 08:16:46 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5455worker2 # [ 84.478052] nix-grpc-daemon[1294]: time=2026-09-20T08:16:46.425Z level=INFO msg="Uploading 1 narinfos"5456lb # [ 84.467258] niks3-server[1127]: 2026/09/20 08:16:46 INFO Signed narinfos id=25 count=15457lb # [ 84.476692] niks3-server[1127]: 2026/09/20 08:16:46 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5458lb # [ 84.482188] niks3-server[1127]: 2026/09/20 08:16:46 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5459lb # [ 84.487564] niks3-server[1127]: 2026/09/20 08:16:46 INFO Completed upload id=255460worker2 # [ 84.498326] nix-grpc-daemon[1294]: time=2026-09-20T08:16:46.446Z level=INFO msg="Upload complete. (402ms)"5461worker2 # [ 84.501906] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=0 paths=1 nar_bytes_in=5205462worker2 # [ 84.508348] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065463worker2 # [ 84.517105] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5464worker2 # [ 84.526816] nix-daemon[911]: reaped child process 1340, status = succeeded5465worker2 # [ 84.531536] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5466client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5467client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5468client # farm-a> LOG-farm-a-on-standby5469worker2 # [ 85.563639] nix-daemon[911]: reaped child process 1354, status = succeeded5470worker2 # [ 85.730852] nix-daemon[911]: accepted connection from pid 1369, user nix-grpc-daemon (trusted)5471worker2 # [ 85.745925] nix-daemon[911]: reaped child process 1372, status = succeeded5472lb # [ 85.751422] niks3-server[1127]: 2026/09/20 08:16:47 INFO Received uploads request method=POST path=/api/pending_closures5473worker2 # [ 85.773501] nix-grpc-daemon[1294]: time=2026-09-20T08:16:47.721Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5474worker2 # [ 85.775098] nix-grpc-daemon[1294]: time=2026-09-20T08:16:47.723Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5475lb # [ 85.798641] niks3-server[1127]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5476lb # [ 85.804918] niks3-server[1127]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5477lb # [ 85.808307] niks3-server[1127]: 2026/09/20 08:16:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5478lb # [ 85.811736] niks3-server[1127]: 2026/09/20 08:16:47 INFO Signed narinfos id=26 count=15479worker2 # [ 85.825513] nix-grpc-daemon[1294]: time=2026-09-20T08:16:47.772Z level=INFO msg="Uploading 1 narinfos"5480lb # [ 85.819280] niks3-server[1127]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5481lb # [ 85.829240] niks3-server[1127]: 2026/09/20 08:16:47 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5482lb # [ 85.832871] niks3-server[1127]: 2026/09/20 08:16:47 INFO Completed upload id=265483worker2 # [ 85.843729] nix-grpc-daemon[1294]: time=2026-09-20T08:16:47.791Z level=INFO msg="Upload complete. (300ms)"5484lb # [ 85.834320] niks3-server[1127]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5485worker2 # [ 85.855392] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15486worker2 # [ 85.870241] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:47Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05487worker2 # [ 85.872727] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:47Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=15488worker2 # [ 85.878407] nix-daemon[911]: reaped child process 1352, status = succeeded5489worker2 # [ 85.914750] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065490worker2 # [ 85.924339] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419065491worker2 # [ 85.937633] nix-grpc-daemon[1294]: time=2026-09-20T08:16:47.885Z level=INFO msg="All 1 paths already cached"5492client # copying 1 paths to 'lb:50051'...5493client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5494worker2 # [ 85.945252] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419065495worker2 # [ 85.953307] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5496worker2 # [ 86.117781] nix-daemon[911]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5497worker2 # [ 86.130971] nix-daemon[911]: reaped child process 1381, status = succeeded5498worker2 # [ 86.298057] nix-daemon[911]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)5499worker2 # [ 86.311196] nix-daemon[911]: reaped child process 1386, status = succeeded5500lb # [ 86.316809] niks3-server[1127]: 2026/09/20 08:16:47 INFO Received uploads request method=POST path=/api/pending_closures5501worker2 # [ 86.332463] nix-grpc-daemon[1294]: time=2026-09-20T08:16:48.280Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5502worker2 # [ 86.333971] nix-grpc-daemon[1294]: time=2026-09-20T08:16:48.280Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5503lb # [ 86.331522] niks3-server[1127]: 2026/09/20 08:16:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5504lb # [ 86.333403] niks3-server[1127]: 2026/09/20 08:16:47 INFO Signed narinfos id=27 count=15505worker2 # [ 86.345470] nix-grpc-daemon[1294]: time=2026-09-20T08:16:48.293Z level=INFO msg="Uploading 1 narinfos"5506lb # [ 86.336991] niks3-server[1127]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5507lb # [ 86.340157] niks3-server[1127]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5508lb # [ 86.345577] niks3-server[1127]: 2026/09/20 08:16:48 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5509lb # [ 86.348332] niks3-server[1127]: 2026/09/20 08:16:48 INFO Completed upload id=275510worker2 # [ 86.358991] nix-grpc-daemon[1294]: time=2026-09-20T08:16:48.307Z level=INFO msg="Upload complete. (393ms)"5511lb # [ 86.350054] niks3-server[1127]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5512worker2 # [ 86.361060] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=0 paths=1 nar_bytes_in=6405513worker2 # [ 86.365480] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065514worker2 # [ 86.372712] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5515worker2 # [ 86.374051] nix-daemon[911]: reaped child process 1376, status = succeeded5516worker2 # [ 86.379943] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5517client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5518client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5519client # farm-b> LOG-farm-b-on-standby5520worker2 # [ 87.409585] nix-daemon[911]: reaped child process 1390, status = succeeded5521worker2 # [ 87.542499] nix-daemon[911]: accepted connection from pid 1405, user nix-grpc-daemon (trusted)5522worker2 # [ 87.555244] nix-daemon[911]: reaped child process 1408, status = succeeded5523lb # [ 87.555888] niks3-server[1127]: 2026/09/20 08:16:49 INFO Received uploads request method=POST path=/api/pending_closures5524worker2 # [ 87.576521] nix-grpc-daemon[1294]: time=2026-09-20T08:16:49.524Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5525worker2 # [ 87.578241] nix-grpc-daemon[1294]: time=2026-09-20T08:16:49.526Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5526lb # [ 87.598699] niks3-server[1127]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5527lb # [ 87.608988] niks3-server[1127]: 2026/09/20 08:16:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5528worker2 # [ 87.631409] nix-grpc-daemon[1294]: time=2026-09-20T08:16:49.579Z level=INFO msg="Uploading 1 narinfos"5529lb # [ 87.620670] niks3-server[1127]: 2026/09/20 08:16:49 INFO Signed narinfos id=28 count=15530lb # [ 87.624664] niks3-server[1127]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5531lb # [ 87.638595] niks3-server[1127]: 2026/09/20 08:16:49 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5532lb # [ 87.642589] niks3-server[1127]: 2026/09/20 08:16:49 INFO Completed upload id=285533worker2 # [ 87.653420] nix-grpc-daemon[1294]: time=2026-09-20T08:16:49.601Z level=INFO msg="Upload complete. (264ms)"5534lb # [ 87.644685] niks3-server[1127]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5535lb # [ 87.649271] niks3-server[1127]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5536worker2 # [ 87.661194] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15537worker2 # [ 87.673255] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:49Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05538worker2 # [ 87.676425] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:49Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=15539worker2 # [ 87.685289] nix-daemon[911]: reaped child process 1388, status = succeeded5540worker2 # [ 87.717116] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065541worker2 # [ 87.729523] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419065542worker2 # [ 87.744364] nix-grpc-daemon[1294]: time=2026-09-20T08:16:49.692Z level=INFO msg="All 2 paths already cached"5543client # copying 1 paths to 'lb:50051'...5544client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5545worker2 # [ 87.752818] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419065546worker2 # [ 87.761344] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5547worker2 # [ 87.920826] nix-daemon[911]: accepted connection from pid 1414, user nix-grpc-daemon (trusted)5548worker2 # [ 87.933593] nix-daemon[911]: reaped child process 1417, status = succeeded5549worker2 # [ 88.062618] nix-daemon[911]: accepted connection from pid 1419, user nix-grpc-daemon (trusted)5550worker2 # [ 88.075241] nix-daemon[911]: reaped child process 1422, status = succeeded5551lb # [ 88.075177] niks3-server[1127]: 2026/09/20 08:16:49 INFO Received uploads request method=POST path=/api/pending_closures5552worker2 # [ 88.097395] nix-grpc-daemon[1294]: time=2026-09-20T08:16:50.045Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5553worker2 # [ 88.098970] nix-grpc-daemon[1294]: time=2026-09-20T08:16:50.047Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5554lb # [ 88.111360] niks3-server[1127]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5555lb # [ 88.122739] niks3-server[1127]: 2026/09/20 08:16:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5556lb # [ 88.129123] niks3-server[1127]: 2026/09/20 08:16:49 INFO Signed narinfos id=29 count=15557worker2 # [ 88.142586] nix-grpc-daemon[1294]: time=2026-09-20T08:16:50.090Z level=INFO msg="Uploading 1 narinfos"5558lb # [ 88.137257] niks3-server[1127]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5559lb # [ 88.147546] niks3-server[1127]: 2026/09/20 08:16:49 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5560lb # [ 88.153643] niks3-server[1127]: 2026/09/20 08:16:49 INFO Completed upload id=295561worker2 # [ 88.164388] nix-grpc-daemon[1294]: time=2026-09-20T08:16:50.112Z level=INFO msg="Upload complete. (390ms)"5562lb # [ 88.155838] niks3-server[1127]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5563worker2 # [ 88.169143] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=0 paths=1 nar_bytes_in=7685564worker2 # [ 88.174628] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065565worker2 # [ 88.183205] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5566worker2 # [ 88.190075] nix-daemon[911]: reaped child process 1412, status = succeeded5567worker2 # [ 88.194928] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5568client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5569client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5570lb # [ 88.329381] envoy[989]: conn peer=[2001:db8:1::3]:60588 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1348 tx=339 ms=20055571client # farm-top> LOG-farm-top-on-standby5572worker2 # [ 89.021726] nix-daemon[911]: reaped child process 1426, status = succeeded5573worker2 # [ 89.164097] nix-daemon[911]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5574worker2 # [ 89.176395] nix-daemon[911]: reaped child process 1444, status = succeeded5575lb # [ 89.182923] niks3-server[1127]: 2026/09/20 08:16:50 INFO Received uploads request method=POST path=/api/pending_closures5576worker2 # [ 89.202917] nix-grpc-daemon[1294]: time=2026-09-20T08:16:51.150Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5577worker2 # [ 89.204701] nix-grpc-daemon[1294]: time=2026-09-20T08:16:51.152Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5578lb # [ 89.220076] niks3-server[1127]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5579lb # [ 89.228359] niks3-server[1127]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5580lb # [ 89.242265] niks3-server[1127]: 2026/09/20 08:16:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5581lb # [ 89.247497] niks3-server[1127]: 2026/09/20 08:16:50 INFO Signed narinfos id=30 count=15582worker2 # [ 89.258303] nix-grpc-daemon[1294]: time=2026-09-20T08:16:51.206Z level=INFO msg="Uploading 1 narinfos"5583lb # [ 89.250918] niks3-server[1127]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5584lb # [ 89.262258] niks3-server[1127]: 2026/09/20 08:16:50 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5585lb # [ 89.266878] niks3-server[1127]: 2026/09/20 08:16:50 INFO Completed upload id=305586worker2 # [ 89.277610] nix-grpc-daemon[1294]: time=2026-09-20T08:16:51.225Z level=INFO msg="Upload complete. (275ms)"5587lb # [ 89.268610] niks3-server[1127]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5588worker2 # [ 89.284408] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15589worker2 # [ 89.297234] nix-daemon[911]: reaped child process 1424, status = succeeded5590client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 5.56 seconds)5591client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5592client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5593worker1 # [ 89.586673] systemd[1]: Listening on Nix worker-protocol over gRPC.5594worker1 # [ 89.594804] systemd[1]: Starting Nix worker-protocol over gRPC...5595worker1 # [ 89.770514] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5596worker1 # [ 89.774676] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15597worker1 # [ 89.780693] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5598worker1 # [ 89.782310] systemd[1]: Started Nix worker-protocol over gRPC.5599lb: must succeed: curl -sf localhost:9901/clusters5600worker1 # [ 89.814338] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500515601worker2 # [ 89.824884] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05602lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5603worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5604worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5605lb: must succeed: curl -sf localhost:9901/clusters5606lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5607lb: must succeed: curl -sf localhost:9901/clusters5608lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5609worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5610worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5611(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.48 seconds)5612subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5613client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5614client # [ 90.114603] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5615client # Running as unit: rs.service; invocation ID: 03518a1547f74f4aa303d2903f4352cd5616client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5617worker2 # [ 90.326106] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:419065618client # [ 90.330386] nix[1164]: don't know how to build these paths:5619client # [ 90.331390] nix[1164]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5620worker2 # [ 90.339087] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05621worker2 # [ 90.344415] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=15622worker2 # [ 90.383143] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065623worker2 # [ 90.395778] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419065624client # [ 90.404269] nix[1164]: copying 1 paths to 'lb:50051'...5625client # [ 90.408163] nix[1164]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5626worker2 # [ 90.409821] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419065627worker2 # [ 90.418927] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5628worker2 # [ 90.600497] nix-daemon[911]: accepted connection from pid 1459, user nix-grpc-daemon (trusted)5629worker2 # [ 90.613345] nix-daemon[911]: reaped child process 1462, status = succeeded5630worker2 # [ 90.781263] nix-daemon[911]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)5631worker2 # [ 90.793675] nix-daemon[911]: reaped child process 1467, status = succeeded5632lb # [ 90.800922] niks3-server[1127]: 2026/09/20 08:16:52 INFO Received uploads request method=POST path=/api/pending_closures5633worker2 # [ 90.819599] nix-grpc-daemon[1294]: time=2026-09-20T08:16:52.767Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5634worker2 # [ 90.821185] nix-grpc-daemon[1294]: time=2026-09-20T08:16:52.769Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5635lb # [ 90.830581] niks3-server[1127]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5636lb # [ 90.849964] niks3-server[1127]: 2026/09/20 08:16:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5637worker2 # [ 90.866694] nix-grpc-daemon[1294]: time=2026-09-20T08:16:52.814Z level=INFO msg="Uploading 1 narinfos"5638lb # [ 90.856139] niks3-server[1127]: 2026/09/20 08:16:52 INFO Signed narinfos id=31 count=15639lb # [ 90.861787] niks3-server[1127]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5640lb # [ 90.874164] niks3-server[1127]: 2026/09/20 08:16:52 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5641lb # [ 90.879788] niks3-server[1127]: 2026/09/20 08:16:52 INFO Completed upload id=315642worker2 # [ 90.890514] nix-grpc-daemon[1294]: time=2026-09-20T08:16:52.838Z level=INFO msg="Upload complete. (458ms)"5643lb # [ 90.882946] niks3-server[1127]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5644worker2 # [ 90.893135] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=0 paths=1 nar_bytes_in=4165645worker2 # [ 90.896237] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419065646worker2 # [ 90.906062] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5647worker2 # [ 90.909179] nix-daemon[911]: reaped child process 1457, status = succeeded5648client # [ 90.913415] nix[1164]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5649worker2 # [ 90.916035] nix-daemon[911]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)5650lb: must succeed: curl -sf localhost:9901/clusters5651lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5652lb: must succeed: curl -sf localhost:9901/clusters5653lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5654lb: must succeed: curl -sf localhost:9901/clusters5655lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5656lb: must succeed: curl -sf localhost:9901/clusters5657lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5658worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5659worker1 # [ 92.989810] systemd-journald[290]: Received client request to rotate journal, rotating.5660worker1 # [ 93.043993] systemd-journald[290]: Vacuuming done, freed 0B of archived journals from /var/log/journal/1d51edf4ed9f4ad495bb5e5bafc927d3.5661worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.11 seconds)5662worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5663worker2 # [ 92.982251] systemd[1]: Stopping Nix worker-protocol over gRPC...5664worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5665??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5666 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735667client: must succeed: sleep 5.05668worker2 # [ 93.693636] nix-grpc-daemon[1238]: ts=2026-09-20T08:16:55Z level=info event=draining5669client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5670worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5671worker2 # [ 98.338284] nix-daemon[911]: reaped child process 1471, status = succeeded5672lb # [ 98.329446] envoy[989]: conn peer=[2001:db8:1::1]:50470 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9490 tx=3781 ms=53345673worker2 # [ 98.500524] nix-daemon[911]: accepted connection from pid 1511, user nix-grpc-daemon (trusted)5674worker2 # [ 98.512782] nix-daemon[911]: reaped child process 1514, status = succeeded5675lb # [ 98.521798] niks3-server[1127]: 2026/09/20 08:17:00 INFO Received uploads request method=POST path=/api/pending_closures5676worker2 # [ 98.541621] nix-grpc-daemon[1294]: time=2026-09-20T08:17:00.489Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5677worker2 # [ 98.543125] nix-grpc-daemon[1294]: time=2026-09-20T08:17:00.491Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5678lb # [ 98.572520] niks3-server[1127]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5679lb # [ 98.577141] niks3-server[1127]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5680lb # [ 98.584890] niks3-server[1127]: 2026/09/20 08:17:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5681lb # [ 98.591110] niks3-server[1127]: 2026/09/20 08:17:00 INFO Signed narinfos id=32 count=15682worker2 # [ 98.604273] nix-grpc-daemon[1294]: time=2026-09-20T08:17:00.552Z level=INFO msg="Uploading 1 narinfos"5683lb # [ 98.596798] niks3-server[1127]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5684lb # [ 98.602346] niks3-server[1127]: 2026/09/20 08:17:00 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5685lb # [ 98.606356] niks3-server[1127]: 2026/09/20 08:17:00 INFO Completed upload id=325686lb # [ 98.607827] niks3-server[1127]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5687worker2 # [ 98.618413] nix-grpc-daemon[1294]: time=2026-09-20T08:17:00.566Z level=INFO msg="Upload complete. (287ms)"5688worker2 # [ 98.625579] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41906 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15689worker2 # [ 98.637868] nix-daemon[911]: reaped child process 1469, status = succeeded5690client # [ 98.655987] systemd[1]: rs.service: Deactivated successfully.5691client # [ 98.657626] systemd[1]: rs.service: Consumed 117ms CPU time over 8.542s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5692worker2 # [ 98.694956] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=signal_exit5693worker2 # [ 98.920258] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=scheduler_yield5694lb # [ 98.912338] niks3-server[1127]: 2026/09/20 08:17:00 INFO lead: released remote=192.168.1.4:500545695worker2 # [ 98.926772] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=scheduler_restarting addr=lb:500515696worker1 # [ 98.915724] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_restarting addr=lb:500515697worker2 # [ 98.928407] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:418965698worker2 # [ 98.929747] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=worker_gone addr=192.168.1.3:500515699worker2 # [ 98.931605] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:418965700worker2 # [ 98.933208] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:00Z level=info event=worker_gone addr=192.168.1.4:500515701worker1 # [ 99.115803] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515702worker2 # [ 99.127955] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515703worker1 # [ 99.124412] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5704worker2 # [ 99.141677] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5705worker1 # [ 99.325820] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515706worker1 # [ 99.331367] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5707worker2 # [ 99.342975] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515708worker2 # [ 99.348296] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5709worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.11 seconds)5710client: waiting for success: ! systemctl is-active rs5711client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5712client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5713client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5714client: must fail: journalctl -u rs | grep -q 'reconnecting'5715client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5716lb: must succeed: curl -sf localhost:9901/clusters5717worker1 # [ 99.532616] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515718worker1 # [ 99.537840] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5719worker2 # [ 99.549457] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515720worker2 # [ 99.554645] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5721lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5722worker1 # [ 99.739090] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515723worker1 # [ 99.743429] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5724worker2 # [ 99.756866] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500515725worker2 # [ 99.760874] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5726worker1 # [ 99.791326] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:01Z level=info event=scheduler_take_over5727lb # [ 99.790211] niks3-server[1127]: 2026/09/20 08:17:01 INFO lead: acquired remote=192.168.1.3:509745728worker2 # [ 99.922608] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=scheduler_restarting5729worker2 # [ 99.943345] nix-daemon[911]: reaped child process 1287, status = succeeded5730worker1 # [ 99.946320] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500515731worker1 # [ 99.949658] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:02Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05732worker2 # [ 99.973181] nix-grpc-daemon[1238]: ts=2026-09-20T08:17:01Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5733lb: must succeed: curl -sf localhost:9901/clusters5734lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5735worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5736worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5737worker2 # [ 100.753694] nix-grpc-daemon[1238]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5738worker2 # [ 100.755161] nix-grpc-daemon[1238]: E0000 00:00:1789892222.701493 1281 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5739worker2 # [ 100.757274] nix-grpc-daemon[1238]: E0000 00:00:1789892222.701634 1281 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5740lb: must succeed: curl -sf localhost:9901/clusters5741lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5742worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5743worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5744worker2 # [ 101.975470] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5745worker2 # [ 101.978588] systemd[1]: Stopped Nix worker-protocol over gRPC.5746worker2 # [ 101.981437] systemd[1]: nix-grpc-daemon.service: Consumed 1.469s CPU time over 29.452s wall clock time, 38.7M memory peak, 57.5K incoming IP traffic, 110.7K outgoing IP traffic.5747worker2 # [ 101.998512] systemd[1]: Starting Nix worker-protocol over gRPC...5748worker2 # [ 102.171614] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5749worker2 # [ 102.174933] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15750worker2 # [ 102.181847] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5751worker2 # [ 102.184489] systemd[1]: Started Nix worker-protocol over gRPC.5752worker2 # [ 102.208685] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500515753worker1 # [ 102.202565] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:04Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05754lb: must succeed: curl -sf localhost:9901/clusters5755lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5756worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5757worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5758(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.90 seconds)5759subtest: scheduler restart mid-build: build finishes, no double build5760client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5761client # [ 103.029249] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5762client # Running as unit: mid.service; invocation ID: ce87f779c1ee43aea18f0e5e81ebc0c75763client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5764worker1 # [ 103.224870] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:471005765worker1 # [ 103.236316] nix-daemon[851]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)5766client # [ 103.255531] nix[1200]: don't know how to build these paths:5767client # [ 103.256445] nix[1200]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5768worker1 # [ 103.258409] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:05Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05769worker1 # [ 103.262943] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:05Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15770worker1 # [ 103.306867] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471005771worker1 # [ 103.320273] nix-grpc-daemon[1146]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 1/5)5772worker1 # [ 103.364325] nix-grpc-daemon[1146]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 2/5)5773worker1 # [ 103.402527] nix-grpc-daemon[1146]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 3/5)5774worker1 # [ 103.483788] nix-grpc-daemon[1146]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 4/5)5775worker1 # [ 103.606091] nix-grpc-daemon[1146]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5776worker1 # [ 103.623455] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471005777client # [ 103.640194] nix[1200]: copying 1 paths to 'lb:50051'...5778worker1 # [ 103.636583] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471005779client # [ 103.643294] nix[1200]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5780worker1 # [ 103.644076] nix-daemon[851]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)5781worker1 # [ 103.654906] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:05Z level=info event=niks3_push_started pid=12695782worker1 # [ 104.028120] nix-daemon[851]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5783worker1 # [ 104.040873] nix-daemon[851]: reaped child process 1285, status = succeeded5784worker1 # [ 104.224179] nix-daemon[851]: accepted connection from pid 1287, user nix-grpc-daemon (trusted)5785worker1 # [ 104.236943] nix-daemon[851]: reaped child process 1294, status = succeeded5786lb # [ 104.252089] niks3-server[1127]: 2026/09/20 08:17:05 INFO Received uploads request method=POST path=/api/pending_closures5787worker1 # [ 104.263212] nix-grpc-daemon[1269]: time=2026-09-20T08:17:06.427Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5788worker1 # [ 104.266339] nix-grpc-daemon[1269]: time=2026-09-20T08:17:06.429Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5789lb # [ 104.283328] niks3-server[1127]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5790lb # [ 104.294264] niks3-server[1127]: 2026/09/20 08:17:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5791lb # [ 104.299264] niks3-server[1127]: 2026/09/20 08:17:05 INFO Signed narinfos id=33 count=15792worker1 # [ 104.304296] nix-grpc-daemon[1269]: time=2026-09-20T08:17:06.468Z level=INFO msg="Uploading 1 narinfos"5793lb # [ 104.309670] niks3-server[1127]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5794lb # [ 104.319336] niks3-server[1127]: 2026/09/20 08:17:05 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5795worker1 # [ 104.327379] nix-grpc-daemon[1269]: time=2026-09-20T08:17:06.492Z level=INFO msg="Upload complete. (474ms)"5796lb # [ 104.325526] niks3-server[1127]: 2026/09/20 08:17:05 INFO Completed upload id=335797lb # [ 104.329272] niks3-server[1127]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5798worker1 # [ 104.330655] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47100 duration_s=0 paths=1 nar_bytes_in=4245799worker1 # [ 104.336556] nix-grpc-daemon[1146]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471005800worker1 # [ 104.344067] nix-daemon[851]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)5801worker1 # [ 104.349242] nix-daemon[851]: reaped child process 1267, status = succeeded5802worker1 # [ 104.354145] nix-daemon[851]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)5803client # [ 104.361321] nix[1200]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5804lb: must succeed: curl -sf localhost:9901/clusters5805lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5806lb: must succeed: curl -sf localhost:9901/clusters5807lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5808worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5809worker1 # [ 106.765685] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1146 (nix-grpc-daemon) on client request.5810worker1 # [ 106.769460] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5811lb # [ 106.777111] niks3-server[1127]: 2026/09/20 08:17:08 INFO lead: released remote=192.168.1.3:509745812client # [ 106.785851] nix[1200]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5813worker2 # [ 106.786362] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5814client # [ 106.789921] nix[1200]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5815worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.07 seconds)5816client: must succeed: sleep 5.05817worker1 # [ 106.804662] nix-daemon[851]: reaped child process 1296, status = succeeded5818worker1 # [ 106.807298] nix-daemon[851]: reaped child process 1260, status = succeeded5819worker1 # [ 106.808455] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5820worker1 # [ 106.810102] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5821worker1 # [ 106.812226] systemd[1]: nix-grpc-daemon.service: Consumed 456ms CPU time over 17.210s wall clock time, 32.8M memory peak, 14.2K incoming IP traffic, 22.4K outgoing IP traffic.5822worker1 # [ 106.820272] nix-daemon[1298]: unexpected Nix daemon error: error: interrupted by the user5823worker1 # [ 106.824355] nix-daemon[851]: reaped child process 1298, status = failed with exit code 15824worker2 # [ 106.986951] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500515825worker1 # [ 106.982588] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5826worker1 # [ 106.991818] systemd[1]: Starting Nix worker-protocol over gRPC...5827worker1 # [ 107.175878] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5828worker1 # [ 107.178222] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15829lb # [ 107.179692] niks3-server[1127]: 2026/09/20 08:17:08 INFO lead: acquired remote=192.168.1.4:386885830worker2 # [ 107.192356] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:09Z level=info event=scheduler_take_over5831worker1 # [ 107.184955] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5832worker1 # [ 107.189196] systemd[1]: Started Nix worker-protocol over gRPC.5833worker2 # [ 107.202768] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5834worker1 # [ 107.212627] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515835worker1 # [ 107.214719] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5836client # [ 107.288513] nix[1200]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting5837worker2 # [ 107.403792] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515838worker2 # [ 107.407979] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5839worker1 # [ 107.415632] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515840worker1 # [ 107.420412] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5841worker2 # [ 107.608870] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515842worker2 # [ 107.620909] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05843worker1 # [ 107.621200] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515844worker1 # [ 107.634246] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5845worker1 # [ 107.835168] nix-grpc-daemon[1334]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515846worker2 # [ 107.847252] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05847client # [ 108.294221] nix[1200]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting5848lb # [ 108.330207] envoy[989]: conn peer=[2001:db8:1::1]:50472 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1350 ms=83135849lb # [ 108.334173] envoy[989]: conn peer=[2001:db8:1::4]:58994 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7648 tx=1796 ms=272525850lb # [ 108.337789] envoy[989]: conn peer=[2001:db8:1::3]:54458 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1590 tx=496 ms=169695851worker2 # [ 110.307948] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:12Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05852worker2 # [ 110.313462] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:12Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15853worker2 # [ 110.366148] nix-grpc-daemon[1521]: ts=2026-09-20T08:17:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506045854worker2 # [ 110.378276] nix-daemon[911]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5855worker2 # [ 110.395652] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 1/5)5856worker2 # [ 110.494077] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5)5857worker2 # [ 110.653303] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 122 ms (attempt 3/5)5858worker2 # [ 110.776894] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 579 ms (attempt 4/5)5859worker2 # [ 111.363221] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5860worker2 # [ 111.384967] nix-grpc-daemon[1521]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5861worker2 # [ 111.409092] nix-daemon[911]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5862client # [ 111.420465] nix[1200]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5863worker2 # [ 111.422811] nix-daemon[911]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5864client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5865client: waiting for success: ! systemctl is-active mid5866worker2 # [ 202.520585] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:44Z level=info event=niks3_push_started pid=16245867worker2 # [ 202.533062] nix-daemon[911]: reaped child process 1600, status = succeeded5868worker2 # [ 202.832761] nix-daemon[911]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)5869worker2 # [ 202.845131] nix-daemon[911]: reaped child process 1640, status = succeeded5870lb # [ 202.850618] niks3-server[1127]: 2026/09/20 08:18:44 INFO Received uploads request method=POST path=/api/pending_closures5871worker2 # [ 202.873442] nix-grpc-daemon[1624]: time=2026-09-20T08:18:44.821Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5872worker2 # [ 202.876827] nix-grpc-daemon[1624]: time=2026-09-20T08:18:44.823Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5873lb # [ 202.912245] niks3-server[1127]: 2026/09/20 08:18:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5874lb # [ 202.916431] niks3-server[1127]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5875lb # [ 202.919143] niks3-server[1127]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5876worker2 # [ 202.930414] nix-grpc-daemon[1624]: time=2026-09-20T08:18:44.877Z level=INFO msg="Uploading 1 narinfos"5877lb # [ 202.920720] niks3-server[1127]: 2026/09/20 08:18:44 INFO Signed narinfos id=34 count=15878lb # [ 202.929368] niks3-server[1127]: 2026/09/20 08:18:44 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5879lb # [ 202.935642] niks3-server[1127]: 2026/09/20 08:18:44 INFO Completed upload id=345880worker2 # [ 202.946335] nix-grpc-daemon[1624]: time=2026-09-20T08:18:44.894Z level=INFO msg="Upload complete. (262ms)"5881lb # [ 202.937383] niks3-server[1127]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5882lb # [ 202.942356] niks3-server[1127]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5883worker2 # [ 202.952920] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50604 duration_s=92 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15884worker2 # [ 202.964220] nix-daemon[911]: reaped child process 1598, status = succeeded5885client # [ 202.989196] systemd[1]: mid.service: Deactivated successfully.5886client # [ 202.993519] systemd[1]: mid.service: Consumed 209ms CPU time over 1min 39.963s wall clock time, 41.4M memory peak, 4K written to disk, 10.1K incoming IP traffic, 11.4K outgoing IP traffic.5887client: (finished: waiting for success: ! systemctl is-active mid, in 91.24 seconds)5888client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5889client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5890(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 100.37 seconds)5891subtest: interrupting the client stops the build on the worker5892client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5893client # [ 203.375242] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5894client # Running as unit: intr.service; invocation ID: 9e268f68ec714f4fa18b5d019ba19d145895client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5896worker2 # [ 203.555537] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506045897client # [ 203.555349] nix[1666]: don't know how to build these paths:5898client # [ 203.556201] nix[1666]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5899worker2 # [ 203.565206] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:45Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05900worker2 # [ 203.567114] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:45Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15901worker1 # [ 203.610789] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355625902worker1 # [ 203.621186] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)5903worker1 # [ 203.637956] nix-grpc-daemon[1334]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)5904worker1 # [ 203.683870] nix-grpc-daemon[1334]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 2/5)5905worker1 # [ 203.822707] nix-grpc-daemon[1334]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 3/5)5906worker1 # [ 203.876458] nix-grpc-daemon[1334]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 311 ms (attempt 4/5)5907worker1 # [ 204.193516] nix-grpc-daemon[1334]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5908worker1 # [ 204.205548] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355625909client # [ 204.219340] nix[1666]: copying 1 paths to 'lb:50051'...5910worker1 # [ 204.215817] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355625911client # [ 204.223164] nix[1666]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5912worker1 # [ 204.222248] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)5913worker1 # [ 204.234190] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:46Z level=info event=niks3_push_started pid=14025914worker1 # [ 204.536511] nix-daemon[851]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5915worker1 # [ 204.551728] nix-daemon[851]: reaped child process 1421, status = succeeded5916worker1 # [ 204.715803] nix-daemon[851]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5917worker1 # [ 204.728206] nix-daemon[851]: reaped child process 1427, status = succeeded5918lb # [ 204.743359] niks3-server[1127]: 2026/09/20 08:18:46 INFO Received uploads request method=POST path=/api/pending_closures5919worker1 # [ 204.757292] nix-grpc-daemon[1402]: time=2026-09-20T08:18:46.921Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5920worker1 # [ 204.758785] nix-grpc-daemon[1402]: time=2026-09-20T08:18:46.923Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5921lb # [ 204.781977] niks3-server[1127]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5922lb # [ 204.790909] niks3-server[1127]: 2026/09/20 08:18:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5923lb # [ 204.797399] niks3-server[1127]: 2026/09/20 08:18:46 INFO Signed narinfos id=35 count=15924worker1 # [ 204.802426] nix-grpc-daemon[1402]: time=2026-09-20T08:18:46.967Z level=INFO msg="Uploading 1 narinfos"5925lb # [ 204.805939] niks3-server[1127]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5926lb # [ 204.816580] niks3-server[1127]: 2026/09/20 08:18:46 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5927lb # [ 204.822774] niks3-server[1127]: 2026/09/20 08:18:46 INFO Completed upload id=355928worker1 # [ 204.824642] nix-grpc-daemon[1402]: time=2026-09-20T08:18:46.989Z level=INFO msg="Upload complete. (438ms)"5929lb # [ 204.824596] niks3-server[1127]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5930worker1 # [ 204.830090] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=4245931worker1 # [ 204.835202] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355625932worker1 # [ 204.845057] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)5933worker1 # [ 204.848591] nix-daemon[851]: reaped child process 1400, status = succeeded5934worker1 # [ 204.853510] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)5935client # [ 204.860689] nix[1666]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5936client: must succeed: systemctl kill -s INT intr5937client # [ 206.928064] systemd[1]: intr.service: Sent signal SIGINT to main process 1666 (nix) on client request.5938worker1 # [ 206.926845] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:49Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5939client # [ 206.934933] nix[1666]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5940client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5941client # [ 206.941445] nix[1666]: error: interrupted by the user5942client # [ 206.968745] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5943client # [ 206.970181] systemd[1]: intr.service: Failed with result 'exit-code'.5944client # [ 206.972153] systemd[1]: intr.service: Consumed 104ms CPU time over 3.596s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5945worker1 # [ 207.073388] nix-daemon[1431]: unexpected Nix daemon error:5946worker1 # [ 207.075310] nix-daemon[851]: reaped child process 1429, status = succeeded5947worker1 # [ 207.076241] nix-daemon[1431]: error: interrupted by the user5948worker1 # [ 207.079850] nix-daemon[851]: reaped child process 1431, status = failed with exit code 15949(finished: subtest: interrupting the client stops the build on the worker, in 4.79 seconds)5950subtest: a deploy mid-build drains: the build finishes, the new generation takes over5951client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5952client # [ 208.198529] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5953client # Running as unit: sw.service; invocation ID: daab304049bd4c39b788e3867c2d8f7f5954client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5955lb # [ 208.334558] envoy[989]: conn peer=[2001:db8:1::1]:41380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4205 tx=1769 ms=997425956lb # [ 208.338983] envoy[989]: conn peer=[2001:db8:1::1]:59752 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=729 ms=34015957worker1 # [ 208.390259] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355625958client # [ 208.398577] nix[1687]: don't know how to build these paths:5959client # [ 208.399468] nix[1687]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5960worker2 # [ 208.410445] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:50Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05961worker2 # [ 208.414530] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:50Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15962worker2 # [ 208.452350] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506045963worker2 # [ 208.467859] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506045964client # [ 208.477028] nix[1687]: copying 1 paths to 'lb:50051'...5965client # [ 208.477984] nix[1687]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5966worker2 # [ 208.479301] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506045967worker2 # [ 208.490383] nix-daemon[911]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5968worker2 # [ 208.661678] nix-daemon[911]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5969worker2 # [ 208.673974] nix-daemon[911]: reaped child process 1681, status = succeeded5970worker2 # [ 208.831423] nix-daemon[911]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)5971worker2 # [ 208.843542] nix-daemon[911]: reaped child process 1686, status = succeeded5972lb # [ 208.848191] niks3-server[1127]: 2026/09/20 08:18:50 INFO Received uploads request method=POST path=/api/pending_closures5973worker2 # [ 208.868672] nix-grpc-daemon[1624]: time=2026-09-20T08:18:50.816Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5974worker2 # [ 208.870169] nix-grpc-daemon[1624]: time=2026-09-20T08:18:50.818Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5975lb # [ 208.882324] niks3-server[1127]: 2026/09/20 08:18:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5976lb # [ 208.886880] niks3-server[1127]: 2026/09/20 08:18:50 INFO Signed narinfos id=36 count=15977worker2 # [ 208.900328] nix-grpc-daemon[1624]: time=2026-09-20T08:18:50.848Z level=INFO msg="Uploading 1 narinfos"5978lb # [ 208.894906] niks3-server[1127]: 2026/09/20 08:18:50 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5979lb # [ 208.901385] niks3-server[1127]: 2026/09/20 08:18:50 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5980lb # [ 208.909538] niks3-server[1127]: 2026/09/20 08:18:50 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5981lb # [ 208.913156] niks3-server[1127]: 2026/09/20 08:18:50 INFO Completed upload id=365982worker2 # [ 208.923677] nix-grpc-daemon[1624]: time=2026-09-20T08:18:50.871Z level=INFO msg="Upload complete. (421ms)"5983lb # [ 208.914916] niks3-server[1127]: 2026/09/20 08:18:50 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5984worker2 # [ 208.926101] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50604 duration_s=0 paths=1 nar_bytes_in=4165985worker2 # [ 208.931250] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506045986worker2 # [ 208.939889] nix-daemon[911]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5987worker2 # [ 208.945760] nix-daemon[911]: reaped child process 1676, status = succeeded5988client # [ 208.946162] nix[1687]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5989worker2 # [ 208.948574] nix-daemon[911]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5990worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25991worker2 # Checking switch inhibitors... done5992worker2 # [ 211.231229] nixos[1721]: switching to system configuration /nix/store/0sd7392fsyrxrxkry5702q2g6zn71g87-nixos-system-worker2-test5993worker2 # activating the configuration...5994worker2 # [ 211.235891] systemd[1]: Stopped target Local File Systems.5995worker2 # [ 211.237318] systemd[1]: Stopped target Remote File Systems.5996worker2 # setting up /etc...5997worker2 # [ 211.826914] systemd[1]: Reload requested from client PID 1721 ('.switch-to-conf') (unit backdoor.service)...5998worker2 # [ 211.828590] systemd[1]: Reloading...5999worker2 # [ 212.489167] systemd[1]: Reloading finished in 658 ms.6000worker2 # restarting sysinit-reactivation.target6001worker2 # [ 212.544090] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6002worker2 # [ 212.671769] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6003worker2 # [ 212.676366] systemd[1]: Reached target Reactivate sysinit units.6004worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6005worker2 # [ 212.680426] systemd[1]: Reloading D-Bus System Message Bus...6006worker2 # [ 212.682458] dbus-broker-launch[583]: Caught SIGHUP, trigger reload.6007worker2 # [ 212.685606] systemd[1]: Reloading Nix worker-protocol over gRPC...6008worker2 # [ 212.716710] dbus-broker-launch[583]: Looking up NSS user entry for 'systemd-timesync'...6009worker2 # [ 212.717869] dbus-broker-launch[583]: NSS returned no entry for 'systemd-timesync'6010worker2 # [ 212.718856] dbus-broker-launch[583]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6011worker2 # [ 212.727439] systemd[1]: Reloaded Nix worker-protocol over gRPC.6012worker2 # [ 212.745750] systemd[1]: Reloaded D-Bus System Message Bus.6013worker2 # [ 212.753376] systemd[1]: Reached target Local File Systems.6014worker2 # [ 212.754268] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6015worker2 # [ 212.757782] systemd[1]: Starting Create SUID/SGID Wrappers...6016worker2 # [ 212.758588] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6017worker2 # [ 212.760540] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676018worker2 # [ 212.763226] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6019worker2 # [ 212.767037] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6020worker2 # [ 212.770207] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6021worker2 # [ 212.771351] systemd[1]: Reached target Remote File Systems.6022worker2 # [ 212.780185] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6023worker2 # [ 212.781478] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6024worker2 # [ 213.171585] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6025worker2 # [ 213.177194] systemd[1]: Finished Create SUID/SGID Wrappers.6026worker2 # [ 213.179297] systemd[1]: Starting linger-users.service...6027worker2 # [ 213.221744] systemd[1]: linger-users.service: Deactivated successfully.6028worker2 # [ 213.226094] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:55Z level=info event=draining6029worker2 # [ 213.227182] systemd[1]: Finished linger-users.service.6030worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6031worker2 # [ 213.480497] nixos[1721]: finished switching to system configuration /nix/store/0sd7392fsyrxrxkry5702q2g6zn71g87-nixos-system-worker2-test6032worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.84 seconds)6033worker2: must succeed: pgrep -f 'read -t [9]0 x'6034worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6035client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&26036client # don't know how to build these paths:6037client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6038worker1 # [ 213.717820] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355626039worker2 # [ 213.736304] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:55Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06040worker2 # [ 213.738158] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:55Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16041worker1 # [ 213.775470] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626042worker1 # [ 213.789268] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626043client # copying 1 paths to 'lb:50051'...6044worker1 # [ 213.802156] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626045client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6046worker1 # [ 213.820977] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6047worker1 # [ 214.000142] nix-daemon[851]: accepted connection from pid 1481, user nix-grpc-daemon (trusted)6048worker1 # [ 214.016312] nix-daemon[851]: reaped child process 1484, status = succeeded6049worker1 # [ 214.169075] nix-daemon[851]: accepted connection from pid 1486, user nix-grpc-daemon (trusted)6050worker1 # [ 214.181645] nix-daemon[851]: reaped child process 1489, status = succeeded6051lb # [ 214.194076] niks3-server[1127]: 2026/09/20 08:18:55 INFO Received uploads request method=POST path=/api/pending_closures6052worker1 # [ 214.204208] nix-grpc-daemon[1402]: time=2026-09-20T08:18:56.368Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6053worker1 # [ 214.205704] nix-grpc-daemon[1402]: time=2026-09-20T08:18:56.370Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6054lb # [ 214.222518] niks3-server[1127]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6055lb # [ 214.232901] niks3-server[1127]: 2026/09/20 08:18:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6056lb # [ 214.236957] niks3-server[1127]: 2026/09/20 08:18:55 INFO Signed narinfos id=37 count=16057worker1 # [ 214.241708] nix-grpc-daemon[1402]: time=2026-09-20T08:18:56.406Z level=INFO msg="Uploading 1 narinfos"6058lb # [ 214.246899] niks3-server[1127]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6059lb # [ 214.256207] niks3-server[1127]: 2026/09/20 08:18:55 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6060worker1 # [ 214.265790] nix-grpc-daemon[1402]: time=2026-09-20T08:18:56.430Z level=INFO msg="Upload complete. (430ms)"6061lb # [ 214.263908] niks3-server[1127]: 2026/09/20 08:18:55 INFO Completed upload id=376062lb # [ 214.267458] niks3-server[1127]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6063worker1 # [ 214.269342] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=5286064worker1 # [ 214.274106] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626065worker1 # [ 214.284529] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6066worker1 # [ 214.288307] nix-daemon[851]: reaped child process 1479, status = succeeded6067worker1 # [ 214.293418] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6068client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6069client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6070client # farm-a> LOG-farm-a-during-drain6071worker1 # [ 215.508519] nix-daemon[851]: reaped child process 1493, status = succeeded6072worker1 # [ 215.647343] nix-daemon[851]: accepted connection from pid 1508, user nix-grpc-daemon (trusted)6073worker1 # [ 215.659856] nix-daemon[851]: reaped child process 1511, status = succeeded6074lb # [ 215.672219] niks3-server[1127]: 2026/09/20 08:18:57 INFO Received uploads request method=POST path=/api/pending_closures6075worker1 # [ 215.682314] nix-grpc-daemon[1402]: time=2026-09-20T08:18:57.847Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6076worker1 # [ 215.683805] nix-grpc-daemon[1402]: time=2026-09-20T08:18:57.848Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6077lb # [ 215.705189] niks3-server[1127]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6078lb # [ 215.719672] niks3-server[1127]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6079lb # [ 215.730119] niks3-server[1127]: 2026/09/20 08:18:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6080lb # [ 215.735137] niks3-server[1127]: 2026/09/20 08:18:57 INFO Signed narinfos id=38 count=16081worker1 # [ 215.736510] nix-grpc-daemon[1402]: time=2026-09-20T08:18:57.901Z level=INFO msg="Uploading 1 narinfos"6082lb # [ 215.738678] niks3-server[1127]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6083lb # [ 215.749436] niks3-server[1127]: 2026/09/20 08:18:57 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6084lb # [ 215.756910] niks3-server[1127]: 2026/09/20 08:18:57 INFO Completed upload id=386085worker1 # [ 215.758780] nix-grpc-daemon[1402]: time=2026-09-20T08:18:57.923Z level=INFO msg="Upload complete. (257ms)"6086lb # [ 215.758681] niks3-server[1127]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6087worker2 # [ 215.777619] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:57Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06088worker1 # [ 215.765616] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16089worker2 # [ 215.780212] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:57Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16090worker1 # [ 215.778395] nix-daemon[851]: reaped child process 1491, status = succeeded6091worker1 # [ 215.818640] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626092worker1 # [ 215.830681] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626093worker1 # [ 215.843052] nix-grpc-daemon[1402]: time=2026-09-20T08:18:58.007Z level=INFO msg="All 1 paths already cached"6094client # copying 1 paths to 'lb:50051'...6095worker1 # [ 215.851060] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626096client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6097worker1 # [ 215.874180] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6098worker1 # [ 216.042674] nix-daemon[851]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6099worker1 # [ 216.055656] nix-daemon[851]: reaped child process 1518, status = succeeded6100worker1 # [ 216.206850] nix-daemon[851]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6101worker1 # [ 216.219522] nix-daemon[851]: reaped child process 1523, status = succeeded6102lb # [ 216.229628] niks3-server[1127]: 2026/09/20 08:18:57 INFO Received uploads request method=POST path=/api/pending_closures6103worker1 # [ 216.240219] nix-grpc-daemon[1402]: time=2026-09-20T08:18:58.404Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6104worker1 # [ 216.241645] nix-grpc-daemon[1402]: time=2026-09-20T08:18:58.404Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6105lb # [ 216.255123] niks3-server[1127]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6106lb # [ 216.266805] niks3-server[1127]: 2026/09/20 08:18:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6107worker1 # [ 216.273531] nix-grpc-daemon[1402]: time=2026-09-20T08:18:58.438Z level=INFO msg="Uploading 1 narinfos"6108lb # [ 216.271658] niks3-server[1127]: 2026/09/20 08:18:57 INFO Signed narinfos id=39 count=16109lb # [ 216.278146] niks3-server[1127]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6110lb # [ 216.289165] niks3-server[1127]: 2026/09/20 08:18:57 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6111lb # [ 216.295091] niks3-server[1127]: 2026/09/20 08:18:57 INFO Completed upload id=396112worker1 # [ 216.296820] nix-grpc-daemon[1402]: time=2026-09-20T08:18:58.461Z level=INFO msg="Upload complete. (408ms)"6113lb # [ 216.297940] niks3-server[1127]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6114worker1 # [ 216.300787] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=6406115worker1 # [ 216.305381] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626116worker1 # [ 216.313474] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6117worker1 # [ 216.320691] nix-daemon[851]: reaped child process 1513, status = succeeded6118client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6119client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6120worker1 # [ 216.324529] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6121client # farm-b> LOG-farm-b-during-drain6122worker1 # [ 216.950810] nix-daemon[851]: reaped child process 1527, status = succeeded6123worker1 # [ 217.099095] nix-daemon[851]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6124worker1 # [ 217.110660] nix-daemon[851]: reaped child process 1545, status = succeeded6125lb # [ 217.123930] niks3-server[1127]: 2026/09/20 08:18:58 INFO Received uploads request method=POST path=/api/pending_closures6126worker1 # [ 217.135892] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.300Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6127worker1 # [ 217.138448] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.302Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6128lb # [ 217.146260] niks3-server[1127]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6129lb # [ 217.152566] niks3-server[1127]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6130lb # [ 217.155963] niks3-server[1127]: 2026/09/20 08:18:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6131lb # [ 217.160886] niks3-server[1127]: 2026/09/20 08:18:58 INFO Signed narinfos id=40 count=16132worker1 # [ 217.162882] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.327Z level=INFO msg="Uploading 1 narinfos"6133lb # [ 217.162712] niks3-server[1127]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6134lb # [ 217.167054] niks3-server[1127]: 2026/09/20 08:18:58 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6135lb # [ 217.170620] niks3-server[1127]: 2026/09/20 08:18:58 INFO Completed upload id=406136worker1 # [ 217.172560] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.337Z level=INFO msg="Upload complete. (242ms)"6137lb # [ 217.172121] niks3-server[1127]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6138worker1 # [ 217.175210] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16139worker1 # [ 217.182553] nix-daemon[851]: reaped child process 1525, status = succeeded6140worker2 # [ 217.192514] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:59Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06141worker2 # [ 217.194289] nix-grpc-daemon[1521]: ts=2026-09-20T08:18:59Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16142worker1 # [ 217.227360] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626143worker1 # [ 217.239386] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626144worker1 # [ 217.253710] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.418Z level=INFO msg="All 2 paths already cached"6145client # copying 1 paths to 'lb:50051'...6146worker1 # [ 217.262778] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626147client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6148worker1 # [ 217.277164] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6149worker1 # [ 217.435100] nix-daemon[851]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6150worker1 # [ 217.448461] nix-daemon[851]: reaped child process 1552, status = succeeded6151worker1 # [ 217.598381] nix-daemon[851]: accepted connection from pid 1554, user nix-grpc-daemon (trusted)6152worker1 # [ 217.611630] nix-daemon[851]: reaped child process 1557, status = succeeded6153lb # [ 217.622832] niks3-server[1127]: 2026/09/20 08:18:59 INFO Received uploads request method=POST path=/api/pending_closures6154worker1 # [ 217.632604] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.797Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6155worker1 # [ 217.634799] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.799Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6156lb # [ 217.650162] niks3-server[1127]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6157lb # [ 217.662476] niks3-server[1127]: 2026/09/20 08:18:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6158lb # [ 217.667408] niks3-server[1127]: 2026/09/20 08:18:59 INFO Signed narinfos id=41 count=16159worker1 # [ 217.672175] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.837Z level=INFO msg="Uploading 1 narinfos"6160lb # [ 217.673495] niks3-server[1127]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6161lb # [ 217.685303] niks3-server[1127]: 2026/09/20 08:18:59 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6162worker1 # [ 217.692939] nix-grpc-daemon[1402]: time=2026-09-20T08:18:59.857Z level=INFO msg="Upload complete. (403ms)"6163lb # [ 217.691183] niks3-server[1127]: 2026/09/20 08:18:59 INFO Completed upload id=416164worker1 # [ 217.694995] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=7686165worker1 # [ 217.697951] nix-grpc-daemon[1334]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626166lb # [ 217.696764] niks3-server[1127]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6167worker1 # [ 217.703251] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6168worker1 # [ 217.708118] nix-daemon[851]: reaped child process 1547, status = succeeded6169client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6170client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6171worker1 # [ 217.712972] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6172client # farm-top> LOG-farm-top-during-drain6173worker1 # [ 218.727633] nix-daemon[851]: reaped child process 1561, status = succeeded6174worker1 # [ 218.867568] nix-daemon[851]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)6175worker1 # [ 218.881216] nix-daemon[851]: reaped child process 1579, status = succeeded6176lb # [ 218.892807] niks3-server[1127]: 2026/09/20 08:19:00 INFO Received uploads request method=POST path=/api/pending_closures6177worker1 # [ 218.903336] nix-grpc-daemon[1402]: time=2026-09-20T08:19:01.067Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6178worker1 # [ 218.904744] nix-grpc-daemon[1402]: time=2026-09-20T08:19:01.067Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6179lb # [ 218.919573] niks3-server[1127]: 2026/09/20 08:19:00 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6180lb # [ 218.936627] niks3-server[1127]: 2026/09/20 08:19:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6181worker1 # [ 218.946823] nix-grpc-daemon[1402]: time=2026-09-20T08:19:01.111Z level=INFO msg="Uploading 1 narinfos"6182lb # [ 218.944792] niks3-server[1127]: 2026/09/20 08:19:00 INFO Signed narinfos id=42 count=16183lb # [ 218.949581] niks3-server[1127]: 2026/09/20 08:19:00 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6184lb # [ 218.955088] niks3-server[1127]: 2026/09/20 08:19:00 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6185lb # [ 218.962453] niks3-server[1127]: 2026/09/20 08:19:00 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6186lb # [ 218.968887] niks3-server[1127]: 2026/09/20 08:19:00 INFO Completed upload id=426187worker1 # [ 218.970786] nix-grpc-daemon[1402]: time=2026-09-20T08:19:01.135Z level=INFO msg="Upload complete. (251ms)"6188lb # [ 218.970709] niks3-server[1127]: 2026/09/20 08:19:00 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6189worker1 # [ 218.976419] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16190worker1 # [ 218.989586] nix-daemon[851]: reaped child process 1559, status = succeeded6191client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 5.49 seconds)6192client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6193client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6194worker2: must succeed: pkill -f 'read -t [9]0 x'6195worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6196client: waiting for success: ! systemctl is-active sw6197worker2 # [ 219.386961] nix-daemon[911]: reaped child process 1690, status = succeeded6198worker2 # [ 219.518529] nix-daemon[911]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6199worker2 # [ 219.529395] nix-daemon[911]: reaped child process 1870, status = succeeded6200lb # [ 219.534503] niks3-server[1127]: 2026/09/20 08:19:01 INFO Received uploads request method=POST path=/api/pending_closures6201worker2 # [ 219.554934] nix-grpc-daemon[1624]: time=2026-09-20T08:19:01.502Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6202worker2 # [ 219.556398] nix-grpc-daemon[1624]: time=2026-09-20T08:19:01.504Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6203lb # [ 219.572851] niks3-server[1127]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6204lb # [ 219.576935] niks3-server[1127]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6205lb # [ 219.588299] niks3-server[1127]: 2026/09/20 08:19:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6206lb # [ 219.592326] niks3-server[1127]: 2026/09/20 08:19:01 INFO Signed narinfos id=43 count=16207worker2 # [ 219.605753] nix-grpc-daemon[1624]: time=2026-09-20T08:19:01.553Z level=INFO msg="Uploading 1 narinfos"6208lb # [ 219.596710] niks3-server[1127]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6209lb # [ 219.604678] niks3-server[1127]: 2026/09/20 08:19:01 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6210lb # [ 219.609839] niks3-server[1127]: 2026/09/20 08:19:01 INFO Completed upload id=436211worker2 # [ 219.620927] nix-grpc-daemon[1624]: time=2026-09-20T08:19:01.568Z level=INFO msg="Upload complete. (253ms)"6212lb # [ 219.611934] niks3-server[1127]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6213worker2 # [ 219.627620] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50604 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16214worker2 # [ 219.638920] nix-daemon[911]: reaped child process 1688, status = succeeded6215client # [ 219.652542] systemd[1]: sw.service: Deactivated successfully.6216client # [ 219.654357] systemd[1]: sw.service: Consumed 104ms CPU time over 11.456s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.6217worker2 # [ 220.226927] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=signal_exit6218client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6219client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6220client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6221worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6222worker2 # [ 220.499297] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=scheduler_yield6223lb # [ 220.490828] niks3-server[1127]: 2026/09/20 08:19:02 INFO lead: released remote=192.168.1.4:386886224worker2 # [ 220.506750] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:506006225worker1 # [ 220.497981] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:02Z level=info event=scheduler_restarting addr=lb:500516226worker2 # [ 220.511864] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=worker_gone addr=192.168.1.3:500516227worker2 # [ 220.514944] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=scheduler_restarting addr=lb:500516228worker2 # [ 220.517929] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:506006229worker2 # [ 220.521194] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=worker_gone addr=192.168.1.4:500516230worker1 # [ 220.698416] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:02Z level=info event=scheduler_connected addr=lb:500516231worker2 # [ 220.712252] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=scheduler_connected addr=lb:500516232worker1 # [ 220.702587] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6233worker2 # [ 220.716691] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6234worker1 # [ 220.903437] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:03Z level=info event=scheduler_connected addr=lb:500516235worker2 # [ 220.917431] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=scheduler_connected addr=lb:500516236worker1 # [ 220.907694] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6237worker2 # [ 220.922092] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6238worker1 # [ 221.108350] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:03Z level=info event=scheduler_connected addr=lb:500516239worker1 # [ 221.112379] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6240worker2 # [ 221.122753] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:03Z level=info event=scheduler_connected addr=lb:500516241worker2 # [ 221.127469] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6242worker1 # [ 221.312744] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:03Z level=info event=scheduler_connected addr=lb:500516243worker1 # [ 221.320327] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6244worker2 # [ 221.329488] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:03Z level=info event=scheduler_connected addr=lb:500516245worker2 # [ 221.333467] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6246worker2 # [ 221.503221] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:03Z level=info event=scheduler_restarting6247worker2 # [ 221.527741] nix-daemon[911]: reaped child process 1592, status = succeeded6248worker1 # [ 221.521650] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:03Z level=info event=scheduler_connected addr=lb:500516249worker2 # [ 221.531086] nix-grpc-daemon[1521]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6250worker2 # [ 221.534791] nix-grpc-daemon[1521]: E0000 00:00:1789892343.478992 1564 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true6251worker2 # [ 221.550790] nix-grpc-daemon[1521]: ts=2026-09-20T08:19:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6252worker2 # [ 222.147964] nix-grpc-daemon[1521]: E0000 00:00:1789892344.095209 1564 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6253worker2 # [ 222.152745] nix-grpc-daemon[1521]: E0000 00:00:1789892344.095336 1564 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6254lb # [ 222.194149] niks3-server[1127]: 2026/09/20 08:19:03 INFO lead: acquired remote=192.168.1.3:348386255worker1 # [ 222.196072] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:04Z level=info event=scheduler_take_over6256worker1 # [ 222.300719] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:04Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"6257worker2 # [ 222.328632] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6258worker2 # [ 222.333388] systemd[1]: nix-grpc-daemon.service: Consumed 882ms CPU time over 2min 333ms wall clock time, 33.2M memory peak, 26.2K incoming IP traffic, 35.8K outgoing IP traffic.6259worker2 # [ 222.349601] systemd[1]: Starting Nix worker-protocol over gRPC...6260worker2 # [ 222.509410] nix-grpc-daemon[1884]: ts=2026-09-20T08:19:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6261worker1 # [ 222.501890] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:04Z level=info event=scheduler_connected addr=lb:500516262worker2 # [ 222.512978] nix-grpc-daemon[1884]: ts=2026-09-20T08:19:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16263worker1 # [ 222.506518] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:04Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06264worker2 # [ 222.520067] nix-grpc-daemon[1884]: ts=2026-09-20T08:19:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6265worker2 # [ 222.522817] systemd[1]: Started Nix worker-protocol over gRPC.6266worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.17 seconds)6267lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6268lb: must succeed: curl -sf localhost:9901/clusters6269worker2 # [ 222.551781] nix-grpc-daemon[1884]: ts=2026-09-20T08:19:04Z level=info event=scheduler_connected addr=lb:500516270worker2 # [ 222.562938] nix-grpc-daemon[1884]: ts=2026-09-20T08:19:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6271lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6272worker2 # [ 222.764179] nix-grpc-daemon[1884]: ts=2026-09-20T08:19:04Z level=info event=scheduler_connected addr=lb:500516273worker1 # [ 222.758367] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:04Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06274lb: must succeed: curl -sf localhost:9901/clusters6275lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6276lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)6277lb: must succeed: curl -sf localhost:9901/clusters6278lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6279worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6280worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6281(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.64 seconds)6282subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6283client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16284worker1 # [ 223.967709] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355626285worker1 # [ 223.979931] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06286worker1 # [ 223.984560] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16287worker1 # [ 223.989336] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06288worker1 # [ 223.993384] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06289worker1 # [ 224.024316] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626290worker1 # [ 224.036376] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626291worker1 # [ 224.043604] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626292worker1 # [ 224.047808] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6293worker1 # [ 224.194830] nix-daemon[851]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6294worker1 # [ 224.208732] nix-daemon[851]: reaped child process 1593, status = succeeded6295worker1 # [ 224.350348] nix-daemon[851]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)6296worker1 # [ 224.364315] nix-daemon[851]: reaped child process 1598, status = succeeded6297lb # [ 224.373947] niks3-server[1127]: 2026/09/20 08:19:06 INFO Received uploads request method=POST path=/api/pending_closures6298worker1 # [ 224.384886] nix-grpc-daemon[1402]: time=2026-09-20T08:19:06.549Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6299worker1 # [ 224.386375] nix-grpc-daemon[1402]: time=2026-09-20T08:19:06.551Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6300lb # [ 224.407422] niks3-server[1127]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6301lb # [ 224.416130] niks3-server[1127]: 2026/09/20 08:19:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6302lb # [ 224.421533] niks3-server[1127]: 2026/09/20 08:19:06 INFO Signed narinfos id=44 count=16303worker1 # [ 224.426113] nix-grpc-daemon[1402]: time=2026-09-20T08:19:06.591Z level=INFO msg="Uploading 1 narinfos"6304lb # [ 224.427646] niks3-server[1127]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6305lb # [ 224.439245] niks3-server[1127]: 2026/09/20 08:19:06 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6306lb # [ 224.445668] niks3-server[1127]: 2026/09/20 08:19:06 INFO Completed upload id=446307worker1 # [ 224.449768] nix-grpc-daemon[1402]: time=2026-09-20T08:19:06.614Z level=INFO msg="Upload complete. (395ms)"6308lb # [ 224.448615] niks3-server[1127]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6309worker1 # [ 224.451988] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=5046310worker1 # [ 224.456557] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626311worker1 # [ 224.463354] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6312worker1 # [ 224.465850] nix-daemon[851]: reaped child process 1588, status = succeeded6313worker1 # [ 224.471394] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6314worker1 # [ 225.696729] nix-daemon[851]: reaped child process 1602, status = succeeded6315worker1 # [ 225.844778] nix-daemon[851]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)6316worker1 # [ 225.857322] nix-daemon[851]: reaped child process 1620, status = succeeded6317lb # [ 225.868892] niks3-server[1127]: 2026/09/20 08:19:07 INFO Received uploads request method=POST path=/api/pending_closures6318worker1 # [ 225.876916] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.041Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6319worker1 # [ 225.882043] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.043Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6320lb # [ 225.901167] niks3-server[1127]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6321lb # [ 225.914281] niks3-server[1127]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6322lb # [ 225.923784] niks3-server[1127]: 2026/09/20 08:19:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6323worker1 # [ 225.930894] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.095Z level=INFO msg="Uploading 1 narinfos"6324lb # [ 225.929153] niks3-server[1127]: 2026/09/20 08:19:07 INFO Signed narinfos id=45 count=16325lb # [ 225.935662] niks3-server[1127]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6326lb # [ 225.944482] niks3-server[1127]: 2026/09/20 08:19:07 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6327lb # [ 225.950706] niks3-server[1127]: 2026/09/20 08:19:07 INFO Completed upload id=456328worker1 # [ 225.952680] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.117Z level=INFO msg="Upload complete. (273ms)"6329lb # [ 225.952576] niks3-server[1127]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6330worker1 # [ 225.966339] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16331worker1 # [ 225.970715] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16332worker1 # [ 225.975201] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06333worker1 # [ 225.983420] nix-daemon[851]: reaped child process 1600, status = succeeded6334worker1 # [ 226.007338] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626335worker1 # [ 226.018928] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626336worker1 # [ 226.030451] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626337worker1 # [ 226.038506] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6338worker1 # [ 226.195324] nix-daemon[851]: accepted connection from pid 1626, user nix-grpc-daemon (trusted)6339worker1 # [ 226.209409] nix-daemon[851]: reaped child process 1629, status = succeeded6340worker1 # [ 226.346391] nix-daemon[851]: accepted connection from pid 1631, user nix-grpc-daemon (trusted)6341worker1 # [ 226.359349] nix-daemon[851]: reaped child process 1634, status = succeeded6342lb # [ 226.367523] niks3-server[1127]: 2026/09/20 08:19:08 INFO Received uploads request method=POST path=/api/pending_closures6343worker1 # [ 226.377669] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6344worker1 # [ 226.379570] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.544Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6345lb # [ 226.395229] niks3-server[1127]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6346lb # [ 226.408686] niks3-server[1127]: 2026/09/20 08:19:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6347worker1 # [ 226.415135] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.579Z level=INFO msg="Uploading 1 narinfos"6348lb # [ 226.413156] niks3-server[1127]: 2026/09/20 08:19:08 INFO Signed narinfos id=46 count=16349lb # [ 226.421631] niks3-server[1127]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6350lb # [ 226.430502] niks3-server[1127]: 2026/09/20 08:19:08 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6351worker1 # [ 226.438587] nix-grpc-daemon[1402]: time=2026-09-20T08:19:08.603Z level=INFO msg="Upload complete. (388ms)"6352lb # [ 226.436791] niks3-server[1127]: 2026/09/20 08:19:08 INFO Completed upload id=466353worker1 # [ 226.441247] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=5046354lb # [ 226.440707] niks3-server[1127]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6355worker1 # [ 226.446638] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626356worker1 # [ 226.455261] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6357worker1 # [ 226.461068] nix-daemon[851]: reaped child process 1624, status = succeeded6358worker1 # [ 226.465730] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6359worker1 # [ 227.481108] nix-daemon[851]: reaped child process 1638, status = succeeded6360worker1 # [ 227.618557] nix-daemon[851]: accepted connection from pid 1653, user nix-grpc-daemon (trusted)6361worker1 # [ 227.630146] nix-daemon[851]: reaped child process 1656, status = succeeded6362lb # [ 227.643674] niks3-server[1127]: 2026/09/20 08:19:09 INFO Received uploads request method=POST path=/api/pending_closures6363worker1 # [ 227.653755] nix-grpc-daemon[1402]: time=2026-09-20T08:19:09.818Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6364worker1 # [ 227.656061] nix-grpc-daemon[1402]: time=2026-09-20T08:19:09.820Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6365lb # [ 227.684127] niks3-server[1127]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6366lb # [ 227.690365] niks3-server[1127]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6367lb # [ 227.701068] niks3-server[1127]: 2026/09/20 08:19:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6368worker1 # [ 227.707611] nix-grpc-daemon[1402]: time=2026-09-20T08:19:09.872Z level=INFO msg="Uploading 1 narinfos"6369lb # [ 227.706187] niks3-server[1127]: 2026/09/20 08:19:09 INFO Signed narinfos id=47 count=16370lb # [ 227.712190] niks3-server[1127]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6371lb # [ 227.721314] niks3-server[1127]: 2026/09/20 08:19:09 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6372lb # [ 227.726432] niks3-server[1127]: 2026/09/20 08:19:09 INFO Completed upload id=476373worker1 # [ 227.728435] nix-grpc-daemon[1402]: time=2026-09-20T08:19:09.893Z level=INFO msg="Upload complete. (256ms)"6374lb # [ 227.730165] niks3-server[1127]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6375worker1 # [ 227.740406] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16376worker1 # [ 227.747115] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:09Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16377worker1 # [ 227.750652] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626378worker1 # [ 227.753821] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:09Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06379worker1 # [ 227.762609] nix-daemon[851]: reaped child process 1636, status = succeeded6380worker1 # [ 227.764165] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626381worker1 # [ 227.769273] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626382worker1 # [ 227.774107] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6383worker1 # [ 227.919568] nix-daemon[851]: accepted connection from pid 1662, user nix-grpc-daemon (trusted)6384worker1 # [ 227.933512] nix-daemon[851]: reaped child process 1665, status = succeeded6385worker1 # [ 228.088308] nix-daemon[851]: accepted connection from pid 1667, user nix-grpc-daemon (trusted)6386worker1 # [ 228.101581] nix-daemon[851]: reaped child process 1670, status = succeeded6387lb # [ 228.114506] niks3-server[1127]: 2026/09/20 08:19:09 INFO Received uploads request method=POST path=/api/pending_closures6388worker1 # [ 228.124026] nix-grpc-daemon[1402]: time=2026-09-20T08:19:10.288Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6389worker1 # [ 228.125526] nix-grpc-daemon[1402]: time=2026-09-20T08:19:10.290Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6390lb # [ 228.144983] niks3-server[1127]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6391lb # [ 228.154947] niks3-server[1127]: 2026/09/20 08:19:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6392worker1 # [ 228.164299] nix-grpc-daemon[1402]: time=2026-09-20T08:19:10.329Z level=INFO msg="Uploading 1 narinfos"6393lb # [ 228.163218] niks3-server[1127]: 2026/09/20 08:19:09 INFO Signed narinfos id=48 count=16394lb # [ 228.170113] niks3-server[1127]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6395lb # [ 228.186223] niks3-server[1127]: 2026/09/20 08:19:09 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6396lb # [ 228.191056] niks3-server[1127]: 2026/09/20 08:19:09 INFO Completed upload id=486397lb # [ 228.193997] niks3-server[1127]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6398worker1 # [ 228.195496] nix-grpc-daemon[1402]: time=2026-09-20T08:19:10.360Z level=INFO msg="Upload complete. (416ms)"6399worker1 # [ 228.199552] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=5046400worker1 # [ 228.206498] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626401worker1 # [ 228.216250] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6402worker1 # [ 228.225558] nix-daemon[851]: reaped child process 1660, status = succeeded6403worker1 # [ 228.233158] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6404lb # [ 228.336200] envoy[989]: conn peer=[2001:db8:1::1]:55656 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9433 tx=3784 ms=52726405lb # [ 228.339827] envoy[989]: conn peer=[2001:db8:1::1]:59760 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1334 ms=112406406lb # [ 228.343475] envoy[989]: conn peer=[2001:db8:1::4]:38122 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2354 tx=777 ms=1193366407worker1 # [ 229.648206] nix-daemon[851]: reaped child process 1674, status = succeeded6408worker1 # [ 229.776319] nix-daemon[851]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6409worker1 # [ 229.789378] nix-daemon[851]: reaped child process 1692, status = succeeded6410lb # [ 229.798171] niks3-server[1127]: 2026/09/20 08:19:11 INFO Received uploads request method=POST path=/api/pending_closures6411worker1 # [ 229.804464] nix-grpc-daemon[1402]: time=2026-09-20T08:19:11.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6412worker1 # [ 229.806085] nix-grpc-daemon[1402]: time=2026-09-20T08:19:11.971Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6413lb # [ 229.818542] niks3-server[1127]: 2026/09/20 08:19:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6414worker1 # [ 229.822478] nix-grpc-daemon[1402]: time=2026-09-20T08:19:11.987Z level=INFO msg="Uploading 1 narinfos"6415lb # [ 229.821297] niks3-server[1127]: 2026/09/20 08:19:11 INFO Signed narinfos id=49 count=16416lb # [ 229.826121] niks3-server[1127]: 2026/09/20 08:19:11 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6417lb # [ 229.831238] niks3-server[1127]: 2026/09/20 08:19:11 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6418lb # [ 229.838144] niks3-server[1127]: 2026/09/20 08:19:11 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6419lb # [ 229.843743] niks3-server[1127]: 2026/09/20 08:19:11 INFO Completed upload id=496420worker1 # [ 229.845512] nix-grpc-daemon[1402]: time=2026-09-20T08:19:12.010Z level=INFO msg="Upload complete. (204ms)"6421worker1 # [ 229.847841] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16422lb # [ 229.847154] niks3-server[1127]: 2026/09/20 08:19:11 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6423lb # [ 229.851025] niks3-server[1127]: 2026/09/20 08:19:11 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6424worker1 # [ 229.853582] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16425worker1 # [ 229.855470] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626426worker1 # [ 229.859245] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06427worker1 # [ 229.864273] nix-daemon[851]: reaped child process 1672, status = succeeded6428worker1 # [ 229.865566] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626429worker1 # [ 229.871218] nix-grpc-daemon[1402]: time=2026-09-20T08:19:12.036Z level=INFO msg="All 1 paths already cached"6430worker1 # [ 229.874757] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626431worker1 # [ 229.878397] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6432worker1 # [ 230.039282] nix-daemon[851]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)6433worker1 # [ 230.052477] nix-daemon[851]: reaped child process 1701, status = succeeded6434worker1 # [ 230.223441] nix-daemon[851]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)6435worker1 # [ 230.236409] nix-daemon[851]: reaped child process 1706, status = succeeded6436lb # [ 230.249651] niks3-server[1127]: 2026/09/20 08:19:11 INFO Received uploads request method=POST path=/api/pending_closures6437worker1 # [ 230.257637] nix-grpc-daemon[1402]: time=2026-09-20T08:19:12.422Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6438worker1 # [ 230.259019] nix-grpc-daemon[1402]: time=2026-09-20T08:19:12.422Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6439lb # [ 230.264562] niks3-server[1127]: 2026/09/20 08:19:11 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6440lb # [ 230.269707] niks3-server[1127]: 2026/09/20 08:19:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6441lb # [ 230.272974] niks3-server[1127]: 2026/09/20 08:19:11 INFO Signed narinfos id=50 count=16442worker1 # [ 230.274746] nix-grpc-daemon[1402]: time=2026-09-20T08:19:12.439Z level=INFO msg="Uploading 1 narinfos"6443lb # [ 230.275178] niks3-server[1127]: 2026/09/20 08:19:11 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6444lb # [ 230.280656] niks3-server[1127]: 2026/09/20 08:19:11 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6445lb # [ 230.284730] niks3-server[1127]: 2026/09/20 08:19:11 INFO Completed upload id=506446worker1 # [ 230.286538] nix-grpc-daemon[1402]: time=2026-09-20T08:19:12.451Z level=INFO msg="Upload complete. (402ms)"6447worker1 # [ 230.288599] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=6246448lb # [ 230.287301] niks3-server[1127]: 2026/09/20 08:19:11 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6449worker1 # [ 230.291714] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626450worker1 # [ 230.296273] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6451worker1 # [ 230.301481] nix-daemon[851]: reaped child process 1696, status = succeeded6452worker1 # [ 230.305985] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6453worker1 # [ 231.332641] nix-daemon[851]: reaped child process 1710, status = succeeded6454worker1 # [ 231.462564] nix-daemon[851]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6455worker1 # [ 231.475805] nix-daemon[851]: reaped child process 1728, status = succeeded6456lb # [ 231.483288] niks3-server[1127]: 2026/09/20 08:19:13 INFO Received uploads request method=POST path=/api/pending_closures6457worker1 # [ 231.491316] nix-grpc-daemon[1402]: time=2026-09-20T08:19:13.654Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6458worker1 # [ 231.495089] nix-grpc-daemon[1402]: time=2026-09-20T08:19:13.654Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6459lb # [ 231.508232] niks3-server[1127]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6460lb # [ 231.510735] niks3-server[1127]: 2026/09/20 08:19:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6461lb # [ 231.513171] niks3-server[1127]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6462lb # [ 231.515296] niks3-server[1127]: 2026/09/20 08:19:13 INFO Signed narinfos id=51 count=16463worker1 # [ 231.517112] nix-grpc-daemon[1402]: time=2026-09-20T08:19:13.681Z level=INFO msg="Uploading 1 narinfos"6464lb # [ 231.517943] niks3-server[1127]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6465lb # [ 231.522618] niks3-server[1127]: 2026/09/20 08:19:13 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6466lb # [ 231.525146] niks3-server[1127]: 2026/09/20 08:19:13 INFO Completed upload id=516467worker1 # [ 231.528114] nix-grpc-daemon[1402]: time=2026-09-20T08:19:13.693Z level=INFO msg="Upload complete. (210ms)"6468lb # [ 231.527646] niks3-server[1127]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6469worker1 # [ 231.530508] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16470worker1 # [ 231.534369] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:13Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16471worker1 # [ 231.536597] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626472worker1 # [ 231.541620] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:13Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06473worker1 # [ 231.546667] nix-daemon[851]: reaped child process 1708, status = succeeded6474worker1 # [ 231.579417] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626475worker1 # [ 231.586396] nix-grpc-daemon[1402]: time=2026-09-20T08:19:13.751Z level=INFO msg="All 1 paths already cached"6476worker1 # [ 231.591255] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626477worker1 # [ 231.595265] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6478worker1 # [ 231.733079] nix-daemon[851]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)6479worker1 # [ 231.747443] nix-daemon[851]: reaped child process 1737, status = succeeded6480worker1 # [ 231.894073] nix-daemon[851]: accepted connection from pid 1739, user nix-grpc-daemon (trusted)6481worker1 # [ 231.906881] nix-daemon[851]: reaped child process 1742, status = succeeded6482lb # [ 231.914258] niks3-server[1127]: 2026/09/20 08:19:13 INFO Received uploads request method=POST path=/api/pending_closures6483worker1 # [ 231.920909] nix-grpc-daemon[1402]: time=2026-09-20T08:19:14.085Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6484worker1 # [ 231.922280] nix-grpc-daemon[1402]: time=2026-09-20T08:19:14.085Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6485lb # [ 231.928402] niks3-server[1127]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6486lb # [ 231.931524] niks3-server[1127]: 2026/09/20 08:19:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6487lb # [ 231.934431] niks3-server[1127]: 2026/09/20 08:19:13 INFO Signed narinfos id=52 count=16488worker1 # [ 231.937789] nix-grpc-daemon[1402]: time=2026-09-20T08:19:14.102Z level=INFO msg="Uploading 1 narinfos"6489lb # [ 231.937906] niks3-server[1127]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6490lb # [ 231.942250] niks3-server[1127]: 2026/09/20 08:19:13 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6491lb # [ 231.946459] niks3-server[1127]: 2026/09/20 08:19:13 INFO Completed upload id=526492worker1 # [ 231.948306] nix-grpc-daemon[1402]: time=2026-09-20T08:19:14.113Z level=INFO msg="Upload complete. (347ms)"6493lb # [ 231.948202] niks3-server[1127]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6494worker1 # [ 231.950246] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=6246495worker1 # [ 231.954443] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626496worker1 # [ 231.960163] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6497worker1 # [ 231.962438] nix-daemon[851]: reaped child process 1732, status = succeeded6498worker1 # [ 231.967497] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6499worker1 # [ 233.195927] nix-daemon[851]: reaped child process 1746, status = succeeded6500worker1 # [ 233.340625] nix-daemon[851]: accepted connection from pid 1761, user nix-grpc-daemon (trusted)6501worker1 # [ 233.353677] nix-daemon[851]: reaped child process 1764, status = succeeded6502lb # [ 233.365972] niks3-server[1127]: 2026/09/20 08:19:15 INFO Received uploads request method=POST path=/api/pending_closures6503worker1 # [ 233.373041] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.537Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6504worker1 # [ 233.375353] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.539Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6505lb # [ 233.384973] niks3-server[1127]: 2026/09/20 08:19:15 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6506lb # [ 233.388122] niks3-server[1127]: 2026/09/20 08:19:15 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6507lb # [ 233.391732] niks3-server[1127]: 2026/09/20 08:19:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6508lb # [ 233.394366] niks3-server[1127]: 2026/09/20 08:19:15 INFO Signed narinfos id=53 count=16509worker1 # [ 233.397549] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.562Z level=INFO msg="Uploading 1 narinfos"6510lb # [ 233.397234] niks3-server[1127]: 2026/09/20 08:19:15 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6511lb # [ 233.402466] niks3-server[1127]: 2026/09/20 08:19:15 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6512lb # [ 233.405380] niks3-server[1127]: 2026/09/20 08:19:15 INFO Completed upload id=536513worker1 # [ 233.407228] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.572Z level=INFO msg="Upload complete. (231ms)"6514lb # [ 233.406915] niks3-server[1127]: 2026/09/20 08:19:15 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6515worker1 # [ 233.409632] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16516worker1 # [ 233.413280] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16517worker1 # [ 233.417612] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626518worker1 # [ 233.419583] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06519worker1 # [ 233.426222] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626520worker1 # [ 233.428446] nix-daemon[851]: reaped child process 1744, status = succeeded6521worker1 # [ 233.432128] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.597Z level=INFO msg="All 1 paths already cached"6522worker1 # [ 233.435754] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626523worker1 # [ 233.440545] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6524worker1 # [ 233.581651] nix-daemon[851]: accepted connection from pid 1770, user nix-grpc-daemon (trusted)6525worker1 # [ 233.594372] nix-daemon[851]: reaped child process 1773, status = succeeded6526worker1 # [ 233.722025] nix-daemon[851]: accepted connection from pid 1775, user nix-grpc-daemon (trusted)6527worker1 # [ 233.734541] nix-daemon[851]: reaped child process 1778, status = succeeded6528lb # [ 233.742192] niks3-server[1127]: 2026/09/20 08:19:15 INFO Received uploads request method=POST path=/api/pending_closures6529worker1 # [ 233.751346] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.916Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6530worker1 # [ 233.752832] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.917Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6531lb # [ 233.761935] niks3-server[1127]: 2026/09/20 08:19:15 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6532lb # [ 233.764799] niks3-server[1127]: 2026/09/20 08:19:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6533lb # [ 233.766803] niks3-server[1127]: 2026/09/20 08:19:15 INFO Signed narinfos id=54 count=16534worker1 # [ 233.768398] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.933Z level=INFO msg="Uploading 1 narinfos"6535lb # [ 233.769459] niks3-server[1127]: 2026/09/20 08:19:15 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6536lb # [ 233.774402] niks3-server[1127]: 2026/09/20 08:19:15 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6537lb # [ 233.777876] niks3-server[1127]: 2026/09/20 08:19:15 INFO Completed upload id=546538worker1 # [ 233.779584] nix-grpc-daemon[1402]: time=2026-09-20T08:19:15.944Z level=INFO msg="Upload complete. (334ms)"6539lb # [ 233.779537] niks3-server[1127]: 2026/09/20 08:19:15 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6540worker1 # [ 233.781566] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=6246541worker1 # [ 233.785642] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626542worker1 # [ 233.792199] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6543worker1 # [ 233.793603] nix-daemon[851]: reaped child process 1768, status = succeeded6544worker1 # [ 233.798805] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6545worker1 # [ 234.827589] nix-daemon[851]: reaped child process 1782, status = succeeded6546worker1 # [ 234.979489] nix-daemon[851]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6547worker1 # [ 234.991149] nix-daemon[851]: reaped child process 1800, status = succeeded6548lb # [ 235.006359] niks3-server[1127]: 2026/09/20 08:19:16 INFO Received uploads request method=POST path=/api/pending_closures6549worker1 # [ 235.013977] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.178Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6550worker1 # [ 235.017056] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.180Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6551lb # [ 235.024131] niks3-server[1127]: 2026/09/20 08:19:16 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6552lb # [ 235.029754] niks3-server[1127]: 2026/09/20 08:19:16 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6553lb # [ 235.031884] niks3-server[1127]: 2026/09/20 08:19:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6554lb # [ 235.033573] niks3-server[1127]: 2026/09/20 08:19:16 INFO Signed narinfos id=55 count=16555worker1 # [ 235.036732] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.201Z level=INFO msg="Uploading 1 narinfos"6556lb # [ 235.037688] niks3-server[1127]: 2026/09/20 08:19:16 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6557lb # [ 235.042293] niks3-server[1127]: 2026/09/20 08:19:16 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6558lb # [ 235.045297] niks3-server[1127]: 2026/09/20 08:19:16 INFO Completed upload id=556559worker1 # [ 235.047141] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.212Z level=INFO msg="Upload complete. (241ms)"6560lb # [ 235.046886] niks3-server[1127]: 2026/09/20 08:19:16 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6561worker1 # [ 235.049563] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16562worker1 # [ 235.054121] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16563worker1 # [ 235.057170] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626564worker1 # [ 235.060237] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06565worker1 # [ 235.066346] nix-daemon[851]: reaped child process 1780, status = succeeded6566worker1 # [ 235.067720] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626567worker1 # [ 235.073447] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.238Z level=INFO msg="All 2 paths already cached"6568worker1 # [ 235.077341] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626569worker1 # [ 235.081325] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6570worker1 # [ 235.239388] nix-daemon[851]: accepted connection from pid 1806, user nix-grpc-daemon (trusted)6571worker1 # [ 235.252158] nix-daemon[851]: reaped child process 1809, status = succeeded6572worker1 # [ 235.415662] nix-daemon[851]: accepted connection from pid 1811, user nix-grpc-daemon (trusted)6573worker1 # [ 235.426909] nix-daemon[851]: reaped child process 1814, status = succeeded6574lb # [ 235.440688] niks3-server[1127]: 2026/09/20 08:19:17 INFO Received uploads request method=POST path=/api/pending_closures6575worker1 # [ 235.450024] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.614Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6576worker1 # [ 235.451391] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.614Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6577lb # [ 235.464727] niks3-server[1127]: 2026/09/20 08:19:17 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6578lb # [ 235.476054] niks3-server[1127]: 2026/09/20 08:19:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6579worker1 # [ 235.482609] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.647Z level=INFO msg="Uploading 1 narinfos"6580lb # [ 235.480711] niks3-server[1127]: 2026/09/20 08:19:17 INFO Signed narinfos id=56 count=16581lb # [ 235.487281] niks3-server[1127]: 2026/09/20 08:19:17 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6582lb # [ 235.498853] niks3-server[1127]: 2026/09/20 08:19:17 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6583lb # [ 235.504358] niks3-server[1127]: 2026/09/20 08:19:17 INFO Completed upload id=566584worker1 # [ 235.508452] nix-grpc-daemon[1402]: time=2026-09-20T08:19:17.673Z level=INFO msg="Upload complete. (421ms)"6585lb # [ 235.507885] niks3-server[1127]: 2026/09/20 08:19:17 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6586worker1 # [ 235.511187] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=7526587worker1 # [ 235.516298] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626588worker1 # [ 235.525424] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6589worker1 # [ 235.532850] nix-daemon[851]: reaped child process 1804, status = succeeded6590worker1 # [ 235.538947] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6591worker1 # [ 236.158762] nix-daemon[851]: reaped child process 1818, status = succeeded6592worker1 # [ 236.300348] nix-daemon[851]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6593worker1 # [ 236.312067] nix-daemon[851]: reaped child process 1836, status = succeeded6594lb # [ 236.326340] niks3-server[1127]: 2026/09/20 08:19:17 INFO Received uploads request method=POST path=/api/pending_closures6595worker1 # [ 236.337332] nix-grpc-daemon[1402]: time=2026-09-20T08:19:18.502Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6596worker1 # [ 236.339834] nix-grpc-daemon[1402]: time=2026-09-20T08:19:18.503Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6597lb # [ 236.357082] niks3-server[1127]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6598lb # [ 236.372458] niks3-server[1127]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6599lb # [ 236.380165] niks3-server[1127]: 2026/09/20 08:19:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6600lb # [ 236.385426] niks3-server[1127]: 2026/09/20 08:19:18 INFO Signed narinfos id=57 count=16601worker1 # [ 236.390032] nix-grpc-daemon[1402]: time=2026-09-20T08:19:18.554Z level=INFO msg="Uploading 1 narinfos"6602lb # [ 236.390908] niks3-server[1127]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6603lb # [ 236.399554] niks3-server[1127]: 2026/09/20 08:19:18 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6604lb # [ 236.404713] niks3-server[1127]: 2026/09/20 08:19:18 INFO Completed upload id=576605worker1 # [ 236.406225] nix-grpc-daemon[1402]: time=2026-09-20T08:19:18.571Z level=INFO msg="Upload complete. (262ms)"6606lb # [ 236.407441] niks3-server[1127]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6607worker1 # [ 236.414927] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16608worker1 # [ 236.419800] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:18Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16609worker1 # [ 236.424354] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626610worker1 # [ 236.433529] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626611worker1 # [ 236.436922] nix-daemon[851]: reaped child process 1816, status = succeeded6612worker1 # [ 236.441727] nix-grpc-daemon[1402]: time=2026-09-20T08:19:18.606Z level=INFO msg="All 2 paths already cached"6613worker1 # [ 236.446438] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626614worker1 # [ 236.450565] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6615worker1 # [ 236.605788] nix-daemon[851]: accepted connection from pid 1840, user nix-grpc-daemon (trusted)6616worker1 # [ 236.618783] nix-daemon[851]: reaped child process 1843, status = succeeded6617worker1 # [ 236.781183] nix-daemon[851]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)6618worker1 # [ 236.793940] nix-daemon[851]: reaped child process 1848, status = succeeded6619lb # [ 236.809153] niks3-server[1127]: 2026/09/20 08:19:18 INFO Received uploads request method=POST path=/api/pending_closures6620worker1 # [ 236.819398] nix-grpc-daemon[1402]: time=2026-09-20T08:19:18.984Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6621worker1 # [ 236.821259] nix-grpc-daemon[1402]: time=2026-09-20T08:19:18.985Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6622lb # [ 236.834646] niks3-server[1127]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6623lb # [ 236.846414] niks3-server[1127]: 2026/09/20 08:19:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6624worker1 # [ 236.853975] nix-grpc-daemon[1402]: time=2026-09-20T08:19:19.018Z level=INFO msg="Uploading 1 narinfos"6625lb # [ 236.852188] niks3-server[1127]: 2026/09/20 08:19:18 INFO Signed narinfos id=58 count=16626lb # [ 236.856433] niks3-server[1127]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6627lb # [ 236.866929] niks3-server[1127]: 2026/09/20 08:19:18 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6628lb # [ 236.872929] niks3-server[1127]: 2026/09/20 08:19:18 INFO Completed upload id=586629worker1 # [ 236.874647] nix-grpc-daemon[1402]: time=2026-09-20T08:19:19.039Z level=INFO msg="Upload complete. (418ms)"6630lb # [ 236.875594] niks3-server[1127]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6631worker1 # [ 236.877992] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=7526632worker1 # [ 236.883886] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626633worker1 # [ 236.891385] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6634worker1 # [ 236.897165] nix-daemon[851]: reaped child process 1838, status = succeeded6635worker1 # [ 236.901969] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6636worker1 # [ 237.926900] nix-daemon[851]: reaped child process 1852, status = succeeded6637worker1 # [ 238.093408] nix-daemon[851]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6638worker1 # [ 238.106317] nix-daemon[851]: reaped child process 1870, status = succeeded6639lb # [ 238.122367] niks3-server[1127]: 2026/09/20 08:19:19 INFO Received uploads request method=POST path=/api/pending_closures6640worker1 # [ 238.132480] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.297Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6641worker1 # [ 238.134085] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.299Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6642lb # [ 238.158224] niks3-server[1127]: 2026/09/20 08:19:19 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6643lb # [ 238.164254] niks3-server[1127]: 2026/09/20 08:19:19 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6644lb # [ 238.177134] niks3-server[1127]: 2026/09/20 08:19:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6645worker1 # [ 238.185198] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.349Z level=INFO msg="Uploading 1 narinfos"6646lb # [ 238.183644] niks3-server[1127]: 2026/09/20 08:19:19 INFO Signed narinfos id=59 count=16647lb # [ 238.187934] niks3-server[1127]: 2026/09/20 08:19:19 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6648lb # [ 238.197271] niks3-server[1127]: 2026/09/20 08:19:19 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6649lb # [ 238.202845] niks3-server[1127]: 2026/09/20 08:19:19 INFO Completed upload id=596650worker1 # [ 238.204566] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.369Z level=INFO msg="Upload complete. (295ms)"6651lb # [ 238.205335] niks3-server[1127]: 2026/09/20 08:19:19 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6652worker1 # [ 238.212728] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16653worker1 # [ 238.219290] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:20Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16654worker1 # [ 238.223691] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626655worker1 # [ 238.234314] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355626656worker1 # [ 238.237297] nix-daemon[851]: reaped child process 1850, status = succeeded6657worker1 # [ 238.242431] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.407Z level=INFO msg="All 2 paths already cached"6658worker1 # [ 238.246665] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355626659worker1 # [ 238.251719] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6660worker1 # [ 238.406064] nix-daemon[851]: accepted connection from pid 1874, user nix-grpc-daemon (trusted)6661worker1 # [ 238.419142] nix-daemon[851]: reaped child process 1877, status = succeeded6662worker1 # [ 238.577919] nix-daemon[851]: accepted connection from pid 1879, user nix-grpc-daemon (trusted)6663worker1 # [ 238.589293] nix-daemon[851]: reaped child process 1882, status = succeeded6664lb # [ 238.602827] niks3-server[1127]: 2026/09/20 08:19:20 INFO Received uploads request method=POST path=/api/pending_closures6665worker1 # [ 238.612460] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.777Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6666worker1 # [ 238.614020] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.778Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6667lb # [ 238.630948] niks3-server[1127]: 2026/09/20 08:19:20 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6668lb # [ 238.643149] niks3-server[1127]: 2026/09/20 08:19:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6669lb # [ 238.647144] niks3-server[1127]: 2026/09/20 08:19:20 INFO Signed narinfos id=60 count=16670worker1 # [ 238.653200] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.818Z level=INFO msg="Uploading 1 narinfos"6671lb # [ 238.654593] niks3-server[1127]: 2026/09/20 08:19:20 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6672lb # [ 238.666444] niks3-server[1127]: 2026/09/20 08:19:20 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6673worker1 # [ 238.674202] nix-grpc-daemon[1402]: time=2026-09-20T08:19:20.839Z level=INFO msg="Upload complete. (417ms)"6674lb # [ 238.672372] niks3-server[1127]: 2026/09/20 08:19:20 INFO Completed upload id=606675lb # [ 238.674805] niks3-server[1127]: 2026/09/20 08:19:20 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6676worker1 # [ 238.678073] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=0 paths=1 nar_bytes_in=7526677worker1 # [ 238.682705] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355626678worker1 # [ 238.688286] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6679worker1 # [ 238.690546] nix-daemon[851]: reaped child process 1872, status = succeeded6680worker1 # [ 238.695863] nix-daemon[851]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)6681worker1 # [ 239.721405] nix-daemon[851]: reaped child process 1886, status = succeeded6682worker1 # [ 239.875331] nix-daemon[851]: accepted connection from pid 1901, user nix-grpc-daemon (trusted)6683worker1 # [ 239.886964] nix-daemon[851]: reaped child process 1904, status = succeeded6684lb # [ 239.902508] niks3-server[1127]: 2026/09/20 08:19:21 INFO Received uploads request method=POST path=/api/pending_closures6685worker1 # [ 239.913181] nix-grpc-daemon[1402]: time=2026-09-20T08:19:22.077Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6686worker1 # [ 239.914654] nix-grpc-daemon[1402]: time=2026-09-20T08:19:22.077Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6687lb # [ 239.933275] niks3-server[1127]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6688lb # [ 239.946139] niks3-server[1127]: 2026/09/20 08:19:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6689lb # [ 239.953634] niks3-server[1127]: 2026/09/20 08:19:21 INFO Signed narinfos id=61 count=16690worker1 # [ 239.958700] nix-grpc-daemon[1402]: time=2026-09-20T08:19:22.123Z level=INFO msg="Uploading 1 narinfos"6691lb # [ 239.959548] niks3-server[1127]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6692lb # [ 239.963234] niks3-server[1127]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6693lb # [ 239.971926] niks3-server[1127]: 2026/09/20 08:19:21 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6694lb # [ 239.980725] niks3-server[1127]: 2026/09/20 08:19:21 INFO Completed upload id=616695lb # [ 239.982502] niks3-server[1127]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6696worker1 # [ 239.982861] nix-grpc-daemon[1402]: time=2026-09-20T08:19:22.147Z level=INFO msg="Upload complete. (279ms)"6697worker1 # [ 239.991279] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35562 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16698worker1 # [ 240.003182] nix-daemon[851]: reaped child process 1884, status = succeeded6699client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.26 seconds)6700worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6701worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6702client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16703worker1 # [ 240.316277] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355626704worker1 # [ 240.327717] nix-grpc-daemon[1334]: ts=2026-09-20T08:19:22Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06705lb # [ 248.337228] envoy[989]: conn peer=[2001:db8:1::1]:43178 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26817 tx=10566 ms=160376706lb # [ 313.866941] postgres[871]: [871] LOG: checkpoint starting: time6707client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.25 seconds)6708(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 136.58 seconds)6709subtest: low disk drains a worker and builds go to the other6710worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6711worker1 # [ 361.286236] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:23Z level=info event=unhealthy reason=min_free6712worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.96 seconds)6713worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6714worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.04 seconds)6715client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26716worker1 # [ 361.535781] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355626717client # don't know how to build these paths:6718client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6719worker1 # [ 361.547442] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:23Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06720worker1 # [ 361.549263] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:23Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16721worker2 # [ 361.564764] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380566722worker2 # [ 361.570861] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6723worker2 # [ 361.578597] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)6724worker2 # [ 361.634072] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 2/5)6725worker2 # [ 361.749990] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 3/5)6726worker2 # [ 361.939915] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 679 ms (attempt 4/5)6727worker2 # [ 362.622655] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6728worker2 # [ 362.639454] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380566729client # copying 1 paths to 'lb:50051'...6730worker2 # [ 362.648622] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:380566731client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6732worker2 # [ 362.655641] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6733worker2 # [ 362.665919] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:24Z level=info event=niks3_push_started pid=19466734worker2 # [ 362.971534] nix-daemon[911]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)6735worker2 # [ 362.983830] nix-daemon[911]: reaped child process 1962, status = succeeded6736worker2 # [ 363.135483] nix-daemon[911]: accepted connection from pid 1964, user nix-grpc-daemon (trusted)6737worker2 # [ 363.147729] nix-daemon[911]: reaped child process 1967, status = succeeded6738lb # [ 363.152325] niks3-server[1127]: 2026/09/20 08:21:24 INFO Received uploads request method=POST path=/api/pending_closures6739worker2 # [ 363.174986] nix-grpc-daemon[1946]: time=2026-09-20T08:21:25.122Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6740worker2 # [ 363.176587] nix-grpc-daemon[1946]: time=2026-09-20T08:21:25.124Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6741lb # [ 363.191515] niks3-server[1127]: 2026/09/20 08:21:24 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6742lb # [ 363.200800] niks3-server[1127]: 2026/09/20 08:21:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6743worker2 # [ 363.217900] nix-grpc-daemon[1946]: time=2026-09-20T08:21:25.165Z level=INFO msg="Uploading 1 narinfos"6744lb # [ 363.206968] niks3-server[1127]: 2026/09/20 08:21:24 INFO Signed narinfos id=62 count=16745lb # [ 363.220897] niks3-server[1127]: 2026/09/20 08:21:24 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6746lb # [ 363.226490] niks3-server[1127]: 2026/09/20 08:21:24 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6747lb # [ 363.232715] niks3-server[1127]: 2026/09/20 08:21:24 INFO Completed upload id=626748worker2 # [ 363.245545] nix-grpc-daemon[1946]: time=2026-09-20T08:21:25.193Z level=INFO msg="Upload complete. (419ms)"6749lb # [ 363.236687] niks3-server[1127]: 2026/09/20 08:21:24 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6750worker2 # [ 363.249075] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38056 duration_s=0 paths=1 nar_bytes_in=5126751worker2 # [ 363.252213] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380566752worker2 # [ 363.258532] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6753worker2 # [ 363.260938] nix-daemon[911]: reaped child process 1944, status = succeeded6754worker2 # [ 363.266254] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6755client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6756client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6757client # farm-a> LOG-farm-a-drain6758worker2 # [ 364.480719] nix-daemon[911]: reaped child process 1971, status = succeeded6759worker2 # [ 364.611781] nix-daemon[911]: accepted connection from pid 1986, user nix-grpc-daemon (trusted)6760worker2 # [ 364.624167] nix-daemon[911]: reaped child process 1989, status = succeeded6761lb # [ 364.628341] niks3-server[1127]: 2026/09/20 08:21:26 INFO Received uploads request method=POST path=/api/pending_closures6762worker2 # [ 364.647767] nix-grpc-daemon[1946]: time=2026-09-20T08:21:26.595Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6763worker2 # [ 364.649851] nix-grpc-daemon[1946]: time=2026-09-20T08:21:26.597Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6764lb # [ 364.669056] niks3-server[1127]: 2026/09/20 08:21:26 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6765lb # [ 364.676433] niks3-server[1127]: 2026/09/20 08:21:26 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6766lb # [ 364.685884] niks3-server[1127]: 2026/09/20 08:21:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6767worker2 # [ 364.701194] nix-grpc-daemon[1946]: time=2026-09-20T08:21:26.649Z level=INFO msg="Uploading 1 narinfos"6768lb # [ 364.690297] niks3-server[1127]: 2026/09/20 08:21:26 INFO Signed narinfos id=63 count=16769lb # [ 364.694786] niks3-server[1127]: 2026/09/20 08:21:26 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6770lb # [ 364.704232] niks3-server[1127]: 2026/09/20 08:21:26 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6771lb # [ 364.707053] niks3-server[1127]: 2026/09/20 08:21:26 INFO Completed upload id=636772worker2 # [ 364.718875] nix-grpc-daemon[1946]: time=2026-09-20T08:21:26.666Z level=INFO msg="Upload complete. (245ms)"6773lb # [ 364.708901] niks3-server[1127]: 2026/09/20 08:21:26 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6774worker2 # [ 364.721370] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38056 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16775worker2 # [ 364.728677] nix-daemon[911]: reaped child process 1969, status = succeeded6776worker1 # [ 364.719895] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:26Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06777worker1 # [ 364.724341] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:26Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16778worker2 # [ 364.771971] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380566779worker2 # [ 364.780376] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380566780worker2 # [ 364.789225] nix-grpc-daemon[1946]: time=2026-09-20T08:21:26.737Z level=INFO msg="All 1 paths already cached"6781client # copying 1 paths to 'lb:50051'...6782client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6783worker2 # [ 364.797729] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:380566784worker2 # [ 364.807160] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6785worker2 # [ 364.961927] nix-daemon[911]: accepted connection from pid 1993, user nix-grpc-daemon (trusted)6786worker2 # [ 364.974368] nix-daemon[911]: reaped child process 1996, status = succeeded6787worker2 # [ 365.125524] nix-daemon[911]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)6788worker2 # [ 365.138141] nix-daemon[911]: reaped child process 2001, status = succeeded6789lb # [ 365.138798] niks3-server[1127]: 2026/09/20 08:21:26 INFO Received uploads request method=POST path=/api/pending_closures6790worker2 # [ 365.159437] nix-grpc-daemon[1946]: time=2026-09-20T08:21:27.107Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6791worker2 # [ 365.160873] nix-grpc-daemon[1946]: time=2026-09-20T08:21:27.107Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6792lb # [ 365.166896] niks3-server[1127]: 2026/09/20 08:21:26 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6793lb # [ 365.177635] niks3-server[1127]: 2026/09/20 08:21:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6794worker2 # [ 365.193327] nix-grpc-daemon[1946]: time=2026-09-20T08:21:27.141Z level=INFO msg="Uploading 1 narinfos"6795lb # [ 365.182746] niks3-server[1127]: 2026/09/20 08:21:26 INFO Signed narinfos id=64 count=16796lb # [ 365.187956] niks3-server[1127]: 2026/09/20 08:21:26 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6797lb # [ 365.199116] niks3-server[1127]: 2026/09/20 08:21:26 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6798worker2 # [ 365.216051] nix-grpc-daemon[1946]: time=2026-09-20T08:21:27.164Z level=INFO msg="Upload complete. (398ms)"6799lb # [ 365.205445] niks3-server[1127]: 2026/09/20 08:21:26 INFO Completed upload id=646800worker2 # [ 365.218090] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38056 duration_s=0 paths=1 nar_bytes_in=6246801lb # [ 365.208555] niks3-server[1127]: 2026/09/20 08:21:26 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6802worker2 # [ 365.223419] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380566803worker2 # [ 365.228624] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6804worker2 # [ 365.230932] nix-daemon[911]: reaped child process 1991, status = succeeded6805worker2 # [ 365.235894] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6806client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6807client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6808client # farm-b> LOG-farm-b-drain6809worker2 # [ 366.051275] nix-daemon[911]: reaped child process 2005, status = succeeded6810worker2 # [ 366.144170] nix-daemon[911]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)6811worker2 # [ 366.156684] nix-daemon[911]: reaped child process 2023, status = succeeded6812lb # [ 366.154677] niks3-server[1127]: 2026/09/20 08:21:27 INFO Received uploads request method=POST path=/api/pending_closures6813worker2 # [ 366.173876] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.121Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6814worker2 # [ 366.175319] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.123Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6815lb # [ 366.183552] niks3-server[1127]: 2026/09/20 08:21:27 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6816lb # [ 366.201777] niks3-server[1127]: 2026/09/20 08:21:27 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6817lb # [ 366.206533] niks3-server[1127]: 2026/09/20 08:21:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6818worker2 # [ 366.221373] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.169Z level=INFO msg="Uploading 1 narinfos"6819lb # [ 366.211233] niks3-server[1127]: 2026/09/20 08:21:27 INFO Signed narinfos id=65 count=16820lb # [ 366.224150] niks3-server[1127]: 2026/09/20 08:21:27 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6821lb # [ 366.230639] niks3-server[1127]: 2026/09/20 08:21:27 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6822lb # [ 366.233192] niks3-server[1127]: 2026/09/20 08:21:27 INFO Completed upload id=656823worker2 # [ 366.243859] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.191Z level=INFO msg="Upload complete. (201ms)"6824lb # [ 366.235778] niks3-server[1127]: 2026/09/20 08:21:27 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6825worker2 # [ 366.247256] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38056 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16826worker1 # [ 366.246108] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:28Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06827worker2 # [ 366.258691] nix-daemon[911]: reaped child process 2003, status = succeeded6828worker1 # [ 366.250187] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:28Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16829worker2 # [ 366.297740] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380566830worker2 # [ 366.308730] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:380566831worker2 # [ 366.320711] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.268Z level=INFO msg="All 2 paths already cached"6832client # copying 1 paths to 'lb:50051'...6833client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6834worker2 # [ 366.328661] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:380566835worker2 # [ 366.336722] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6836worker2 # [ 366.476430] nix-daemon[911]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)6837worker2 # [ 366.488937] nix-daemon[911]: reaped child process 2030, status = succeeded6838worker2 # [ 366.650527] nix-daemon[911]: accepted connection from pid 2032, user nix-grpc-daemon (trusted)6839worker2 # [ 366.662706] nix-daemon[911]: reaped child process 2035, status = succeeded6840lb # [ 366.666893] niks3-server[1127]: 2026/09/20 08:21:28 INFO Received uploads request method=POST path=/api/pending_closures6841worker2 # [ 366.681579] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.629Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6842worker2 # [ 366.683138] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.631Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6843lb # [ 366.683772] niks3-server[1127]: 2026/09/20 08:21:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6844lb # [ 366.685759] niks3-server[1127]: 2026/09/20 08:21:28 INFO Signed narinfos id=66 count=16845worker2 # [ 366.696314] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.644Z level=INFO msg="Uploading 1 narinfos"6846lb # [ 366.686809] niks3-server[1127]: 2026/09/20 08:21:28 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6847lb # [ 366.692576] niks3-server[1127]: 2026/09/20 08:21:28 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6848lb # [ 366.695600] niks3-server[1127]: 2026/09/20 08:21:28 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6849lb # [ 366.698279] niks3-server[1127]: 2026/09/20 08:21:28 INFO Completed upload id=666850worker2 # [ 366.710085] nix-grpc-daemon[1946]: time=2026-09-20T08:21:28.658Z level=INFO msg="Upload complete. (360ms)"6851lb # [ 366.700471] niks3-server[1127]: 2026/09/20 08:21:28 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6852worker2 # [ 366.711968] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38056 duration_s=0 paths=1 nar_bytes_in=7526853worker2 # [ 366.715252] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:380566854worker2 # [ 366.719629] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6855worker2 # [ 366.724208] nix-daemon[911]: reaped child process 2025, status = succeeded6856worker2 # [ 366.728962] nix-daemon[911]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6857client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6858client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6859client # farm-top> LOG-farm-top-drain6860worker2 # [ 367.943353] nix-daemon[911]: reaped child process 2039, status = succeeded6861worker2 # [ 368.070515] nix-daemon[911]: accepted connection from pid 2054, user nix-grpc-daemon (trusted)6862worker2 # [ 368.083644] nix-daemon[911]: reaped child process 2057, status = succeeded6863lb # [ 368.084367] niks3-server[1127]: 2026/09/20 08:21:29 INFO Received uploads request method=POST path=/api/pending_closures6864worker2 # [ 368.102981] nix-grpc-daemon[1946]: time=2026-09-20T08:21:30.050Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6865worker2 # [ 368.104462] nix-grpc-daemon[1946]: time=2026-09-20T08:21:30.052Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6866lb # [ 368.120521] niks3-server[1127]: 2026/09/20 08:21:29 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6867lb # [ 368.129204] niks3-server[1127]: 2026/09/20 08:21:29 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6868lb # [ 368.138797] niks3-server[1127]: 2026/09/20 08:21:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6869lb # [ 368.144825] niks3-server[1127]: 2026/09/20 08:21:29 INFO Signed narinfos id=67 count=16870worker2 # [ 368.158649] nix-grpc-daemon[1946]: time=2026-09-20T08:21:30.106Z level=INFO msg="Uploading 1 narinfos"6871lb # [ 368.150966] niks3-server[1127]: 2026/09/20 08:21:29 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6872lb # [ 368.159868] niks3-server[1127]: 2026/09/20 08:21:29 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6873lb # [ 368.165763] niks3-server[1127]: 2026/09/20 08:21:29 INFO Completed upload id=676874worker2 # [ 368.176366] nix-grpc-daemon[1946]: time=2026-09-20T08:21:30.124Z level=INFO msg="Upload complete. (240ms)"6875lb # [ 368.168552] niks3-server[1127]: 2026/09/20 08:21:29 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6876worker2 # [ 368.178839] nix-grpc-daemon[1884]: ts=2026-09-20T08:21:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38056 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16877worker2 # [ 368.185692] nix-daemon[911]: reaped child process 2037, status = succeeded6878client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.84 seconds)6879client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6880lb # [ 368.344220] envoy[989]: conn peer=[2001:db8:1::1]:53514 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=725 tx=455 ms=1200266881lb # [ 368.347851] envoy[989]: conn peer=[2001:db8:1::1]:42042 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9390 tx=3814 ms=66486882client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.16 seconds)6883worker1: must succeed: rm /nix/.rw-store/fill6884worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6885worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6886worker1 # [ 369.290943] nix-grpc-daemon[1334]: ts=2026-09-20T08:21:31Z level=info event=healthy reason=min_free6887worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.09 seconds)6888(finished: subtest: low disk drains a worker and builds go to the other, in 9.27 seconds)6889(finished: run the VM test script, in 370.52 seconds)6890test script finished in 370.73s6891cleanup6892kill QemuMachine (pid 49)6893client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6894kill QemuMachine (pid 50)6895lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6896kill QemuMachine (pid 51)6897worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6898kill QemuMachine (pid 52)6899worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6900(finished: cleanup, in 1.09 seconds)6901additionally exposed symbols:6902 client, lb, worker1, worker2,6903 vlan1,6904 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh