vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #250
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.s6PTs9dt9M', fmt=raw size=107374182414lb: QEMU running (pid 49)15lb # mke2fs 1.47.4 (6-Mar-2025)16lb # Discarding device blocks: 0/262144 done17lb # Creating filesystem with 262144 4k blocks and 65536 inodes18lb # Filesystem UUID: f6189fac-de06-4631-8ad7-fd726280cd7719lb # Superblock backups stored on blocks:20lb # 32768, 98304, 163840, 22937621lb # 22lb # Allocating group tables: 0/8 done23lb # Writing inode tables: 0/8 done24lb # Creating journal (8192 blocks): done25lb # Writing superblocks and filesystem accounting information: 0/8 done26client # Disk image does not exist, creating the virtualisation disk image...27lb # 28client: QEMU running (pid 50)29lb # Virtualisation disk image created.30client # Formatting '/build/vm-state-client/tmp.g1Kb5xyMG9', fmt=raw size=107374182431client # mke2fs 1.47.4 (6-Mar-2025)32client # Discarding device blocks: 0/262144 done33client # Creating filesystem with 262144 4k blocks and 65536 inodes34client # Filesystem UUID: 80538da9-d766-41e2-9def-ed305affdae435client # Superblock backups stored on blocks:36client # 32768, 98304, 163840, 22937637client # 38client # Allocating group tables: 0/8 done39client # Writing inode tables: 0/8 done40client # Creating journal (8192 blocks): done41client # Writing superblocks and filesystem accounting information: 0/8 done42client # 43client # Virtualisation disk image created.44worker2 # Disk image does not exist, creating the virtualisation disk image...45worker2 # Formatting '/build/vm-state-worker2/tmp.x7P8BZneoT', fmt=raw size=107374182446worker2: QEMU running (pid 51)47worker2 # mke2fs 1.47.4 (6-Mar-2025)48worker2 # Discarding device blocks: 0/262144 done49worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes50worker2 # Filesystem UUID: 7283a6f9-eb43-4369-aa35-2912eaf208f751worker2 # Superblock backups stored on blocks:52worker2 # 32768, 98304, 163840, 22937653worker2 # 54worker2 # Allocating group tables: 0/8 done55worker2 # Writing inode tables: 0/8 done56worker2 # Creating journal (8192 blocks): done57worker1 # Disk image does not exist, creating the virtualisation disk image...58worker1: QEMU running (pid 52)59worker1 # Formatting '/build/vm-state-worker1/tmp.KcmAJUY2U9', fmt=raw size=107374182460worker2 # Writing superblocks and filesystem accounting information: 0/8 done61worker1 # mke2fs 1.47.4 (6-Mar-2025)62worker2 # 63worker1 # Discarding device blocks: 0/262144 done64worker2 # Virtualisation disk image created.65worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes66(finished: start all VMs, in 0.23 seconds)67worker1 # Filesystem UUID: 30a3f0ec-d924-4dab-851c-7f76182f7cb268client: waiting for unit network-addresses-eth1.service69worker1 # Superblock backups stored on blocks:70client: waiting for the VM to finish booting71worker1 # 32768, 98304, 163840, 22937672worker1 # 73worker1 # Allocating group tables: 0/8 done74worker1 # Writing inode tables: 0/8 done75worker1 # Creating journal (8192 blocks): done76worker1 # Writing superblocks and filesystem accounting information: 0/8 done77worker1 # 78worker1 # Virtualisation disk image created.79client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83client # 84client # 85client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87client # 88client # 89client # 90client # 91client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092worker2 # 93worker2 # 94worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0095client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...96client # 97client # 98worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99worker2 # 100worker2 # 101worker2 # 102worker2 # 103lb # 104lb # 105worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00106lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00107worker1 # 108worker1 # 109worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00110lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...111lb # 112lb # 113lb # 114lb # 115worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...116worker2 # 117worker2 # 118lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00119worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...120worker1 # 121worker1 # 122worker1 # 123worker1 # 124worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00125lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126lb # 127lb # 128worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker1 # 130worker1 # 131client # Booting from ROM...132worker2 # Booting from ROM...133lb # Booting from ROM...134worker1 # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0awpqwy2d5xzs80mb1c2bwcn4cfyr0qj-nixos-system-worker2-test/init regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration console=ttyS0,115200n8 console=tty0137worker2 # [ 0.000000] BIOS-provided physical RAM map:138worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026145worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved146worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved148worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved149worker2 # [ 0.000000] NX (Execute Disable) protection: active150client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test/init regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration console=ttyS0,115200n8 console=tty0151worker2 # [ 0.000000] APIC: Static calls initialized152client # [ 0.000000] BIOS-provided physical RAM map:153worker2 # [ 0.000000] SMBIOS 2.8 present.154client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable155client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved156worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014157worker2 # [ 0.000000] DMI: Memory slots populated: 1/1158client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved159worker2 # [ 0.000000] Hypervisor detected: KVM160client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable161worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000162worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00163client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved164worker2 # [ 0.000000] kvm-clock: using sched offset of 445326042 cycles165client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved166client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved167worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns168client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved169worker2 # [ 0.000004] tsc: Detected 2400.012 MHz processor170worker2 # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000171client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved172client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved173worker2 # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs174client # [ 0.000000] NX (Execute Disable) protection: active175lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026176worker2 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT177client # [ 0.000000] APIC: Static calls initialized178client # [ 0.000000] SMBIOS 2.8 present.179worker2 # [ 0.002747] found SMP MP-table at [mem 0x000f5450-0x000f545f]180worker2 # [ 0.002757] Using GB pages for direct mapping181worker2 # [ 0.002824] RAMDISK: [mem 0x5e367000-0x5ffcffff]182client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014183client # [ 0.000000] DMI: Memory slots populated: 1/1184worker2 # [ 0.002831] ACPI: Early table checksum verification disabled185client # [ 0.000000] Hypervisor detected: KVM186worker2 # [ 0.002834] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )187client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000188lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0189client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00190lb # [ 0.000000] BIOS-provided physical RAM map:191worker2 # [ 0.002837] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)192client # [ 0.000001] kvm-clock: using sched offset of 472675717 cycles193lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable194worker2 # [ 0.002841] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)195lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved196client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns197worker2 # [ 0.002848] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)198client # [ 0.000005] tsc: Detected 2400.012 MHz processor199lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved200worker2 # [ 0.002850] ACPI: FACS 0x000000005FFE0000 000040201client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000202worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026203lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable204worker2 # [ 0.002852] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)205client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs206lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved207worker2 # [ 0.002854] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)208client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT209lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved210client # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]211worker2 # [ 0.002855] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)212lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved213client # [ 0.002747] Using GB pages for direct mapping214client # [ 0.002861] RAMDISK: [mem 0x5e366000-0x5ffcffff]215lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved216worker2 # [ 0.002857] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)217worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0kr1n537dvgjwic16706vlk6jg70cr08-nixos-system-worker1-test/init regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration console=ttyS0,115200n8 console=tty0218worker1 # [ 0.000000] BIOS-provided physical RAM map:219client # [ 0.002870] ACPI: Early table checksum verification disabled220lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved221worker2 # [ 0.002858] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]222client # [ 0.002873] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )223worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable224lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved225worker2 # [ 0.002859] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]226lb # [ 0.000000] NX (Execute Disable) protection: active227worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved228client # [ 0.002878] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)229worker2 # [ 0.002860] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]230lb # [ 0.000000] APIC: Static calls initialized231worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved232lb # [ 0.000000] SMBIOS 2.8 present.233client # [ 0.002882] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)234worker2 # [ 0.002860] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]235worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable236client # [ 0.002889] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)237worker2 # [ 0.002861] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]238lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014239worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved240client # [ 0.002891] ACPI: FACS 0x000000005FFE0000 000040241lb # [ 0.000000] DMI: Memory slots populated: 1/1242worker2 # [ 0.002861] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]243lb # [ 0.000000] Hypervisor detected: KVM244worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved245client # [ 0.002892] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)246lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000247worker2 # [ 0.002862] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]248worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved249worker2 # [ 0.003085] No NUMA configuration found250lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00251client # [ 0.002894] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)252worker2 # [ 0.003086] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]253lb # [ 0.000001] kvm-clock: using sched offset of 487379532 cycles254worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved255client # [ 0.002895] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)256worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved257worker2 # [ 0.003088] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]258worker2 # [ 0.005428] Zone ranges:259lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns260worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved261client # [ 0.002897] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)262lb # [ 0.000005] tsc: Detected 2400.012 MHz processor263worker2 # [ 0.005429] DMA [mem 0x0000000000001000-0x0000000000ffffff]264worker1 # [ 0.000000] NX (Execute Disable) protection: active265worker2 # [ 0.005431] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]266client # [ 0.002898] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]267lb # [ 0.000825] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000268worker2 # [ 0.005432] Normal empty269worker1 # [ 0.000000] APIC: Static calls initialized270worker2 # [ 0.005432] Device empty271worker1 # [ 0.000000] SMBIOS 2.8 present.272client # [ 0.002899] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]273lb # [ 0.000853] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs274worker2 # [ 0.005433] Movable zone start for each node275worker2 # [ 0.005434] Early memory node ranges276client # [ 0.002900] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]277worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014278lb # [ 0.000856] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT279worker2 # [ 0.005434] node 0: [mem 0x0000000000001000-0x000000000009efff]280worker1 # [ 0.000000] DMI: Memory slots populated: 1/1281client # [ 0.002900] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]282lb # [ 0.002772] found SMP MP-table at [mem 0x000f5450-0x000f545f]283worker1 # [ 0.000000] Hypervisor detected: KVM284lb # [ 0.002783] Using GB pages for direct mapping285worker2 # [ 0.005435] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]286client # [ 0.002901] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]287worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000288lb # [ 0.002862] RAMDISK: [mem 0x5e367000-0x5ffcffff]289worker2 # [ 0.005436] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]290worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00291client # [ 0.002901] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]292lb # [ 0.002871] ACPI: Early table checksum verification disabled293worker2 # [ 0.005455] On node 0, zone DMA: 1 pages in unavailable ranges294worker1 # [ 0.000000] kvm-clock: using sched offset of 464442717 cycles295client # [ 0.002902] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]296lb # [ 0.002874] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )297worker2 # [ 0.005712] On node 0, zone DMA: 97 pages in unavailable ranges298client # [ 0.003144] No NUMA configuration found299lb # [ 0.002878] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)300worker2 # [ 0.031464] On node 0, zone DMA32: 40 pages in unavailable ranges301worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns302client # [ 0.003145] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]303worker2 # [ 0.031914] ACPI: PM-Timer IO Port: 0x608304worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor305client # [ 0.003147] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]306lb # [ 0.002883] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)307worker2 # [ 0.031925] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])308worker1 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000309client # [ 0.005559] Zone ranges:310client # [ 0.005560] DMA [mem 0x0000000000001000-0x0000000000ffffff]311lb # [ 0.002891] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)312worker2 # [ 0.031951] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23313worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs314lb # [ 0.002893] ACPI: FACS 0x000000005FFE0000 000040315client # [ 0.005561] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]316worker2 # [ 0.031953] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)317worker1 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT318client # [ 0.005563] Normal empty319client # [ 0.005563] Device empty320worker2 # [ 0.031955] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)321lb # [ 0.002894] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)322worker1 # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]323client # [ 0.005564] Movable zone start for each node324worker1 # [ 0.002747] Using GB pages for direct mapping325client # [ 0.005565] Early memory node ranges326worker2 # [ 0.031956] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)327lb # [ 0.002896] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)328worker1 # [ 0.002823] RAMDISK: [mem 0x5e367000-0x5ffcffff]329client # [ 0.005566] node 0: [mem 0x0000000000001000-0x000000000009efff]330worker2 # [ 0.031956] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)331worker1 # [ 0.002833] ACPI: Early table checksum verification disabled332lb # [ 0.002897] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)333client # [ 0.005567] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]334worker2 # [ 0.031957] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)335worker1 # [ 0.002836] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )336client # [ 0.005568] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]337lb # [ 0.002899] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)338worker2 # [ 0.031959] ACPI: Using ACPI (MADT) for SMP configuration information339worker1 # [ 0.002840] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)340worker2 # [ 0.031960] ACPI: HPET id: 0x8086a201 base: 0xfed00000341client # [ 0.005589] On node 0, zone DMA: 1 pages in unavailable ranges342lb # [ 0.002900] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]343worker2 # [ 0.031963] TSC deadline timer available344client # [ 0.005866] On node 0, zone DMA: 97 pages in unavailable ranges345worker1 # [ 0.002844] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)346lb # [ 0.002902] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]347worker2 # [ 0.031967] CPU topo: Max. logical packages: 1348client # [ 0.034205] On node 0, zone DMA32: 40 pages in unavailable ranges349worker2 # [ 0.031968] CPU topo: Max. logical dies: 1350worker1 # [ 0.002851] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)351client # [ 0.034665] ACPI: PM-Timer IO Port: 0x608352lb # [ 0.002902] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]353worker2 # [ 0.031968] CPU topo: Max. dies per package: 1354worker1 # [ 0.002853] ACPI: FACS 0x000000005FFE0000 000040355client # [ 0.034676] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])356lb # [ 0.002903] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]357worker2 # [ 0.031972] CPU topo: Max. threads per core: 1358worker2 # [ 0.031972] CPU topo: Num. cores per package: 1359client # [ 0.034702] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23360lb # [ 0.002903] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]361worker1 # [ 0.002854] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)362worker2 # [ 0.031973] CPU topo: Num. threads per package: 1363client # [ 0.034705] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)364lb # [ 0.002903] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]365worker1 # [ 0.002856] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)366worker2 # [ 0.031973] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs367client # [ 0.034707] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)368lb # [ 0.002904] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]369worker1 # [ 0.002857] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)370worker2 # [ 0.031990] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()371client # [ 0.034708] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)372lb # [ 0.003128] No NUMA configuration found373worker2 # [ 0.032019] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]374lb # [ 0.003129] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]375worker1 # [ 0.002859] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)376client # [ 0.034709] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)377lb # [ 0.003132] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]378worker2 # [ 0.032021] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]379client # [ 0.034710] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)380worker1 # [ 0.002860] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]381lb # [ 0.005325] Zone ranges:382worker2 # [ 0.032022] [mem 0x60000000-0xafffffff] available for PCI devices383client # [ 0.034712] ACPI: Using ACPI (MADT) for SMP configuration information384worker1 # [ 0.002861] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]385lb # [ 0.005325] DMA [mem 0x0000000000001000-0x0000000000ffffff]386worker2 # [ 0.032023] Booting paravirtualized kernel on KVM387client # [ 0.034713] ACPI: HPET id: 0x8086a201 base: 0xfed00000388worker1 # [ 0.002862] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]389lb # [ 0.005328] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]390client # [ 0.034717] TSC deadline timer available391lb # [ 0.005329] Normal empty392client # [ 0.034722] CPU topo: Max. logical packages: 1393worker2 # [ 0.032025] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns394worker1 # [ 0.002862] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]395lb # [ 0.005330] Device empty396lb # [ 0.005330] Movable zone start for each node397client # [ 0.034723] CPU topo: Max. logical dies: 1398lb # [ 0.005331] Early memory node ranges399worker2 # [ 0.036490] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1400client # [ 0.034723] CPU topo: Max. dies per package: 1401worker1 # [ 0.002863] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]402client # [ 0.034726] CPU topo: Max. threads per core: 1403lb # [ 0.005331] node 0: [mem 0x0000000000001000-0x000000000009efff]404worker2 # [ 0.038577] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152405worker1 # [ 0.002863] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]406client # [ 0.034727] CPU topo: Num. cores per package: 1407worker2 # [ 0.038620] kvm-guest: PV spinlocks disabled, single CPU408lb # [ 0.005333] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]409worker1 # [ 0.002864] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]410client # [ 0.034727] CPU topo: Num. threads per package: 1411worker1 # [ 0.003092] No NUMA configuration found412lb # [ 0.005334] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]413client # [ 0.034727] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs414worker1 # [ 0.003093] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]415lb # [ 0.005354] On node 0, zone DMA: 1 pages in unavailable ranges416client # [ 0.034746] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()417worker1 # [ 0.003095] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]418lb # [ 0.005614] On node 0, zone DMA: 97 pages in unavailable ranges419worker1 # [ 0.005489] Zone ranges:420client # [ 0.034779] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]421lb # [ 0.031190] On node 0, zone DMA32: 40 pages in unavailable ranges422worker1 # [ 0.005490] DMA [mem 0x0000000000001000-0x0000000000ffffff]423lb # [ 0.031671] ACPI: PM-Timer IO Port: 0x608424client # [ 0.034781] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]425worker2 # [ 0.038621] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0awpqwy2d5xzs80mb1c2bwcn4cfyr0qj-nixos-system-worker2-test/init regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration console=ttyS0,115200n8 console=tty0426worker1 # [ 0.005492] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]427lb # [ 0.031683] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])428worker1 # [ 0.005493] Normal empty429client # [ 0.034783] [mem 0x60000000-0xafffffff] available for PCI devices430worker1 # [ 0.005494] Device empty431lb # [ 0.031709] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23432client # [ 0.034784] Booting paravirtualized kernel on KVM433worker1 # [ 0.005494] Movable zone start for each node434worker1 # [ 0.005495] Early memory node ranges435worker2 # [ 0.038710] Unknown kernel command line parameters "regInfo=/nix/store/z1njsiw298qbc3gqbf3cxg7mldzwa6vi-closure-info/registration", will be passed to user space.436lb # [ 0.031712] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)437worker2 # [ 0.038723] random: crng init done438client # [ 0.034788] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns439worker1 # [ 0.005495] node 0: [mem 0x0000000000001000-0x000000000009efff]440lb # [ 0.031714] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)441worker2 # [ 0.038723] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes442client # [ 0.039254] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1443worker1 # [ 0.005497] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]444lb # [ 0.031715] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)445worker2 # [ 0.040781] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)446client # [ 0.041813] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152447lb # [ 0.031716] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)448worker1 # [ 0.005498] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]449client # [ 0.041856] kvm-guest: PV spinlocks disabled, single CPU450worker2 # [ 0.041946] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)451worker1 # [ 0.005518] On node 0, zone DMA: 1 pages in unavailable ranges452lb # [ 0.031717] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)453worker2 # [ 0.041976] Fallback order for Node 0: 0454worker1 # [ 0.005798] On node 0, zone DMA: 97 pages in unavailable ranges455lb # [ 0.031719] ACPI: Using ACPI (MADT) for SMP configuration information456worker2 # [ 0.041978] Built 1 zonelists, mobility grouping on. Total pages: 393078457worker1 # [ 0.034046] On node 0, zone DMA32: 40 pages in unavailable ranges458worker2 # [ 0.041979] Policy zone: DMA32459lb # [ 0.031720] ACPI: HPET id: 0x8086a201 base: 0xfed00000460worker1 # [ 0.034507] ACPI: PM-Timer IO Port: 0x608461lb # [ 0.031723] TSC deadline timer available462worker2 # [ 0.044375] mem auto-init: stack:all(zero), heap alloc:on, heap free:off463worker1 # [ 0.034517] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])464lb # [ 0.031727] CPU topo: Max. logical packages: 1465worker2 # [ 0.047348] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1466lb # [ 0.031728] CPU topo: Max. logical dies: 1467worker1 # [ 0.034547] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23468client # [ 0.041857] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test/init regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration console=ttyS0,115200n8 console=tty0469worker2 # [ 0.050545] allocated 3145728 bytes of page_ext470lb # [ 0.031728] CPU topo: Max. dies per package: 1471worker1 # [ 0.034549] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)472lb # [ 0.031732] CPU topo: Max. threads per core: 1473worker2 # [ 0.060095] ftrace: allocating 48731 entries in 192 pages474lb # [ 0.031733] CPU topo: Num. cores per package: 1475worker1 # [ 0.034551] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)476worker2 # [ 0.060097] ftrace: allocated 192 pages with 2 groups477client # [ 0.041953] Unknown kernel command line parameters "regInfo=/nix/store/qxwc9f8vm1br5havgjrxjsjv6jana853-closure-info/registration", will be passed to user space.478worker2 # [ 0.060913] Dynamic Preempt: lazy479lb # [ 0.031733] CPU topo: Num. threads per package: 1480client # [ 0.041966] random: crng init done481worker1 # [ 0.034552] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)482worker2 # [ 0.061077] rcu: Preemptible hierarchical RCU implementation.483lb # [ 0.031734] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs484client # [ 0.041967] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes485worker2 # [ 0.061078] rcu: RCU event tracing is enabled.486worker1 # [ 0.034553] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)487lb # [ 0.031753] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()488worker2 # [ 0.061079] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.489worker1 # [ 0.034554] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)490client # [ 0.044227] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)491worker2 # [ 0.061080] Trampoline variant of Tasks RCU enabled.492lb # [ 0.031785] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]493worker1 # [ 0.034556] ACPI: Using ACPI (MADT) for SMP configuration information494client # [ 0.045349] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)495worker2 # [ 0.061080] Rude variant of Tasks RCU enabled.496worker1 # [ 0.034557] ACPI: HPET id: 0x8086a201 base: 0xfed00000497client # [ 0.045381] Fallback order for Node 0: 0498worker2 # [ 0.061081] Tracing variant of Tasks RCU enabled.499lb # [ 0.031787] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]500worker1 # [ 0.034561] TSC deadline timer available501lb # [ 0.031788] [mem 0x60000000-0xafffffff] available for PCI devices502client # [ 0.045384] Built 1 zonelists, mobility grouping on. Total pages: 393078503worker1 # [ 0.034565] CPU topo: Max. logical packages: 1504worker2 # [ 0.061082] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.505client # [ 0.045385] Policy zone: DMA32506lb # [ 0.031790] Booting paravirtualized kernel on KVM507worker1 # [ 0.034566] CPU topo: Max. logical dies: 1508worker2 # [ 0.061082] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1509client # [ 0.048038] mem auto-init: stack:all(zero), heap alloc:on, heap free:off510worker1 # [ 0.034566] CPU topo: Max. dies per package: 1511worker1 # [ 0.034570] CPU topo: Max. threads per core: 1512lb # [ 0.031793] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns513client # [ 0.051532] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1514worker2 # [ 0.061098] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.515worker1 # [ 0.034571] CPU topo: Num. cores per package: 1516client # [ 0.055349] allocated 3145728 bytes of page_ext517lb # [ 0.036282] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1518worker1 # [ 0.034571] CPU topo: Num. threads per package: 1519client # [ 0.065575] ftrace: allocating 48731 entries in 192 pages520worker2 # [ 0.061100] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.521lb # [ 0.038438] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152522worker1 # [ 0.034571] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs523client # [ 0.065577] ftrace: allocated 192 pages with 2 groups524lb # [ 0.038477] kvm-guest: PV spinlocks disabled, single CPU525client # [ 0.066438] Dynamic Preempt: lazy526worker2 # [ 0.061101] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.527worker1 # [ 0.034591] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()528client # [ 0.066581] rcu: Preemptible hierarchical RCU implementation.529worker2 # [ 0.065694] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16530worker1 # [ 0.034625] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]531client # [ 0.066582] rcu: RCU event tracing is enabled.532worker2 # [ 0.065970] rcu: srcu_init: Setting srcu_struct sizes based on contention.533client # [ 0.066583] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.534worker1 # [ 0.034627] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]535client # [ 0.066584] Trampoline variant of Tasks RCU enabled.536worker1 # [ 0.034628] [mem 0x60000000-0xafffffff] available for PCI devices537worker2 # [ 0.065976] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns538client # [ 0.066585] Rude variant of Tasks RCU enabled.539worker1 # [ 0.034630] Booting paravirtualized kernel on KVM540client # [ 0.066585] Tracing variant of Tasks RCU enabled.541lb # [ 0.038479] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0542worker2 # [ 0.066074] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)543worker2 # [ 0.069620] Console: colour VGA+ 80x25544client # [ 0.066586] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.545worker1 # [ 0.034633] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns546worker2 # [ 0.069623] printk: legacy console [tty0] enabled547client # [ 0.066587] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1548lb # [ 0.038571] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.549worker1 # [ 0.039098] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1550worker2 # [ 0.099227] printk: legacy console [ttyS0] enabled551lb # [ 0.038584] random: crng init done552worker2 # [ 0.196711] ACPI: Core revision 20250807553worker1 # [ 0.041361] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152554client # [ 0.066596] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.555lb # [ 0.038585] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes556worker1 # [ 0.041410] kvm-guest: PV spinlocks disabled, single CPU557client # [ 0.066598] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.558lb # [ 0.040654] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)559worker2 # [ 0.197565] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns560client # [ 0.066599] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.561lb # [ 0.041703] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)562worker2 # [ 0.199085] APIC: Switch to symmetric I/O mode setup563lb # [ 0.041734] Fallback order for Node 0: 0564client # [ 0.071047] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16565worker2 # [ 0.200041] x2apic enabled566lb # [ 0.041737] Built 1 zonelists, mobility grouping on. Total pages: 393078567client # [ 0.071336] rcu: srcu_init: Setting srcu_struct sizes based on contention.568lb # [ 0.041738] Policy zone: DMA32569worker2 # [ 0.200774] APIC: Switched APIC routing to: physical x2apic570worker1 # [ 0.041411] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0kr1n537dvgjwic16706vlk6jg70cr08-nixos-system-worker1-test/init regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration console=ttyS0,115200n8 console=tty0571lb # [ 0.044573] mem auto-init: stack:all(zero), heap alloc:on, heap free:off572client # [ 0.071343] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns573lb # [ 0.047626] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1574client # [ 0.071454] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)575lb # [ 0.050857] allocated 3145728 bytes of page_ext576worker1 # [ 0.041508] Unknown kernel command line parameters "regInfo=/nix/store/r6hmyzq7r5qbifm6wx7rcr4vsrd60rib-closure-info/registration", will be passed to user space.577worker2 # [ 0.202552] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1578client # [ 0.074971] Console: colour VGA+ 80x25579worker1 # [ 0.041520] random: crng init done580lb # [ 0.060396] ftrace: allocating 48731 entries in 192 pages581client # [ 0.074974] printk: legacy console [tty0] enabled582lb # [ 0.060399] ftrace: allocated 192 pages with 2 groups583worker1 # [ 0.041521] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes584client # [ 0.104380] printk: legacy console [ttyS0] enabled585lb # [ 0.061217] Dynamic Preempt: lazy586worker2 # [ 0.203517] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns587worker1 # [ 0.044024] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)588client # [ 0.199546] ACPI: Core revision 20250807589lb # [ 0.061349] rcu: Preemptible hierarchical RCU implementation.590lb # [ 0.061350] rcu: RCU event tracing is enabled.591worker2 # [ 0.205141] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)592worker1 # [ 0.045152] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)593worker1 # [ 0.045183] Fallback order for Node 0: 0594lb # [ 0.061350] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.595client # [ 0.200422] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns596worker2 # [ 0.206233] x86/cpu: User Mode Instruction Prevention (UMIP) activated597lb # [ 0.061352] Trampoline variant of Tasks RCU enabled.598worker1 # [ 0.045186] Built 1 zonelists, mobility grouping on. Total pages: 393078599worker1 # [ 0.045187] Policy zone: DMA32600client # [ 0.201910] APIC: Switch to symmetric I/O mode setup601lb # [ 0.061352] Rude variant of Tasks RCU enabled.602worker2 # [ 0.207313] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127603lb # [ 0.061352] Tracing variant of Tasks RCU enabled.604worker1 # [ 0.047826] mem auto-init: stack:all(zero), heap alloc:on, heap free:off605client # [ 0.202839] x2apic enabled606worker1 # [ 0.051144] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1607lb # [ 0.061353] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.608client # [ 0.203617] APIC: Switched APIC routing to: physical x2apic609worker1 # [ 0.054623] allocated 3145728 bytes of page_ext610worker2 # [ 0.208139] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0611lb # [ 0.061354] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1612worker1 # [ 0.064890] ftrace: allocating 48731 entries in 192 pages613worker1 # [ 0.064892] ftrace: allocated 192 pages with 2 groups614worker2 # [ 0.209142] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto615lb # [ 0.061385] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.616client # [ 0.205420] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1617worker1 # [ 0.065771] Dynamic Preempt: lazy618worker1 # [ 0.065877] rcu: Preemptible hierarchical RCU implementation.619lb # [ 0.061387] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.620worker2 # [ 0.210139] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl621worker1 # [ 0.065877] rcu: RCU event tracing is enabled.622client # [ 0.206369] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns623worker2 # [ 0.211139] Transient Scheduler Attacks: Vulnerable: No microcode624lb # [ 0.061388] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.625worker1 # [ 0.065878] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.626worker1 # [ 0.065880] Trampoline variant of Tasks RCU enabled.627lb # [ 0.065813] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16628worker2 # [ 0.212138] Spectre V2 : Mitigation: Enhanced / Automatic IBRS629client # [ 0.207961] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)630worker1 # [ 0.065880] Rude variant of Tasks RCU enabled.631lb # [ 0.066103] rcu: srcu_init: Setting srcu_struct sizes based on contention.632worker1 # [ 0.065881] Tracing variant of Tasks RCU enabled.633worker2 # [ 0.213145] Speculative Return Stack Overflow: Mitigation: Safe RET634client # [ 0.209045] x86/cpu: User Mode Instruction Prevention (UMIP) activated635worker1 # [ 0.065881] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.636lb # [ 0.066108] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns637client # [ 0.210098] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127638worker1 # [ 0.065882] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1639lb # [ 0.066208] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)640client # [ 0.210958] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0641lb # [ 0.069753] Console: colour VGA+ 80x25642worker1 # [ 0.065941] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.643lb # [ 0.069756] printk: legacy console [tty0] enabled644lb # [ 0.099557] printk: legacy console [ttyS0] enabled645worker1 # [ 0.065943] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.646client # [ 0.211961] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto647worker2 # [ 0.214138] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization648lb # [ 0.195958] ACPI: Core revision 20250807649worker1 # [ 0.065944] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.650worker2 # [ 0.216146] Spectre V2 : Enabling IBPB for BPF651client # [ 0.212958] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl652worker1 # [ 0.070407] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16653lb # [ 0.196835] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns654worker2 # [ 0.217139] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier655worker1 # [ 0.070695] rcu: srcu_init: Setting srcu_struct sizes based on contention.656client # [ 0.213958] Transient Scheduler Attacks: Vulnerable: No microcode657worker2 # [ 0.218139] active return thunk: srso_alias_return_thunk658lb # [ 0.198424] APIC: Switch to symmetric I/O mode setup659client # [ 0.214957] Spectre V2 : Mitigation: Enhanced / Automatic IBRS660worker1 # [ 0.070702] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns661lb # [ 0.199376] x2apic enabled662client # [ 0.215958] Speculative Return Stack Overflow: Mitigation: Safe RET663worker2 # [ 0.219159] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'664worker1 # [ 0.070811] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)665lb # [ 0.200157] APIC: Switched APIC routing to: physical x2apic666worker1 # [ 0.074350] Console: colour VGA+ 80x25667worker2 # [ 0.220139] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'668worker1 # [ 0.074353] printk: legacy console [tty0] enabled669worker1 # [ 0.103825] printk: legacy console [ttyS0] enabled670worker2 # [ 0.221138] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'671worker1 # [ 0.199386] ACPI: Core revision 20250807672lb # [ 0.202039] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1673worker2 # [ 0.222139] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'674client # [ 0.216957] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization675worker2 # [ 0.223139] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'676worker1 # [ 0.200261] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns677lb # [ 0.203155] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns678client # [ 0.218965] Spectre V2 : Enabling IBPB for BPF679worker2 # [ 0.224138] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'680worker1 # [ 0.201790] APIC: Switch to symmetric I/O mode setup681worker1 # [ 0.202726] x2apic enabled682lb # [ 0.204790] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)683client # [ 0.219678] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier684worker2 # [ 0.225139] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'685client # [ 0.220958] active return thunk: srso_alias_return_thunk686lb # [ 0.205874] x86/cpu: User Mode Instruction Prevention (UMIP) activated687worker1 # [ 0.203457] APIC: Switched APIC routing to: physical x2apic688worker2 # [ 0.226139] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256689client # [ 0.221796] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'690lb # [ 0.207705] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127691worker2 # [ 0.227139] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64692worker1 # [ 0.205257] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1693client # [ 0.222957] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'694lb # [ 0.208497] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0695worker2 # [ 0.228139] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512696client # [ 0.223958] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'697worker2 # [ 0.229139] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024698worker1 # [ 0.206280] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns699lb # [ 0.209791] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto700client # [ 0.224957] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'701worker2 # [ 0.230140] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8702worker1 # [ 0.207916] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)703client # [ 0.225957] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'704lb # [ 0.210789] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl705client # [ 0.226957] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'706worker1 # [ 0.209002] x86/cpu: User Mode Instruction Prevention (UMIP) activated707lb # [ 0.212788] Transient Scheduler Attacks: Vulnerable: No microcode708worker2 # [ 0.231139] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.709worker1 # [ 0.210069] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127710lb # [ 0.213788] Spectre V2 : Mitigation: Enhanced / Automatic IBRS711client # [ 0.227957] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'712lb # [ 0.214788] Speculative Return Stack Overflow: Mitigation: Safe RET713worker1 # [ 0.210913] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0714client # [ 0.228958] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256715client # [ 0.229957] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64716worker1 # [ 0.211917] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto717client # [ 0.230958] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512718client # [ 0.231957] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024719worker1 # [ 0.213913] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl720client # [ 0.232958] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8721worker1 # [ 0.214914] Transient Scheduler Attacks: Vulnerable: No microcode722lb # [ 0.215768] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization723lb # [ 0.217794] Spectre V2 : Enabling IBPB for BPF724worker1 # [ 0.215913] Spectre V2 : Mitigation: Enhanced / Automatic IBRS725client # [ 0.233958] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.726worker1 # [ 0.216913] Speculative Return Stack Overflow: Mitigation: Safe RET727lb # [ 0.218531] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier728lb # [ 0.219789] active return thunk: srso_alias_return_thunk729lb # [ 0.220809] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'730lb # [ 0.221788] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'731worker1 # [ 0.217913] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization732worker1 # [ 0.219922] Spectre V2 : Enabling IBPB for BPF733lb # [ 0.222789] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'734lb # [ 0.223788] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'735worker1 # [ 0.220914] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier736worker1 # [ 0.221913] active return thunk: srso_alias_return_thunk737lb # [ 0.225606] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'738lb # [ 0.226576] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'739worker1 # [ 0.222934] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'740worker1 # [ 0.223913] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'741lb # [ 0.227599] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'742worker1 # [ 0.224913] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'743lb # [ 0.228788] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256744worker1 # [ 0.225913] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'745lb # [ 0.229788] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64746worker1 # [ 0.226913] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'747lb # [ 0.230788] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512748worker1 # [ 0.227913] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'749lb # [ 0.231788] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024750worker1 # [ 0.228913] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'751lb # [ 0.232788] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8752worker1 # [ 0.229914] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256753lb # [ 0.233788] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.754worker1 # [ 0.231644] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755worker1 # [ 0.232646] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756worker1 # [ 0.233645] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757worker1 # [ 0.233913] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758worker1 # [ 0.234913] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759worker2 # [ 0.267990] Freeing SMP alternatives memory: 44K760worker2 # [ 0.268745] pid_max: default: 32768 minimum: 301761worker2 # [ 0.269240] LSM: initializing lsm=capability,landlock,yama,bpf,ima762worker2 # [ 0.270248] landlock: Up and running.763worker2 # [ 0.271139] Yama: becoming mindful.764worker2 # [ 0.272350] LSM support for eBPF active765worker2 # [ 0.273170] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766client # [ 0.269605] Freeing SMP alternatives memory: 44K767client # [ 0.269961] pid_max: default: 32768 minimum: 301768worker2 # [ 0.274180] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)769client # [ 0.271070] LSM: initializing lsm=capability,landlock,yama,bpf,ima770client # [ 0.272067] landlock: Up and running.771client # [ 0.272958] Yama: becoming mindful.772worker2 # [ 0.276672] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)773client # [ 0.273750] LSM support for eBPF active774worker2 # [ 0.277715] Performance Events: Fam17h+ core perfctr, AMD PMU driver.775client # [ 0.274510] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)776worker2 # [ 0.278143] ... version: 2777worker2 # [ 0.278867] ... bit width: 48778client # [ 0.274998] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)779worker2 # [ 0.279141] ... generic counters: 6780worker2 # [ 0.279875] ... generic bitmap: 000000000000003f781worker2 # [ 0.280151] ... fixed-purpose counters: 0782client # [ 0.278109] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)783worker2 # [ 0.280888] ... fixed-purpose bitmap: 0000000000000000784client # [ 0.279545] Performance Events: Fam17h+ core perfctr, AMD PMU driver.785worker2 # [ 0.281141] ... value mask: 0000ffffffffffff786client # [ 0.279966] ... version: 2787worker2 # [ 0.282060] ... max period: 00007fffffffffff788client # [ 0.280643] ... bit width: 48789worker2 # [ 0.282825] ... global_ctrl mask: 000000000000003f790client # [ 0.280960] ... generic counters: 6791worker2 # [ 0.283251] signal: max sigframe size: 3376792client # [ 0.281651] ... generic bitmap: 000000000000003f793client # [ 0.281960] ... fixed-purpose counters: 0794worker2 # [ 0.284056] rcu: Hierarchical SRCU implementation.795client # [ 0.282635] ... fixed-purpose bitmap: 0000000000000000796worker2 # [ 0.284756] rcu: Max phase no-delay instances is 400.797client # [ 0.282960] ... value mask: 0000ffffffffffff798lb # [ 0.269452] Freeing SMP alternatives memory: 44K799client # [ 0.283839] ... max period: 00007fffffffffff800lb # [ 0.269791] pid_max: default: 32768 minimum: 301801client # [ 0.284631] ... global_ctrl mask: 000000000000003f802lb # [ 0.270869] LSM: initializing lsm=capability,landlock,yama,bpf,ima803client # [ 0.285060] signal: max sigframe size: 3376804lb # [ 0.271897] landlock: Up and running.805client # [ 0.285833] rcu: Hierarchical SRCU implementation.806lb # [ 0.272788] Yama: becoming mindful.807client # [ 0.286511] rcu: Max phase no-delay instances is 400.808lb # [ 0.273591] LSM support for eBPF active809worker2 # [ 0.289654] smp: Bringing up secondary CPUs ...810worker1 # [ 0.270841] Freeing SMP alternatives memory: 44K811worker2 # [ 0.290155] smp: Brought up 1 node, 1 CPU812worker1 # [ 0.271460] pid_max: default: 32768 minimum: 301813lb # [ 0.274340] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)814worker2 # [ 0.290812] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)815worker1 # [ 0.272005] LSM: initializing lsm=capability,landlock,yama,bpf,ima816lb # [ 0.274841] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)817worker1 # [ 0.273021] landlock: Up and running.818worker1 # [ 0.273914] Yama: becoming mindful.819worker2 # [ 0.291330] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)820worker1 # [ 0.274705] LSM support for eBPF active821worker2 # [ 0.292376] devtmpfs: initialized822client # [ 0.291556] smp: Bringing up secondary CPUs ...823lb # [ 0.278462] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)824worker1 # [ 0.275498] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)825client # [ 0.291974] smp: Brought up 1 node, 1 CPU826worker2 # [ 0.293147] x86/mm: Memory block size: 128MB827client # [ 0.292623] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)828worker1 # [ 0.276788] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)829lb # [ 0.279418] Performance Events: Fam17h+ core perfctr, AMD PMU driver.830lb # [ 0.279792] ... version: 2831worker2 # [ 0.294878] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)832lb # [ 0.280492] ... bit width: 48833client # [ 0.293140] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)834lb # [ 0.280791] ... generic counters: 6835worker1 # [ 0.279147] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)836worker2 # [ 0.296024] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).837client # [ 0.294238] devtmpfs: initialized838lb # [ 0.281449] ... generic bitmap: 000000000000003f839worker2 # [ 0.297212] pinctrl core: initialized pinctrl subsystem840lb # [ 0.281843] ... fixed-purpose counters: 0841client # [ 0.295105] x86/mm: Memory block size: 128MB842worker1 # [ 0.280466] Performance Events: Fam17h+ core perfctr, AMD PMU driver.843worker2 # [ 0.298317] PM: RTC time: 08:59:14, date: 2026-09-20844worker1 # [ 0.280921] ... version: 2845lb # [ 0.282528] ... fixed-purpose bitmap: 0000000000000000846worker1 # [ 0.281600] ... bit width: 48847lb # [ 0.282790] ... value mask: 0000ffffffffffff848worker1 # [ 0.281915] ... generic counters: 6849client # [ 0.296898] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)850lb # [ 0.283692] ... max period: 00007fffffffffff851worker1 # [ 0.282602] ... generic bitmap: 000000000000003f852lb # [ 0.284468] ... global_ctrl mask: 000000000000003f853worker1 # [ 0.282915] ... fixed-purpose counters: 0854client # [ 0.297866] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).855worker2 # [ 0.301734] NET: Registered PF_NETLINK/PF_ROUTE protocol family856lb # [ 0.284901] signal: max sigframe size: 3376857worker1 # [ 0.283583] ... fixed-purpose bitmap: 0000000000000000858client # [ 0.299054] pinctrl core: initialized pinctrl subsystem859worker1 # [ 0.283915] ... value mask: 0000ffffffffffff860lb # [ 0.285696] rcu: Hierarchical SRCU implementation.861worker2 # [ 0.302632] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations862client # [ 0.300133] PM: RTC time: 08:59:14, date: 2026-09-20863lb # [ 0.286343] rcu: Max phase no-delay instances is 400.864worker1 # [ 0.284756] ... max period: 00007fffffffffff865worker2 # [ 0.303162] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations866worker1 # [ 0.285555] ... global_ctrl mask: 000000000000003f867worker1 # [ 0.286015] signal: max sigframe size: 3376868worker2 # [ 0.304402] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations869worker1 # [ 0.286785] rcu: Hierarchical SRCU implementation.870worker2 # [ 0.305151] audit: initializing netlink subsys (disabled)871worker1 # [ 0.287478] rcu: Max phase no-delay instances is 400.872client # [ 0.304230] NET: Registered PF_NETLINK/PF_ROUTE protocol family873worker2 # [ 0.306319] thermal_sys: Registered thermal governor 'fair_share'874client # [ 0.305536] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations875lb # [ 0.291427] smp: Bringing up secondary CPUs ...876worker2 # [ 0.306321] thermal_sys: Registered thermal governor 'bang_bang'877lb # [ 0.291804] smp: Brought up 1 node, 1 CPU878worker2 # [ 0.307142] thermal_sys: Registered thermal governor 'step_wise'879client # [ 0.305986] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations880lb # [ 0.292464] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)881worker2 # [ 0.308079] thermal_sys: Registered thermal governor 'user_space'882client # [ 0.307272] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations883worker1 # [ 0.292447] smp: Bringing up secondary CPUs ...884worker2 # [ 0.308867] audit: type=2000 audit(1789894755.129:1): state=initialized audit_enabled=0 res=1885client # [ 0.307970] audit: initializing netlink subsys (disabled)886worker1 # [ 0.292929] smp: Brought up 1 node, 1 CPU887lb # [ 0.292936] Memory: 1454588K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)888worker2 # [ 0.310144] thermal_sys: Registered thermal governor 'power_allocator'889lb # [ 0.294006] devtmpfs: initialized890worker1 # [ 0.293564] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)891worker2 # [ 0.310156] cpuidle: using governor menu892client # [ 0.309159] thermal_sys: Registered thermal governor 'fair_share'893lb # [ 0.294766] x86/mm: Memory block size: 128MB894client # [ 0.309161] thermal_sys: Registered thermal governor 'bang_bang'895worker2 # [ 0.312321] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5896client # [ 0.309961] thermal_sys: Registered thermal governor 'step_wise'897worker1 # [ 0.294029] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)898worker1 # [ 0.295167] devtmpfs: initialized899client # [ 0.310878] thermal_sys: Registered thermal governor 'user_space'900lb # [ 0.296355] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)901worker2 # [ 0.313363] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]902worker1 # [ 0.295967] x86/mm: Memory block size: 128MB903worker2 # [ 0.314144] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry904client # [ 0.311704] audit: type=2000 audit(1789894755.139:1): state=initialized audit_enabled=0 res=1905lb # [ 0.296818] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).906worker2 # [ 0.315152] PCI: Using configuration type 1 for base access907lb # [ 0.297869] pinctrl core: initialized pinctrl subsystem908client # [ 0.312963] thermal_sys: Registered thermal governor 'power_allocator'909client # [ 0.312977] cpuidle: using governor menu910worker1 # [ 0.297796] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)911lb # [ 0.299033] PM: RTC time: 08:59:14, date: 2026-09-20912worker2 # [ 0.316234] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.913client # [ 0.315179] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5914worker1 # [ 0.298812] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).915worker1 # [ 0.300006] pinctrl core: initialized pinctrl subsystem916client # [ 0.316214] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]917worker1 # [ 0.301229] PM: RTC time: 08:59:14, date: 2026-09-20918lb # [ 0.302583] NET: Registered PF_NETLINK/PF_ROUTE protocol family919client # [ 0.316963] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry920client # [ 0.317972] PCI: Using configuration type 1 for base access921lb # [ 0.304007] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations922client # [ 0.319116] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.923lb # [ 0.304818] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations924worker1 # [ 0.304779] NET: Registered PF_NETLINK/PF_ROUTE protocol family925worker2 # [ 0.323384] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages926lb # [ 0.306076] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations927worker2 # [ 0.324142] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page928worker1 # [ 0.306187] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations929lb # [ 0.306801] audit: initializing netlink subsys (disabled)930worker1 # [ 0.306941] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations931lb # [ 0.307792] audit: type=2000 audit(1789894755.155:1): state=initialized audit_enabled=0 res=1932lb # [ 0.308937] thermal_sys: Registered thermal governor 'fair_share'933worker1 # [ 0.308207] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations934client # [ 0.324221] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages935lb # [ 0.308939] thermal_sys: Registered thermal governor 'bang_bang'936worker1 # [ 0.308926] audit: initializing netlink subsys (disabled)937client # [ 0.324962] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page938lb # [ 0.309791] thermal_sys: Registered thermal governor 'step_wise'939worker2 # [ 0.329142] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages940worker1 # [ 0.310009] thermal_sys: Registered thermal governor 'fair_share'941lb # [ 0.310697] thermal_sys: Registered thermal governor 'user_space'942worker2 # [ 0.330142] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page943worker1 # [ 0.310012] thermal_sys: Registered thermal governor 'bang_bang'944lb # [ 0.311475] thermal_sys: Registered thermal governor 'power_allocator'945worker1 # [ 0.310916] thermal_sys: Registered thermal governor 'step_wise'946lb # [ 0.311805] cpuidle: using governor menu947worker1 # [ 0.311864] thermal_sys: Registered thermal governor 'user_space'948lb # [ 0.314043] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5949client # [ 0.329961] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages950worker1 # [ 0.312680] audit: type=2000 audit(1789894755.160:1): state=initialized audit_enabled=0 res=1951client # [ 0.330960] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page952worker1 # [ 0.313919] thermal_sys: Registered thermal governor 'power_allocator'953lb # [ 0.315071] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]954worker1 # [ 0.313933] cpuidle: using governor menu955lb # [ 0.315793] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry956worker1 # [ 0.316160] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5957lb # [ 0.316801] PCI: Using configuration type 1 for base access958worker2 # [ 0.338756] ACPI: Added _OSI(Module Device)959worker1 # [ 0.317146] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]960lb # [ 0.318008] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.961worker2 # [ 0.339143] ACPI: Added _OSI(Processor Device)962worker1 # [ 0.317919] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry963worker2 # [ 0.339889] ACPI: Added _OSI(Processor Aggregator Device)964worker1 # [ 0.318927] PCI: Using configuration type 1 for base access965worker1 # [ 0.320062] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.966client # [ 0.341315] ACPI: Added _OSI(Module Device)967client # [ 0.341962] ACPI: Added _OSI(Processor Device)968lb # [ 0.324809] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages969client # [ 0.342713] ACPI: Added _OSI(Processor Aggregator Device)970lb # [ 0.325791] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page971worker1 # [ 0.325154] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages972worker2 # [ 0.346661] ACPI: 1 ACPI AML tables successfully acquired and loaded973worker1 # [ 0.325917] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page974worker2 # [ 0.350065] ACPI: Interpreter enabled975lb # [ 0.330791] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages976worker2 # [ 0.350624] ACPI: PM: (supports S0 S3 S4 S5)977lb # [ 0.331791] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page978worker2 # [ 0.351142] ACPI: Using IOAPIC for interrupt routing979worker1 # [ 0.330917] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages980worker2 # [ 0.352019] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug981worker1 # [ 0.331915] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page982client # [ 0.351508] ACPI: 1 ACPI AML tables successfully acquired and loaded983worker2 # [ 0.357142] PCI: Using E820 reservations for host bridge windows984client # [ 0.355381] ACPI: Interpreter enabled985worker2 # [ 0.358279] ACPI: Enabled 2 GPEs in block 00 to 3F986client # [ 0.355976] ACPI: PM: (supports S0 S3 S4 S5)987client # [ 0.356697] ACPI: Using IOAPIC for interrupt routing988client # [ 0.357023] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug989lb # [ 0.343024] ACPI: Added _OSI(Module Device)990client # [ 0.357961] PCI: Using E820 reservations for host bridge windows991lb # [ 0.343735] ACPI: Added _OSI(Processor Device)992worker1 # [ 0.342286] ACPI: Added _OSI(Module Device)993lb # [ 0.344333] ACPI: Added _OSI(Processor Aggregator Device)994worker1 # [ 0.342917] ACPI: Added _OSI(Processor Device)995worker1 # [ 0.343690] ACPI: Added _OSI(Processor Aggregator Device)996client # [ 0.361072] ACPI: Enabled 2 GPEs in block 00 to 3F997worker2 # [ 0.366880] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])998worker2 # [ 0.367718] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]999lb # [ 0.350524] ACPI: 1 ACPI AML tables successfully acquired and loaded1000worker2 # [ 0.368221] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1001worker2 # [ 0.369265] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1002worker2 # [ 0.370494] PCI host bridge to bus 0000:001003worker2 # [ 0.371145] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1004client # [ 0.369809] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1005worker1 # [ 0.352152] ACPI: 1 ACPI AML tables successfully acquired and loaded1006lb # [ 0.354215] ACPI: Interpreter enabled1007lb # [ 0.354805] ACPI: PM: (supports S0 S3 S4 S5)1008worker2 # [ 0.372141] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1009client # [ 0.370711] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1010lb # [ 0.355499] ACPI: Using IOAPIC for interrupt routing1011worker2 # [ 0.373141] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1012client # [ 0.372527] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1013worker2 # [ 0.374141] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1014worker1 # [ 0.356338] ACPI: Interpreter enabled1015client # [ 0.373084] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1016worker2 # [ 0.375141] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1017worker1 # [ 0.356932] ACPI: PM: (supports S0 S3 S4 S5)1018lb # [ 0.357854] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1019client # [ 0.374359] PCI host bridge to bus 0000:001020worker1 # [ 0.357656] ACPI: Using IOAPIC for interrupt routing1021worker2 # [ 0.376141] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1022lb # [ 0.358792] PCI: Using E820 reservations for host bridge windows1023client # [ 0.374964] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1024worker2 # [ 0.377141] pci_bus 0000:00: root bus resource [bus 00-ff]1025worker1 # [ 0.357978] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1026client # [ 0.375960] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1027worker1 # [ 0.358916] PCI: Using E820 reservations for host bridge windows1028worker2 # [ 0.378097] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1029client # [ 0.376960] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1030lb # [ 0.361864] ACPI: Enabled 2 GPEs in block 00 to 3F1031worker2 # [ 0.379542] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1032client # [ 0.377960] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1033worker1 # [ 0.361998] ACPI: Enabled 2 GPEs in block 00 to 3F1034client # [ 0.378960] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1035client # [ 0.379965] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1036client # [ 0.380988] pci_bus 0000:00: root bus resource [bus 00-ff]1037client # [ 0.382027] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1038lb # [ 0.369465] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1039client # [ 0.383400] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1040worker2 # [ 0.382205] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1041lb # [ 0.369796] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1042worker2 # [ 0.383154] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1043lb # [ 0.370870] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1044worker2 # [ 0.384141] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1045worker1 # [ 0.371055] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1046lb # [ 0.371913] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1047worker2 # [ 0.385422] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1048lb # [ 0.373168] PCI host bridge to bus 0000:001049worker1 # [ 0.372807] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1050lb # [ 0.373795] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1051worker1 # [ 0.373995] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1052lb # [ 0.374790] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1053worker2 # [ 0.387051] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1054worker1 # [ 0.375082] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1055lb # [ 0.375782] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1056client # [ 0.386083] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1057worker1 # [ 0.376288] PCI host bridge to bus 0000:001058lb # [ 0.376705] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1059client # [ 0.386973] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1060worker2 # [ 0.389151] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1061worker1 # [ 0.376920] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1062lb # [ 0.377679] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1063worker2 # [ 0.389976] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1064client # [ 0.387929] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1065worker1 # [ 0.377916] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1066lb # [ 0.378662] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1067worker2 # [ 0.390860] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1068worker1 # [ 0.378915] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1069lb # [ 0.379698] pci_bus 0000:00: root bus resource [bus 00-ff]1070client # [ 0.389108] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1071worker2 # [ 0.391147] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1072worker1 # [ 0.379915] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1073lb # [ 0.380544] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1074client # [ 0.390723] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1075worker1 # [ 0.380916] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1076worker2 # [ 0.392648] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1077lb # [ 0.382214] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1078worker1 # [ 0.381916] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1079worker1 # [ 0.382917] pci_bus 0000:00: root bus resource [bus 00-ff]1080client # [ 0.393981] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1081worker2 # [ 0.395150] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1082worker1 # [ 0.383951] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1083client # [ 0.394839] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1084worker2 # [ 0.395986] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1085client # [ 0.395651] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1086worker2 # [ 0.396887] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1087worker1 # [ 0.385343] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1088client # [ 0.395966] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1089worker2 # [ 0.397692] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1090client # [ 0.397766] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1091lb # [ 0.384863] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1092client # [ 0.399977] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1093lb # [ 0.385847] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1094worker2 # [ 0.400365] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1095client # [ 0.400831] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1096worker2 # [ 0.401777] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1097lb # [ 0.386818] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1098client # [ 0.401705] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1099worker2 # [ 0.402163] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1100lb # [ 0.388103] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1101client # [ 0.402511] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1102worker1 # [ 0.388104] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1103worker2 # [ 0.403680] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1104worker1 # [ 0.388973] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1105lb # [ 0.389485] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1106worker1 # [ 0.389938] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1107worker2 # [ 0.405882] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1108client # [ 0.404967] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1109worker1 # [ 0.391242] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1110worker2 # [ 0.406148] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1111lb # [ 0.392820] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1112client # [ 0.405967] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1113worker2 # [ 0.407080] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1114lb # [ 0.393721] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1115client # [ 0.406878] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1116worker1 # [ 0.392643] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1117lb # [ 0.394514] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1118worker2 # [ 0.408540] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1119client # [ 0.408350] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1120lb # [ 0.394796] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1121worker1 # [ 0.395957] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1122worker2 # [ 0.411148] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1123lb # [ 0.396367] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1124worker1 # [ 0.396861] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1125client # [ 0.409978] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1126worker2 # [ 0.411979] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1127client # [ 0.410788] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1128worker1 # [ 0.397619] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1129worker2 # [ 0.412848] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1130client # [ 0.411684] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1131worker1 # [ 0.397922] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1132lb # [ 0.397819] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1133worker2 # [ 0.413702] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1134lb # [ 0.398693] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1135client # [ 0.412506] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1136worker1 # [ 0.399482] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1137lb # [ 0.399833] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1138client # [ 0.413967] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1139lb # [ 0.401368] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1140worker1 # [ 0.401871] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1141worker2 # [ 0.416050] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1142client # [ 0.414967] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1143worker1 # [ 0.402553] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1144worker2 # [ 0.417149] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1145client # [ 0.415924] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1146worker1 # [ 0.402937] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1147worker2 # [ 0.418078] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1148client # [ 0.417375] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1149lb # [ 0.403807] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1150worker1 # [ 0.404480] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1151worker2 # [ 0.419596] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1152lb # [ 0.404604] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1153lb # [ 0.405488] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1154client # [ 0.419904] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1155worker2 # [ 0.421149] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1156worker2 # [ 0.421970] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1157lb # [ 0.406360] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1158client # [ 0.420643] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1159worker1 # [ 0.407902] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1160worker2 # [ 0.422880] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1161client # [ 0.421704] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1162worker1 # [ 0.408527] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1163worker2 # [ 0.423947] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1164worker1 # [ 0.408938] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1165lb # [ 0.407813] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1166client # [ 0.422560] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1167lb # [ 0.408656] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1168worker2 # [ 0.425424] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1169worker1 # [ 0.410499] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1170client # [ 0.424003] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1171lb # [ 0.409550] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1172client # [ 0.424907] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1173worker2 # [ 0.428142] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1174client # [ 0.425736] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1175worker2 # [ 0.429101] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1176worker1 # [ 0.412943] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1177lb # [ 0.410327] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1178client # [ 0.426793] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1179worker1 # [ 0.413775] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1180worker2 # [ 0.430498] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1181lb # [ 0.411798] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1182worker1 # [ 0.414656] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1183client # [ 0.428291] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1184lb # [ 0.412655] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1185worker2 # [ 0.432149] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1186lb # [ 0.413527] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1187worker1 # [ 0.415482] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1188client # [ 0.429756] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1189worker2 # [ 0.432997] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1190client # [ 0.430687] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1191lb # [ 0.414357] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1192worker2 # [ 0.433854] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1193worker1 # [ 0.417635] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1194client # [ 0.431540] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1195worker1 # [ 0.417923] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1196worker2 # [ 0.434688] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1197worker1 # [ 0.418897] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1198client # [ 0.432967] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1199lb # [ 0.417790] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1200worker2 # [ 0.436148] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1201client # [ 0.433834] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1202lb # [ 0.418625] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1203worker1 # [ 0.420436] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1204worker2 # [ 0.436982] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1205client # [ 0.434697] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1206lb # [ 0.419498] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1207worker2 # [ 0.437868] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1208lb # [ 0.420432] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1209client # [ 0.436060] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1210worker2 # [ 0.438704] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1211worker1 # [ 0.422941] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1212worker2 # [ 0.439703] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1213worker1 # [ 0.423832] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1214client # [ 0.437996] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1215lb # [ 0.421814] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1216worker1 # [ 0.424653] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1217client # [ 0.438842] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1218lb # [ 0.422653] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1219worker2 # [ 0.440333] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1220client # [ 0.439683] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1221lb # [ 0.423526] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1222worker1 # [ 0.425510] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1223worker2 # [ 0.442823] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1224lb # [ 0.423810] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1225client # [ 0.440516] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1226client # [ 0.441506] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1227worker1 # [ 0.427735] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1228lb # [ 0.425344] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1229worker1 # [ 0.428557] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1230client # [ 0.442165] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1231lb # [ 0.426803] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1232worker1 # [ 0.428959] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1233client # [ 0.443517] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1234lb # [ 0.427813] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1235worker1 # [ 0.429923] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1236lb # [ 0.429368] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1237worker1 # [ 0.431463] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1238lb # [ 0.430817] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1239worker1 # [ 0.432949] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1240worker1 # [ 0.433938] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1241lb # [ 0.431707] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1242worker2 # [ 0.443351] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1243lb # [ 0.432812] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1244worker1 # [ 0.435491] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1245worker2 # [ 0.445759] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1246lb # [ 0.434328] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1247worker2 # [ 0.446376] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1248lb # [ 0.435797] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1249worker2 # [ 0.447688] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1250worker1 # [ 0.436924] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1251client # [ 0.444162] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1252lb # [ 0.436666] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1253worker1 # [ 0.438553] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1254lb # [ 0.437520] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1255worker2 # [ 0.448400] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1256client # [ 0.446454] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1257worker1 # [ 0.438938] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1258worker2 # [ 0.449427] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1259client # [ 0.447200] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1260lb # [ 0.438368] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1261worker1 # [ 0.440472] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1262client # [ 0.448470] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1263worker2 # [ 0.450384] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1264lb # [ 0.439801] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1265worker1 # [ 0.441922] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1266client # [ 0.449258] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1267worker2 # [ 0.452133] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1268lb # [ 0.440873] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1269worker1 # [ 0.442752] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1270worker2 # [ 0.452944] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1271worker1 # [ 0.443649] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1272client # [ 0.450582] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1273lb # [ 0.442467] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1274worker2 # [ 0.454162] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1275client # [ 0.451216] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1276worker2 # [ 0.455726] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1277worker1 # [ 0.444488] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1278client # [ 0.452767] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1279client # [ 0.453643] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1280worker1 # [ 0.445734] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1281client # [ 0.454276] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1282worker1 # [ 0.446802] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1283worker2 # [ 0.459511] ACPI: PCI: Interrupt link LNKA configured for IRQ 101284client # [ 0.455560] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1285worker1 # [ 0.448592] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1286worker2 # [ 0.460259] ACPI: PCI: Interrupt link LNKB configured for IRQ 101287worker2 # [ 0.461250] ACPI: PCI: Interrupt link LNKC configured for IRQ 111288worker2 # [ 0.462237] ACPI: PCI: Interrupt link LNKD configured for IRQ 111289worker2 # [ 0.463245] ACPI: PCI: Interrupt link LNKE configured for IRQ 101290client # [ 0.459246] ACPI: PCI: Interrupt link LNKA configured for IRQ 101291worker2 # [ 0.464237] ACPI: PCI: Interrupt link LNKF configured for IRQ 101292client # [ 0.460068] ACPI: PCI: Interrupt link LNKB configured for IRQ 101293lb # [ 0.442977] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1294worker2 # [ 0.465240] ACPI: PCI: Interrupt link LNKG configured for IRQ 111295client # [ 0.461071] ACPI: PCI: Interrupt link LNKC configured for IRQ 111296worker2 # [ 0.466243] ACPI: PCI: Interrupt link LNKH configured for IRQ 111297lb # [ 0.445441] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1298client # [ 0.462060] ACPI: PCI: Interrupt link LNKD configured for IRQ 111299worker2 # [ 0.467184] ACPI: PCI: Interrupt link GSIA configured for IRQ 161300client # [ 0.463059] ACPI: PCI: Interrupt link LNKE configured for IRQ 101301lb # [ 0.446051] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1302worker2 # [ 0.468157] ACPI: PCI: Interrupt link GSIB configured for IRQ 171303client # [ 0.464056] ACPI: PCI: Interrupt link LNKF configured for IRQ 101304worker2 # [ 0.469108] ACPI: PCI: Interrupt link GSIC configured for IRQ 181305lb # [ 0.447349] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1306client # [ 0.465067] ACPI: PCI: Interrupt link LNKG configured for IRQ 111307worker2 # [ 0.469930] ACPI: PCI: Interrupt link GSID configured for IRQ 191308client # [ 0.466063] ACPI: PCI: Interrupt link LNKH configured for IRQ 111309worker2 # [ 0.470878] ACPI: PCI: Interrupt link GSIE configured for IRQ 201310lb # [ 0.448831] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1311client # [ 0.466995] ACPI: PCI: Interrupt link GSIA configured for IRQ 161312worker2 # [ 0.471154] ACPI: PCI: Interrupt link GSIF configured for IRQ 211313worker1 # [ 0.449117] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1314worker2 # [ 0.472081] ACPI: PCI: Interrupt link GSIG configured for IRQ 221315client # [ 0.467974] ACPI: PCI: Interrupt link GSIB configured for IRQ 171316lb # [ 0.450110] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1317worker2 # [ 0.472834] ACPI: PCI: Interrupt link GSIH configured for IRQ 231318client # [ 0.468923] ACPI: PCI: Interrupt link GSIC configured for IRQ 181319worker1 # [ 0.451638] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1320lb # [ 0.451034] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1321client # [ 0.469691] ACPI: PCI: Interrupt link GSID configured for IRQ 191322worker2 # [ 0.474186] iommu: Default domain type: Translated1323worker1 # [ 0.452190] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1324client # [ 0.469979] ACPI: PCI: Interrupt link GSIE configured for IRQ 201325lb # [ 0.452796] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1326worker2 # [ 0.474967] iommu: DMA domain TLB invalidation policy: lazy mode1327client # [ 0.470899] ACPI: PCI: Interrupt link GSIF configured for IRQ 211328worker1 # [ 0.453594] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1329lb # [ 0.453607] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1330worker2 # [ 0.476101] ACPI: bus type USB registered1331client # [ 0.471697] ACPI: PCI: Interrupt link GSIG configured for IRQ 221332worker2 # [ 0.476675] usbcore: registered new interface driver usbfs1333client # [ 0.471975] ACPI: PCI: Interrupt link GSIH configured for IRQ 231334worker1 # [ 0.454185] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1335lb # [ 0.454812] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1336worker2 # [ 0.477157] usbcore: registered new interface driver hub1337worker2 # [ 0.478046] usbcore: registered new device driver usb1338worker1 # [ 0.455222] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1339client # [ 0.474035] iommu: Default domain type: Translated1340lb # [ 0.456778] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1341client # [ 0.474838] iommu: DMA domain TLB invalidation policy: lazy mode1342worker2 # [ 0.479591] NetLabel: Initializing1343worker1 # [ 0.456172] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1344worker2 # [ 0.480142] NetLabel: domain hash size = 1281345client # [ 0.475981] ACPI: bus type USB registered1346worker2 # [ 0.480872] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1347client # [ 0.476766] usbcore: registered new interface driver usbfs1348worker2 # [ 0.481178] NetLabel: unlabeled traffic allowed by default1349worker1 # [ 0.457962] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1350client # [ 0.477685] usbcore: registered new interface driver hub1351lb # [ 0.460403] ACPI: PCI: Interrupt link LNKA configured for IRQ 101352worker2 # [ 0.482049] PCI: Using ACPI for IRQ routing1353client # [ 0.477972] usbcore: registered new device driver usb1354worker1 # [ 0.458812] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1355lb # [ 0.460900] ACPI: PCI: Interrupt link LNKB configured for IRQ 101356client # [ 0.479723] NetLabel: Initializing1357lb # [ 0.461892] ACPI: PCI: Interrupt link LNKC configured for IRQ 111358worker1 # [ 0.460253] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1359client # [ 0.479966] NetLabel: domain hash size = 1281360lb # [ 0.462893] ACPI: PCI: Interrupt link LNKD configured for IRQ 111361client # [ 0.480702] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1362lb # [ 0.463888] ACPI: PCI: Interrupt link LNKE configured for IRQ 101363worker1 # [ 0.461711] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1364client # [ 0.481001] NetLabel: unlabeled traffic allowed by default1365client # [ 0.481897] PCI: Using ACPI for IRQ routing1366lb # [ 0.464894] ACPI: PCI: Interrupt link LNKF configured for IRQ 101367lb # [ 0.465894] ACPI: PCI: Interrupt link LNKG configured for IRQ 111368lb # [ 0.466887] ACPI: PCI: Interrupt link LNKH configured for IRQ 111369worker1 # [ 0.465534] ACPI: PCI: Interrupt link LNKA configured for IRQ 101370lb # [ 0.467833] ACPI: PCI: Interrupt link GSIA configured for IRQ 161371worker1 # [ 0.466021] ACPI: PCI: Interrupt link LNKB configured for IRQ 101372lb # [ 0.468806] ACPI: PCI: Interrupt link GSIB configured for IRQ 171373worker1 # [ 0.467016] ACPI: PCI: Interrupt link LNKC configured for IRQ 111374lb # [ 0.469804] ACPI: PCI: Interrupt link GSIC configured for IRQ 181375lb # [ 0.470803] ACPI: PCI: Interrupt link GSID configured for IRQ 191376worker1 # [ 0.468012] ACPI: PCI: Interrupt link LNKD configured for IRQ 111377lb # [ 0.471762] ACPI: PCI: Interrupt link GSIE configured for IRQ 201378worker1 # [ 0.469014] ACPI: PCI: Interrupt link LNKE configured for IRQ 101379lb # [ 0.472565] ACPI: PCI: Interrupt link GSIF configured for IRQ 211380worker1 # [ 0.470013] ACPI: PCI: Interrupt link LNKF configured for IRQ 101381lb # [ 0.473532] ACPI: PCI: Interrupt link GSIG configured for IRQ 221382worker1 # [ 0.471016] ACPI: PCI: Interrupt link LNKG configured for IRQ 111383lb # [ 0.473802] ACPI: PCI: Interrupt link GSIH configured for IRQ 231384worker1 # [ 0.472014] ACPI: PCI: Interrupt link LNKH configured for IRQ 111385worker1 # [ 0.472953] ACPI: PCI: Interrupt link GSIA configured for IRQ 161386lb # [ 0.475757] iommu: Default domain type: Translated1387worker1 # [ 0.473928] ACPI: PCI: Interrupt link GSIB configured for IRQ 171388lb # [ 0.476345] iommu: DMA domain TLB invalidation policy: lazy mode1389worker1 # [ 0.474929] ACPI: PCI: Interrupt link GSIC configured for IRQ 181390lb # [ 0.477049] ACPI: bus type USB registered1391worker1 # [ 0.475931] ACPI: PCI: Interrupt link GSID configured for IRQ 191392worker1 # [ 0.476930] ACPI: PCI: Interrupt link GSIE configured for IRQ 201393lb # [ 0.477815] usbcore: registered new interface driver usbfs1394worker1 # [ 0.477928] ACPI: PCI: Interrupt link GSIF configured for IRQ 211395lb # [ 0.478810] usbcore: registered new interface driver hub1396worker1 # [ 0.478924] ACPI: PCI: Interrupt link GSIG configured for IRQ 221397lb # [ 0.479749] usbcore: registered new device driver usb1398worker1 # [ 0.479927] ACPI: PCI: Interrupt link GSIH configured for IRQ 231399lb # [ 0.481373] NetLabel: Initializing1400worker1 # [ 0.482087] iommu: Default domain type: Translated1401lb # [ 0.482284] NetLabel: domain hash size = 1281402worker1 # [ 0.482922] iommu: DMA domain TLB invalidation policy: lazy mode1403lb # [ 0.482790] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1404worker1 # [ 0.484182] ACPI: bus type USB registered1405lb # [ 0.483861] NetLabel: unlabeled traffic allowed by default1406worker1 # [ 0.484949] usbcore: registered new interface driver usbfs1407lb # [ 0.484804] PCI: Using ACPI for IRQ routing1408worker1 # [ 0.485894] usbcore: registered new interface driver hub1409worker1 # [ 0.486619] usbcore: registered new device driver usb1410worker1 # [ 0.487964] NetLabel: Initializing1411worker1 # [ 0.488642] NetLabel: domain hash size = 1281412worker1 # [ 0.488916] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker1 # [ 0.489907] NetLabel: unlabeled traffic allowed by default1414worker1 # [ 0.490671] PCI: Using ACPI for IRQ routing1415worker2 # [ 0.525121] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker2 # [ 0.525137] pci 0000:00:01.0: vgaarb: bridge control possible1417worker2 # [ 0.525137] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker2 # [ 0.525146] vgaarb: loaded1419worker2 # [ 0.525891] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker2 # [ 0.526142] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.525696] pci 0000:00:01.0: vgaarb: setting as boot VGA device1422client # [ 0.525956] pci 0000:00:01.0: vgaarb: bridge control possible1423client # [ 0.525956] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1424client # [ 0.525965] vgaarb: loaded1425worker2 # [ 0.531227] clocksource: Switched to clocksource kvm-clock1426client # [ 0.526716] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01427client # [ 0.526961] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1428worker2 # [ 0.532880] VFS: Disk quotas dquot_6.6.01429worker2 # [ 0.535324] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1430worker2 # [ 0.536714] pnp: PnP ACPI init1431client # [ 0.530047] clocksource: Switched to clocksource kvm-clock1432worker2 # [ 0.537499] ACPI: IRQ 4 override to edge(!), high(!)1433worker2 # [ 0.538515] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1434worker2 # [ 0.540091] pnp: PnP ACPI: found 6 devices1435client # [ 0.533631] VFS: Disk quotas dquot_6.6.01436client # [ 0.534358] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1437client # [ 0.535798] pnp: PnP ACPI init1438client # [ 0.536642] ACPI: IRQ 4 override to edge(!), high(!)1439client # [ 0.537685] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1440client # [ 0.539286] pnp: PnP ACPI: found 6 devices1441worker2 # [ 0.547645] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1442worker2 # [ 0.549157] clocksource: Switched to clocksource acpi_pm1443lb # [ 0.528410] pci 0000:00:01.0: vgaarb: setting as boot VGA device1444worker2 # [ 0.550151] NET: Registered PF_INET protocol family1445lb # [ 0.528786] pci 0000:00:01.0: vgaarb: bridge control possible1446worker2 # [ 0.551318] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1447lb # [ 0.528786] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1448lb # [ 0.528795] vgaarb: loaded1449lb # [ 0.529555] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01450client # [ 0.547161] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1451lb # [ 0.529790] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1452client # [ 0.548627] clocksource: Switched to clocksource acpi_pm1453client # [ 0.549600] NET: Registered PF_INET protocol family1454client # [ 0.550870] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1455worker1 # [ 0.534086] pci 0000:00:01.0: vgaarb: setting as boot VGA device1456worker1 # [ 0.534912] pci 0000:00:01.0: vgaarb: bridge control possible1457lb # [ 0.533890] clocksource: Switched to clocksource kvm-clock1458worker1 # [ 0.534912] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1459worker1 # [ 0.534921] vgaarb: loaded1460lb # [ 0.535532] VFS: Disk quotas dquot_6.6.01461worker1 # [ 0.535668] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01462worker1 # [ 0.535917] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1463lb # [ 0.538073] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1464lb # [ 0.539477] pnp: PnP ACPI init1465lb # [ 0.540303] ACPI: IRQ 4 override to edge(!), high(!)1466lb # [ 0.541308] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1467worker2 # [ 0.567703] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1468lb # [ 0.542843] pnp: PnP ACPI: found 6 devices1469worker2 # [ 0.569280] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1470worker2 # [ 0.570621] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1471worker1 # [ 0.544010] clocksource: Switched to clocksource kvm-clock1472worker2 # [ 0.572010] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1473worker2 # [ 0.573283] TCP: Hash tables configured (established 16384 bind 16384)1474worker2 # [ 0.574423] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1475client # [ 0.567864] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1476worker1 # [ 0.547580] VFS: Disk quotas dquot_6.6.01477worker2 # [ 0.575635] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1478worker1 # [ 0.548270] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1479client # [ 0.569405] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1480worker2 # [ 0.576689] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1481worker1 # [ 0.549554] pnp: PnP ACPI init1482lb # [ 0.550436] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1483client # [ 0.570683] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1484worker2 # [ 0.577839] NET: Registered PF_UNIX/PF_LOCAL protocol family1485lb # [ 0.551832] clocksource: Switched to clocksource acpi_pm1486worker1 # [ 0.550344] ACPI: IRQ 4 override to edge(!), high(!)1487worker2 # [ 0.578753] NET: Registered PF_XDP protocol family1488client # [ 0.571967] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1489lb # [ 0.552752] NET: Registered PF_INET protocol family1490worker1 # [ 0.551263] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1491worker2 # [ 0.579552] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1492client # [ 0.573187] TCP: Hash tables configured (established 16384 bind 16384)1493worker1 # [ 0.552736] pnp: PnP ACPI: found 6 devices1494worker2 # [ 0.580524] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1495lb # [ 0.554182] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1496client # [ 0.574304] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1497worker2 # [ 0.581485] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1498client # [ 0.575543] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1499worker2 # [ 0.582613] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1500client # [ 0.576662] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1501worker2 # [ 0.583711] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1502client # [ 0.577914] NET: Registered PF_UNIX/PF_LOCAL protocol family1503worker2 # [ 0.584825] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1504client # [ 0.578894] NET: Registered PF_XDP protocol family1505worker2 # [ 0.586503] ACPI: \_SB_.GSIA: Enabled at IRQ 161506client # [ 0.579725] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1507client # [ 0.580757] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1508client # [ 0.581818] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1509worker2 # [ 0.588692] ACPI: \_SB_.GSIB: Enabled at IRQ 171510worker1 # [ 0.560357] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1511worker1 # [ 0.561811] clocksource: Switched to clocksource acpi_pm1512client # [ 0.582909] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1513worker1 # [ 0.562844] NET: Registered PF_INET protocol family1514worker2 # [ 0.590743] ACPI: \_SB_.GSIC: Enabled at IRQ 181515client # [ 0.584065] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1516client # [ 0.585168] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1517worker1 # [ 0.564009] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1518worker2 # [ 0.592694] ACPI: \_SB_.GSID: Enabled at IRQ 191519client # [ 0.586901] ACPI: \_SB_.GSIA: Enabled at IRQ 161520worker2 # [ 0.594491] PCI: CLS 0 bytes, default 641521client # [ 0.589524] ACPI: \_SB_.GSIB: Enabled at IRQ 171522worker2 # [ 0.595373] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1523worker2 # [ 0.597087] Trying to unpack rootfs image as initramfs...1524lb # [ 0.570568] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1525client # [ 0.591547] ACPI: \_SB_.GSIC: Enabled at IRQ 181526lb # [ 0.572117] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1527client # [ 0.593528] ACPI: \_SB_.GSID: Enabled at IRQ 191528lb # [ 0.573480] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1529lb # [ 0.574894] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1530client # [ 0.595308] PCI: CLS 0 bytes, default 641531lb # [ 0.576233] TCP: Hash tables configured (established 16384 bind 16384)1532client # [ 0.596227] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1533lb # [ 0.577408] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1534client # [ 0.598001] Trying to unpack rootfs image as initramfs...1535lb # [ 0.578779] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1536lb # [ 0.579909] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1537lb # [ 0.581175] NET: Registered PF_UNIX/PF_LOCAL protocol family1538lb # [ 0.582330] NET: Registered PF_XDP protocol family1539worker1 # [ 0.581054] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1540lb # [ 0.583300] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1541worker1 # [ 0.582607] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1542lb # [ 0.584411] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1543lb # [ 0.585523] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1544worker1 # [ 0.583926] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1545lb # [ 0.586794] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1546worker1 # [ 0.585539] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1547lb # [ 0.588026] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1548worker1 # [ 0.586816] TCP: Hash tables configured (established 16384 bind 16384)1549lb # [ 0.589250] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1550worker1 # [ 0.587934] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1551worker1 # [ 0.589236] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1552lb # [ 0.591121] ACPI: \_SB_.GSIA: Enabled at IRQ 161553worker1 # [ 0.590312] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1554worker1 # [ 0.591559] NET: Registered PF_UNIX/PF_LOCAL protocol family1555lb # [ 0.593764] ACPI: \_SB_.GSIB: Enabled at IRQ 171556worker1 # [ 0.592553] NET: Registered PF_XDP protocol family1557worker1 # [ 0.593393] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1558lb # [ 0.595789] ACPI: \_SB_.GSIC: Enabled at IRQ 181559worker1 # [ 0.594497] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1560worker1 # [ 0.595522] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1561lb # [ 0.597831] ACPI: \_SB_.GSID: Enabled at IRQ 191562worker1 # [ 0.596668] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1563lb # [ 0.599574] PCI: CLS 0 bytes, default 641564worker1 # [ 0.597811] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1565worker1 # [ 0.598935] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1566lb # [ 0.600547] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1567worker1 # [ 0.600698] ACPI: \_SB_.GSIA: Enabled at IRQ 161568lb # [ 0.602489] Trying to unpack rootfs image as initramfs...1569worker1 # [ 0.603242] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker1 # [ 0.605244] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker1 # [ 0.607183] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker1 # [ 0.608851] PCI: CLS 0 bytes, default 641573worker1 # [ 0.609771] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574worker1 # [ 0.611568] Trying to unpack rootfs image as initramfs...1575worker2 # [ 0.641157] Initialise system trusted keyrings1576worker2 # [ 0.644230] workingset: timestamp_bits=40 max_order=19 bucket_order=01577client # [ 0.639899] Initialise system trusted keyrings1578client # [ 0.642809] workingset: timestamp_bits=40 max_order=19 bucket_order=01579worker2 # [ 0.667215] Key type asymmetric registered1580worker2 # [ 0.667931] Asymmetric key parser 'x509' registered1581worker2 # [ 0.668823] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1582worker2 # [ 0.671316] io scheduler mq-deadline registered1583worker2 # [ 0.672108] io scheduler kyber registered1584client # [ 0.665693] Key type asymmetric registered1585client # [ 0.666410] Asymmetric key parser 'x509' registered1586lb # [ 0.647207] Initialise system trusted keyrings1587client # [ 0.667301] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1588lb # [ 0.648262] workingset: timestamp_bits=40 max_order=19 bucket_order=01589worker2 # [ 0.676196] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1590client # [ 0.670787] io scheduler mq-deadline registered1591worker2 # [ 0.677509] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1592client # [ 0.671542] io scheduler kyber registered1593client # [ 0.674286] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1594worker2 # [ 0.682977] Linux agpgart interface v0.1031595worker2 # [ 0.683745] ACPI: bus type drm_connector registered1596worker1 # [ 0.656646] Initialise system trusted keyrings1597client # [ 0.677667] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1598client # [ 0.681281] Linux agpgart interface v0.1031599worker1 # [ 0.660278] workingset: timestamp_bits=40 max_order=19 bucket_order=01600worker2 # [ 0.688336] usbcore: registered new interface driver usbserial_generic1601client # [ 0.682081] ACPI: bus type drm_connector registered1602worker2 # [ 0.689367] usbserial: USB Serial support registered for generic1603client # [ 0.685115] usbcore: registered new interface driver usbserial_generic1604worker2 # [ 0.692191] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1605client # [ 0.686300] usbserial: USB Serial support registered for generic1606worker2 # [ 0.692191] Please enable it if your BIOS has the CPPC option.1607worker2 # [ 0.694449] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1608client # [ 0.689646] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1609worker2 # [ 0.697353] drop_monitor: Initializing network drop monitor service1610client # [ 0.689646] Please enable it if your BIOS has the CPPC option.1611worker2 # [ 0.698453] NET: Registered PF_INET6 protocol family1612client # [ 0.691902] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1613lb # [ 0.672843] Key type asymmetric registered1614lb # [ 0.673726] Asymmetric key parser 'x509' registered1615worker2 # [ 0.701606] Segment Routing with IPv61616client # [ 0.695760] drop_monitor: Initializing network drop monitor service1617lb # [ 0.675751] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1618client # [ 0.696943] NET: Registered PF_INET6 protocol family1619worker2 # [ 0.704215] In-situ OAM (IOAM) with IPv61620lb # [ 0.678763] io scheduler mq-deadline registered1621worker2 # [ 0.705224] IPI shorthand broadcast: enabled1622lb # [ 0.679612] io scheduler kyber registered1623client # [ 0.700096] Segment Routing with IPv61624worker1 # [ 0.681538] Key type asymmetric registered1625client # [ 0.703657] In-situ OAM (IOAM) with IPv61626lb # [ 0.683715] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1627client # [ 0.704744] IPI shorthand broadcast: enabled1628lb # [ 0.685140] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1629worker1 # [ 0.684266] Asymmetric key parser 'x509' registered1630worker1 # [ 0.685112] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1631worker2 # [ 0.713303] sched_clock: Marking stable (578014028, 135162034)->(787876341, -74700279)1632worker1 # [ 0.688366] io scheduler mq-deadline registered1633lb # [ 0.690485] Linux agpgart interface v0.1031634worker1 # [ 0.689179] io scheduler kyber registered1635worker2 # [ 0.717405] registered taskstats version 11636lb # [ 0.691331] ACPI: bus type drm_connector registered1637worker2 # [ 0.718325] Loading compiled-in X.509 certificates1638worker1 # [ 0.691773] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1639client # [ 0.713112] sched_clock: Marking stable (580013879, 132614106)->(788540937, -75912952)1640worker1 # [ 0.693095] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1641lb # [ 0.696143] usbcore: registered new interface driver usbserial_generic1642lb # [ 0.697409] usbserial: USB Serial support registered for generic1643client # [ 0.717874] registered taskstats version 11644client # [ 0.718823] Loading compiled-in X.509 certificates1645worker1 # [ 0.698874] Linux agpgart interface v0.1031646worker1 # [ 0.699696] ACPI: bus type drm_connector registered1647lb # [ 0.700722] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1648lb # [ 0.700722] Please enable it if your BIOS has the CPPC option.1649lb # [ 0.703177] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1650worker1 # [ 0.702722] usbcore: registered new interface driver usbserial_generic1651worker1 # [ 0.703853] usbserial: USB Serial support registered for generic1652lb # [ 0.706838] drop_monitor: Initializing network drop monitor service1653lb # [ 0.708185] NET: Registered PF_INET6 protocol family1654worker1 # [ 0.707245] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1655worker2 # [ 0.736193] Demotion targets for Node 0: null1656worker1 # [ 0.707245] Please enable it if your BIOS has the CPPC option.1657worker2 # [ 0.737016] Key type .fscrypt registered1658worker1 # [ 0.709498] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1659lb # [ 0.713001] Segment Routing with IPv61660lb # [ 0.713770] In-situ OAM (IOAM) with IPv61661worker2 # [ 0.740190] Key type fscrypt-provisioning registered1662worker2 # [ 0.741095] ima: No TPM chip found, activating TPM-bypass!1663worker1 # [ 0.713376] drop_monitor: Initializing network drop monitor service1664worker2 # [ 0.741968] ima: Allocated hash algorithm: sha11665worker1 # [ 0.714579] NET: Registered PF_INET6 protocol family1666lb # [ 0.716972] IPI shorthand broadcast: enabled1667client # [ 0.736655] Demotion targets for Node 0: null1668worker2 # [ 0.744211] ima: No architecture policies found1669worker2 # [ 0.745093] PM: Magic number: 10:810:9781670client # [ 0.738676] Key type .fscrypt registered1671worker1 # [ 0.717693] Segment Routing with IPv61672client # [ 0.739341] Key type fscrypt-provisioning registered1673client # [ 0.740306] ima: No TPM chip found, activating TPM-bypass!1674worker1 # [ 0.720254] In-situ OAM (IOAM) with IPv61675worker2 # [ 0.748654] RAS: Correctable Errors collector initialized.1676worker1 # [ 0.721359] IPI shorthand broadcast: enabled1677client # [ 0.744645] ima: Allocated hash algorithm: sha11678client # [ 0.745460] ima: No architecture policies found1679lb # [ 0.725230] sched_clock: Marking stable (591014793, 133678296)->(802513057, -77819968)1680client # [ 0.747646] PM: Magic number: 10:810:9781681lb # [ 0.728784] registered taskstats version 11682client # [ 0.749320] RAS: Correctable Errors collector initialized.1683lb # [ 0.729836] Loading compiled-in X.509 certificates1684worker2 # [ 0.757260] clk: Disabling unused clocks1685worker2 # [ 0.757954] PM: genpd: Disabling unused power domains1686worker1 # [ 0.729748] sched_clock: Marking stable (596013872, 133210164)->(805604812, -76380776)1687worker1 # [ 0.735422] registered taskstats version 11688worker1 # [ 0.736386] Loading compiled-in X.509 certificates1689client # [ 0.758311] clk: Disabling unused clocks1690client # [ 0.762655] PM: genpd: Disabling unused power domains1691lb # [ 0.748712] Demotion targets for Node 0: null1692lb # [ 0.750752] Key type .fscrypt registered1693lb # [ 0.751476] Key type fscrypt-provisioning registered1694lb # [ 0.752525] ima: No TPM chip found, activating TPM-bypass!1695lb # [ 0.754713] ima: Allocated hash algorithm: sha11696lb # [ 0.755576] ima: No architecture policies found1697worker1 # [ 0.755244] Demotion targets for Node 0: null1698worker1 # [ 0.756129] Key type .fscrypt registered1699worker1 # [ 0.756859] Key type fscrypt-provisioning registered1700lb # [ 0.758707] PM: Magic number: 10:810:9781701lb # [ 0.760469] RAS: Correctable Errors collector initialized.1702worker1 # [ 0.760345] ima: No TPM chip found, activating TPM-bypass!1703worker1 # [ 0.761288] ima: Allocated hash algorithm: sha11704worker1 # [ 0.762086] ima: No architecture policies found1705worker1 # [ 0.764404] PM: Magic number: 10:810:9781706worker1 # [ 0.766051] RAS: Correctable Errors collector initialized.1707lb # [ 0.769429] clk: Disabling unused clocks1708lb # [ 0.773719] PM: genpd: Disabling unused power domains1709worker1 # [ 0.776909] clk: Disabling unused clocks1710worker1 # [ 0.779239] PM: genpd: Disabling unused power domains1711worker2 # [ 0.921928] Freeing initrd memory: 29092K1712worker2 # [ 0.925066] Freeing unused decrypted memory: 2028K1713worker2 # [ 0.927677] Freeing unused kernel image (initmem) memory: 3644K1714worker2 # [ 0.928814] Write protecting the kernel read-only data: 32768k1715worker2 # [ 0.930699] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker2 # [ 0.932270] Freeing unused kernel image (rodata/data gap) memory: 752K1717client # [ 0.935308] Freeing initrd memory: 29096K1718client # [ 0.938649] Freeing unused decrypted memory: 2028K1719client # [ 0.941393] Freeing unused kernel image (initmem) memory: 3644K1720client # [ 0.942522] Write protecting the kernel read-only data: 32768k1721client # [ 0.944516] Freeing unused kernel image (text/rodata gap) memory: 1208K1722client # [ 0.946133] Freeing unused kernel image (rodata/data gap) memory: 752K1723worker1 # [ 0.950480] Freeing initrd memory: 29092K1724worker1 # [ 0.953693] Freeing unused decrypted memory: 2028K1725lb # [ 0.955319] Freeing initrd memory: 29092K1726worker2 # [ 0.983453] x86/mm: Checked W+X mappings: passed, no W+X pages found.1727worker1 # [ 0.956405] Freeing unused kernel image (initmem) memory: 3644K1728worker2 # [ 0.984560] Run /init as init process1729lb # [ 0.958766] Freeing unused decrypted memory: 2028K1730worker1 # [ 0.957481] Write protecting the kernel read-only data: 32768k1731worker1 # [ 0.959407] Freeing unused kernel image (text/rodata gap) memory: 1208K1732lb # [ 0.961582] Freeing unused kernel image (initmem) memory: 3644K1733worker1 # [ 0.960955] Freeing unused kernel image (rodata/data gap) memory: 752K1734lb # [ 0.962693] Write protecting the kernel read-only data: 32768k1735lb # [ 0.964728] Freeing unused kernel image (text/rodata gap) memory: 1208K1736lb # [ 0.966263] Freeing unused kernel image (rodata/data gap) memory: 752K1737worker2 # [ 0.994526] systemd[1]: Inserted module 'autofs4'1738client # [ 0.998773] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739client # [ 1.000070] Run /init as init process1740worker2 # [ 1.010775] fuse: init (API version 7.45)1741worker2 # [ 1.016578] ACPI: \_SB_.GSIG: Enabled at IRQ 221742client # [ 1.010848] systemd[1]: Inserted module 'autofs4'1743worker2 # [ 1.018835] ACPI: \_SB_.GSIH: Enabled at IRQ 231744worker2 # [ 1.021793] ACPI: \_SB_.GSIE: Enabled at IRQ 201745worker2 # [ 1.024026] ACPI: \_SB_.GSIF: Enabled at IRQ 211746client # [ 1.027008] fuse: init (API version 7.45)1747client # [ 1.032797] ACPI: \_SB_.GSIG: Enabled at IRQ 221748worker1 # [ 1.012064] x86/mm: Checked W+X mappings: passed, no W+X pages found.1749worker1 # [ 1.013117] Run /init as init process1750client # [ 1.035600] ACPI: \_SB_.GSIH: Enabled at IRQ 231751lb # [ 1.017364] x86/mm: Checked W+X mappings: passed, no W+X pages found.1752lb # [ 1.018492] Run /init as init process1753client # [ 1.039376] ACPI: \_SB_.GSIE: Enabled at IRQ 201754client # [ 1.041904] ACPI: \_SB_.GSIF: Enabled at IRQ 211755worker2 # [ 1.048794] systemd[1]: Successfully made /usr/ read-only.1756worker1 # [ 1.023686] systemd[1]: Inserted module 'autofs4'1757lb # [ 1.030336] systemd[1]: Inserted module 'autofs4'1758worker1 # [ 1.040076] fuse: init (API version 7.45)1759lb # [ 1.047466] fuse: init (API version 7.45)1760worker1 # [ 1.045919] ACPI: \_SB_.GSIG: Enabled at IRQ 221761worker1 # [ 1.048416] ACPI: \_SB_.GSIH: Enabled at IRQ 231762client # [ 1.071836] systemd[1]: Successfully made /usr/ read-only.1763worker1 # [ 1.051397] ACPI: \_SB_.GSIE: Enabled at IRQ 201764lb # [ 1.053420] ACPI: \_SB_.GSIG: Enabled at IRQ 221765worker1 # [ 1.053585] ACPI: \_SB_.GSIF: Enabled at IRQ 211766lb # [ 1.056040] ACPI: \_SB_.GSIH: Enabled at IRQ 231767lb # [ 1.059168] ACPI: \_SB_.GSIE: Enabled at IRQ 201768lb # [ 1.061393] ACPI: \_SB_.GSIF: Enabled at IRQ 211769worker1 # [ 1.082371] systemd[1]: Successfully made /usr/ read-only.1770lb # [ 1.087570] systemd[1]: Successfully made /usr/ read-only.1771worker2 # [ 1.385328] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker2 # [ 1.398632] systemd[1]: Detected virtualization kvm.1773worker2 # [ 1.400802] systemd[1]: Detected architecture x86-64.1774worker2 # [ 1.402900] systemd[1]: Running in initrd.1775worker2 # [ 1.405406] systemd[1]: Initializing machine ID from random generator.1776worker2 # [ 1.408277] systemd[1]: Hostname set to <worker2>.1777client # [ 1.407781] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778client # [ 1.413502] systemd[1]: Detected virtualization kvm.1779client # [ 1.414481] systemd[1]: Detected architecture x86-64.1780client # [ 1.415468] systemd[1]: Running in initrd.1781client # [ 1.416976] systemd[1]: Initializing machine ID from random generator.1782client # [ 1.418423] systemd[1]: Hostname set to <client>.1783worker1 # [ 1.419152] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784worker1 # [ 1.431615] systemd[1]: Detected virtualization kvm.1785lb # [ 1.424106] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1786worker1 # [ 1.433882] systemd[1]: Detected architecture x86-64.1787lb # [ 1.436029] systemd[1]: Detected virtualization kvm.1788worker1 # [ 1.436275] systemd[1]: Running in initrd.1789lb # [ 1.438142] systemd[1]: Detected architecture x86-64.1790worker1 # [ 1.437815] systemd[1]: Initializing machine ID from random generator.1791worker1 # [ 1.438999] systemd[1]: Hostname set to <worker1>.1792lb # [ 1.440235] systemd[1]: Running in initrd.1793lb # [ 1.442791] systemd[1]: Initializing machine ID from random generator.1794lb # [ 1.445523] systemd[1]: Hostname set to <lb>.1795client # [ 1.615349] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker2 # [ 1.632857] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797client # [ 1.655528] systemd[1]: Queued start job for default target Initrd Default Target.1798client # [ 1.659997] systemd[1]: Created slice Slice /system/modprobe.1799worker1 # [ 1.638774] systemd[1]: bpf-restrict-fs: LSM BPF program attached1800client # [ 1.661154] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801client # [ 1.662570] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802client # [ 1.663710] systemd[1]: Reached target Path Units.1803client # [ 1.664571] systemd[1]: Reached target Slice Units.1804client # [ 1.665486] systemd[1]: Reached target Swaps.1805client # [ 1.666314] systemd[1]: Reached target Timer Units.1806client # [ 1.667330] systemd[1]: Listening on D-Bus System Message Bus Socket.1807client # [ 1.668629] systemd[1]: Listening on Journal Socket (/dev/log).1808client # [ 1.669806] systemd[1]: Listening on Journal Sockets.1809client # [ 1.670830] systemd[1]: Listening on udev Control Socket.1810client # [ 1.671858] systemd[1]: Listening on udev Kernel Socket.1811client # [ 1.672836] systemd[1]: Reached target Socket Units.1812client # [ 1.674698] systemd[1]: Starting Create List of Static Device Nodes...1813client # [ 1.678740] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1814worker2 # [ 1.687089] systemd[1]: Queued start job for default target Initrd Default Target.1815worker2 # [ 1.691466] systemd[1]: Created slice Slice /system/modprobe.1816lb # [ 1.664593] systemd[1]: bpf-restrict-fs: LSM BPF program attached1817worker2 # [ 1.692719] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1818client # [ 1.686706] systemd[1]: Starting Load Kernel Module configfs...1819worker2 # [ 1.694100] systemd[1]: Expecting device /dev/disk/by-label/nixos...1820worker2 # [ 1.695239] systemd[1]: Reached target Path Units.1821worker2 # [ 1.696102] systemd[1]: Reached target Slice Units.1822worker2 # [ 1.697011] systemd[1]: Reached target Swaps.1823worker2 # [ 1.697879] systemd[1]: Reached target Timer Units.1824worker2 # [ 1.698869] systemd[1]: Listening on D-Bus System Message Bus Socket.1825worker2 # [ 1.700114] systemd[1]: Listening on Journal Socket (/dev/log).1826worker2 # [ 1.701321] systemd[1]: Listening on Journal Sockets.1827worker2 # [ 1.702344] systemd[1]: Listening on udev Control Socket.1828worker2 # [ 1.703391] systemd[1]: Listening on udev Kernel Socket.1829worker2 # [ 1.704339] systemd[1]: Reached target Socket Units.1830worker2 # [ 1.706098] systemd[1]: Starting Create List of Static Device Nodes...1831worker1 # [ 1.679336] systemd[1]: Queued start job for default target Initrd Default Target.1832worker2 # [ 1.709985] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1833client # [ 1.703708] systemd[1]: Starting Journal Service...1834worker1 # [ 1.682623] systemd[1]: Created slice Slice /system/modprobe.1835worker1 # [ 1.683785] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1836worker1 # [ 1.685159] systemd[1]: Expecting device /dev/disk/by-label/nixos...1837worker1 # [ 1.686309] systemd[1]: Reached target Path Units.1838worker1 # [ 1.687116] systemd[1]: Reached target Slice Units.1839worker1 # [ 1.687981] systemd[1]: Reached target Swaps.1840worker1 # [ 1.688786] systemd[1]: Reached target Timer Units.1841worker2 # [ 1.717358] systemd[1]: Starting Load Kernel Module configfs...1842worker1 # [ 1.689776] systemd[1]: Listening on D-Bus System Message Bus Socket.1843worker1 # [ 1.690965] systemd[1]: Listening on Journal Socket (/dev/log).1844worker1 # [ 1.692110] systemd[1]: Listening on Journal Sockets.1845worker1 # [ 1.693092] systemd[1]: Listening on udev Control Socket.1846worker1 # [ 1.694087] systemd[1]: Listening on udev Kernel Socket.1847worker1 # [ 1.695011] systemd[1]: Reached target Socket Units.1848client # [ 1.716705] systemd[1]: Starting Load Kernel Modules...1849worker1 # [ 1.696883] systemd[1]: Starting Create List of Static Device Nodes...1850worker1 # [ 1.701294] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1851worker2 # [ 1.729647] systemd[1]: Starting Journal Service...1852worker1 # [ 1.707806] systemd[1]: Starting Load Kernel Module configfs...1853client # [ 1.721760] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1854worker2 # [ 1.744240] systemd[1]: Starting Load Kernel Modules...1855lb # [ 1.718050] systemd[1]: Queued start job for default target Initrd Default Target.1856client # [ 1.738453] netfs: FS-Cache loaded1857lb # [ 1.721979] systemd[1]: Created slice Slice /system/modprobe.1858client # [ 1.743243] 9pnet: Installing 9P2000 support1859lb # [ 1.723178] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1860lb # [ 1.724603] systemd[1]: Expecting device /dev/disk/by-label/nixos...1861worker1 # [ 1.723417] systemd[1]: Starting Journal Service...1862lb # [ 1.725793] systemd[1]: Reached target Path Units.1863lb # [ 1.726705] systemd[1]: Reached target Slice Units.1864lb # [ 1.727575] systemd[1]: Reached target Swaps.1865lb # [ 1.728417] systemd[1]: Reached target Timer Units.1866lb # [ 1.729371] systemd[1]: Listening on D-Bus System Message Bus Socket.1867lb # [ 1.730540] systemd[1]: Listening on Journal Socket (/dev/log).1868lb # [ 1.731713] systemd[1]: Listening on Journal Sockets.1869client # [ 1.751803] systemd[1]: Starting Coldplug All udev Devices...1870lb # [ 1.732712] systemd[1]: Listening on udev Control Socket.1871lb # [ 1.733712] systemd[1]: Listening on udev Kernel Socket.1872lb # [ 1.734662] systemd[1]: Reached target Socket Units.1873worker2 # [ 1.749200] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1874lb # [ 1.736393] systemd[1]: Starting Create List of Static Device Nodes...1875worker1 # [ 1.735301] systemd[1]: Starting Load Kernel Modules...1876lb # [ 1.740763] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1877worker2 # [ 1.767716] netfs: FS-Cache loaded1878worker2 # [ 1.772867] 9pnet: Installing 9P2000 support1879client # [ 1.766435] systemd[1]: Finished Create List of Static Device Nodes.1880lb # [ 1.747765] systemd[1]: Starting Load Kernel Module configfs...1881worker1 # [ 1.740278] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1882client # [ 1.773323] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1883worker2 # [ 1.781992] systemd[1]: Starting Coldplug All udev Devices...1884worker1 # [ 1.758808] netfs: FS-Cache loaded1885lb # [ 1.761770] systemd[1]: Starting Journal Service...1886client # [ 1.782031] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1887worker1 # [ 1.763773] 9pnet: Installing 9P2000 support1888client # [ 1.787067] systemd[1]: modprobe@configfs.service: Deactivated successfully.1889client # [ 1.788730] systemd-journald[67]: Collecting audit messages is disabled.1890worker2 # [ 1.798313] systemd[1]: Finished Create List of Static Device Nodes.1891lb # [ 1.772781] systemd[1]: Starting Load Kernel Modules...1892client # [ 1.794023] systemd[1]: Finished Load Kernel Module configfs.1893worker2 # [ 1.803799] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1894client # [ 1.800408] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1895worker1 # [ 1.780325] systemd[1]: Starting Coldplug All udev Devices...1896client # [ 1.802954] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1897worker2 # [ 1.812242] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1898lb # [ 1.779766] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1899client # [ 1.811855] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1900worker2 # [ 1.818596] systemd[1]: modprobe@configfs.service: Deactivated successfully.1901worker2 # [ 1.820017] systemd-journald[67]: Collecting audit messages is disabled.1902client # [ 1.813355] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1903lb # [ 1.797218] netfs: FS-Cache loaded1904worker1 # [ 1.795368] systemd[1]: Finished Create List of Static Device Nodes.1905worker2 # [ 1.825376] systemd[1]: Finished Load Kernel Module configfs.1906lb # [ 1.801962] 9pnet: Installing 9P2000 support1907worker1 # [ 1.799963] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1908worker2 # [ 1.829790] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1909worker1 # [ 1.807691] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1910worker2 # [ 1.834882] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1911worker1 # [ 1.810794] systemd-journald[67]: Collecting audit messages is disabled.1912lb # [ 1.812779] systemd[1]: Starting Coldplug All udev Devices...1913worker1 # [ 1.814672] systemd[1]: modprobe@configfs.service: Deactivated successfully.1914worker2 # [ 1.842130] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1915worker2 # [ 1.843772] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1916worker1 # [ 1.819568] systemd[1]: Finished Load Kernel Module configfs.1917client # [ 1.844201] systemd[1]: Finished Load Kernel Modules.1918worker1 # [ 1.825704] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1919lb # [ 1.828842] systemd[1]: Finished Create List of Static Device Nodes.1920worker1 # [ 1.828624] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1921client # [ 1.851847] systemd[1]: Starting Apply Kernel Variables...1922lb # [ 1.836399] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1923worker1 # [ 1.838273] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1924worker1 # [ 1.840120] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1925lb # [ 1.845104] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1926client # [ 1.864716] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1927lb # [ 1.847563] systemd-journald[67]: Collecting audit messages is disabled.1928worker2 # [ 1.875682] systemd[1]: Finished Load Kernel Modules.1929lb # [ 1.852151] systemd[1]: modprobe@configfs.service: Deactivated successfully.1930client # [ 1.872879] systemd[1]: Starting Create Static Device Nodes in /dev...1931worker2 # [ 1.881093] systemd[1]: Starting Apply Kernel Variables...1932lb # [ 1.857756] systemd[1]: Finished Load Kernel Module configfs.1933lb # [ 1.862237] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1934worker2 # [ 1.891295] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1935lb # [ 1.866642] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1936worker1 # [ 1.870781] systemd[1]: Finished Load Kernel Modules.1937lb # [ 1.874916] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1938client # [ 1.895729] systemd[1]: Finished Apply Kernel Variables.1939worker2 # [ 1.902844] systemd[1]: Starting Create Static Device Nodes in /dev...1940lb # [ 1.877883] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1941worker1 # [ 1.878423] systemd[1]: Starting Apply Kernel Variables...1942client # [ 1.908068] systemd[1]: Started Journal Service.1943client # [ 1.774959] systemd-modules-load[68]: Inserted module 'dm_mod'1944client # [ 1.778247] systemd-modules-load[68]: Inserted module 'virtio_balloon'1945client # [ 1.780287] systemd-modules-load[68]: Inserted module 'virtio_gpu'1946worker1 # [ 1.893356] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1947worker2 # [ 1.922489] systemd[1]: Finished Apply Kernel Variables.1948client # [ 1.784253] systemd[1]: Finished Create Static Device Nodes in /dev.1949client # [ 1.792081] systemd[1]: Reached target Preparation for Local File Systems.1950worker1 # [ 1.903479] systemd[1]: Starting Create Static Device Nodes in /dev...1951client # [ 1.793906] systemd[1]: Reached target Local File Systems.1952client # [ 1.795147] systemd[1]: Starting Create System Files and Directories...1953worker2 # [ 1.935117] systemd[1]: Started Journal Service.1954lb # [ 1.909791] systemd[1]: Finished Load Kernel Modules.1955worker2 # [ 1.802224] systemd-modules-load[68]: Inserted module 'dm_mod'1956worker2 # [ 1.804445] systemd-modules-load[68]: Inserted module 'virtio_balloon'1957client # [ 1.803081] systemd[1]: Starting Rule-based Manager for Device Events and Files...1958worker2 # [ 1.807278] systemd-modules-load[68]: Inserted module 'virtio_gpu'1959worker2 # [ 1.808252] systemd[1]: Finished Create Static Device Nodes in /dev.1960lb # [ 1.917935] systemd[1]: Starting Apply Kernel Variables...1961worker2 # [ 1.809349] systemd[1]: Reached target Preparation for Local File Systems.1962worker2 # [ 1.811885] systemd[1]: Reached target Local File Systems.1963worker1 # [ 1.919319] systemd[1]: Finished Apply Kernel Variables.1964worker2 # [ 1.815096] systemd[1]: Starting Create System Files and Directories...1965worker2 # [ 1.819950] systemd[1]: Starting Rule-based Manager for Device Events and Files...1966worker1 # [ 1.929609] systemd[1]: Started Journal Service.1967lb # [ 1.930808] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1968worker1 # [ 1.797549] systemd-modules-load[68]: Inserted module 'dm_mod'1969worker1 # [ 1.802318] systemd-modules-load[68]: Inserted module 'virtio_balloon'1970worker1 # [ 1.803401] systemd-modules-load[68]: Inserted module 'virtio_gpu'1971lb # [ 1.939320] systemd[1]: Starting Create Static Device Nodes in /dev...1972client # [ 1.830206] systemd[1]: Finished Create System Files and Directories.1973worker1 # [ 1.816214] systemd[1]: Finished Create Static Device Nodes in /dev.1974worker1 # [ 1.817222] systemd[1]: Reached target Preparation for Local File Systems.1975worker1 # [ 1.818238] systemd[1]: Reached target Local File Systems.1976worker2 # [ 1.845884] systemd[1]: Finished Create System Files and Directories.1977worker1 # [ 1.823080] systemd[1]: Starting Create System Files and Directories...1978worker1 # [ 1.828141] systemd[1]: Starting Rule-based Manager for Device Events and Files...1979lb # [ 1.963295] systemd[1]: Finished Apply Kernel Variables.1980client # [ 1.853376] systemd-udevd[83]: Using default interface naming scheme 'v261'.1981lb # [ 1.839435] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.974317] systemd[1]: Started Journal Service.1982lb # 1983lb # [ 1.842543] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984lb # [ 1.845333] systemd-modules-load[68]: Inserted module 'virtio_gpu'1985worker2 # [ 1.874769] systemd-udevd[77]: Using default interface naming scheme 'v261'.1986lb # [ 1.852834] systemd[1]: Finished Create Static Device Nodes in /dev.1987worker1 # [ 1.854502] systemd[1]: Finished Create System Files and Directories.1988client # [ 1.877311] systemd[1]: Started Rule-based Manager for Device Events and Files.1989lb # [ 1.857988] systemd[1]: Reached target Preparation for Local File Systems.1990lb # [ 1.860888] systemd[1]: Reached target Local File Systems.1991lb # [ 1.861896] systemd[1]: Starting Create System Files and Directories...1992lb # [ 1.867340] systemd[1]: Starting Rule-based Manager for Device Events and Files...1993worker2 # [ 1.898763] systemd[1]: Started Rule-based Manager for Device Events and Files.1994worker1 # [ 1.879348] systemd-udevd[83]: Using default interface naming scheme 'v261'.1995lb # [ 1.896992] systemd[1]: Finished Create System Files and Directories.1996client # [ 1.921710] systemd[1]: Finished Coldplug All udev Devices.1997client # [ 1.922729] systemd[1]: Reached target System Initialization.1998client # [ 1.923527] systemd[1]: Reached target Basic System.1999worker1 # [ 1.907076] systemd[1]: Started Rule-based Manager for Device Events and Files.2000worker2 # [ 1.938908] systemd[1]: Finished Coldplug All udev Devices.
loading 1,810 hidden lines…
3811worker2 # [ 10.109068] dhcpcd[691]: DUID 00:01:00:01:32:42:5c:ed:52:54:00:12:34:563812worker2 # [ 10.109984] dhcpcd[691]: eth0: IAID 00:12:34:563813worker2 # [ 10.110906] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:34563814lb # [ 10.109944] dhcpcd[708]: dhcpcd-10.3.2 starting3815lb # [ 10.132467] dhcpcd[770]: dev: loaded udev3816lb # [ 10.134757] systemd[1]: Finished Extra networking commands..3817lb # [ 10.139190] systemd[1]: Reached target Network.3818lb # [ 10.154249] systemd[1]: Starting PostgreSQL Server...3819lb # [ 10.161422] systemd[1]: Starting Permit User Sessions...3820lb # [ 10.301902] 8021q: 802.1Q VLAN Support v1.83821lb # [ 10.302331] 8021q: adding VLAN 0 to HW filter on device eth13822lb # [ 10.371483] kvm_amd: TSC scaling supported3823lb # [ 10.239317] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3824lb # [ 10.376241] kvm_amd: Nested Virtualization enabled3825lb # [ 10.379735] kvm_amd: Nested Paging enabled3826lb # [ 10.380173] kvm_amd: LBR virtualization supported3827lb # [ 10.384006] kvm_amd: Virtual VMLOAD VMSAVE supported3828lb # [ 10.387801] kvm_amd: Virtual GIF supported3829lb # [ 10.388266] kvm_amd: Virtual NMI enabled3830lb # [ 10.268706] systemd[1]: Finished Permit User Sessions.3831lb # [ 10.284291] systemd[1]: Started Getty on tty1.3832lb # [ 10.290399] systemd[1]: Reached target Login Prompts.3833lb # [ 10.509465] EDAC MC: Ver: 3.0.03834lb # [ 10.553517] cfg80211: Loading compiled-in X.509 certificates for regulatory database3835lb # [ 10.583786] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3836lb # [ 10.584529] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3837lb # [ 10.589928] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23838lb # [ 10.590881] cfg80211: failed to load regulatory.db3839worker2 # [ 10.515521] dhcpcd[691]: eth0: soliciting a DHCP lease3840worker2 # [ 10.678418] NET: Registered PF_PACKET protocol family3841worker2 # [ 10.549384] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.23842client: (finished: waiting for unit network-addresses-eth1.service, in 11.20 seconds)3843worker2 # [ 10.552363] dhcpcd[691]: eth0: probing address 10.0.2.15/243844client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3845lb # [ 10.672974] 8021q: adding VLAN 0 to HW filter on device eth03846lb # [ 10.541380] dhcpcd[770]: eth0: waiting for carrier3847lb # [ 10.542652] dhcpcd[770]: eth0: carrier acquired3848lb # [ 10.556868] dhcpcd[770]: DUID 00:01:00:01:32:42:5c:ed:52:54:00:12:34:563849lb # [ 10.558292] dhcpcd[770]: eth0: IAID 00:12:34:563850lb # [ 10.559294] dhcpcd[770]: eth0: adding address fe80::5054:ff:fe12:34563851client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3852lb: waiting for unit network-addresses-eth1.service3853lb: waiting for the VM to finish booting3854lb: Guest shell says: b'Spawning backdoor root shell...\n'3855lb: connected to guest root shell3856lb: (connecting took 0.00 seconds)3857lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3858lb # [ 10.575405] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".3859lb # [ 10.577447] postgresql-pre-start[792]: This user must also own the server process.3860worker1 # [ 10.581535] dhcpcd[695]: eth0: soliciting a DHCP lease3861lb # [ 10.587264] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".3862lb # [ 10.589682] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".3863lb # [ 10.590886] postgresql-pre-start[792]: The default text search configuration will be set to "english".3864lb # [ 10.592028] postgresql-pre-start[792]: Data page checksums are enabled.3865lb # [ 10.592875] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3866lb # [ 10.594600] postgresql-pre-start[792]: creating subdirectories ... ok3867lb # [ 10.597040] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix3868worker1 # [ 10.740013] NET: Registered PF_PACKET protocol family3869worker1 # [ 10.612894] dhcpcd[695]: eth0: offered 10.0.2.15 from 10.0.2.23870worker1 # [ 10.616496] dhcpcd[695]: eth0: probing address 10.0.2.15/243871lb # [ 10.672969] systemd-vconsole-setup[737]: Configuration of first virtual console was skipped, ignoring remaining ones.3872lb: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds)3873lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3874lb # [ 10.680154] systemd[1]: Finished Virtual Console Setup.3875lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3876worker1: waiting for unit network-addresses-eth1.service3877worker1: waiting for the VM to finish booting3878worker1: Guest shell says: b'Spawning backdoor root shell...\n'3879worker1: connected to guest root shell3880worker1: (connecting took 0.00 seconds)3881worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3882lb # [ 10.745704] postgresql-pre-start[792]: selecting default "max_connections" ... 1003883worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3884worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3885worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3886worker2: waiting for unit network-addresses-eth1.service3887worker2: waiting for the VM to finish booting3888worker2: Guest shell says: b'Spawning backdoor root shell...\n'3889worker2: connected to guest root shell3890worker2: (connecting took 0.00 seconds)3891worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3892lb # [ 10.838887] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB3893worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3894worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3895worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3896lb: waiting for unit niks3.service3897client # [ 10.991747] systemd[1]: Finished Extra networking commands..3898client # [ 10.993948] systemd[1]: Reached target Network.3899client # [ 10.997310] systemd[1]: Starting Permit User Sessions...3900client # [ 11.027669] systemd[1]: Finished Permit User Sessions.3901client # [ 11.032132] systemd[1]: Started Getty on tty1.3902client # [ 11.033439] systemd[1]: Reached target Login Prompts.3903worker1 # [ 11.350467] dhcpcd[695]: eth0: soliciting an IPv6 router3904worker1 # [ 11.351823] dhcpcd[695]: eth0: Router Advertisement from fe80::23905worker1 # [ 11.352605] dhcpcd[695]: eth0: adding address fec0::5054:ff:fe12:3456/643906worker1 # [ 11.353515] dhcpcd[695]: eth0: adding route to fec0::/643907worker1 # [ 11.354293] dhcpcd[695]: eth0: adding default route via fe80::23908worker2 # [ 11.402543] dhcpcd[691]: eth0: soliciting an IPv6 router3909worker2 # [ 11.404780] dhcpcd[691]: eth0: Router Advertisement from fe80::23910worker2 # [ 11.406783] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/643911worker2 # [ 11.408940] dhcpcd[691]: eth0: adding route to fec0::/643912worker2 # [ 11.410886] dhcpcd[691]: eth0: adding default route via fe80::23913lb # [ 11.547457] dhcpcd[770]: eth0: soliciting a DHCP lease3914lb # [ 11.695769] NET: Registered PF_PACKET protocol family3915lb # [ 11.566765] dhcpcd[770]: eth0: offered 10.0.2.15 from 10.0.2.23916lb # [ 11.568145] dhcpcd[770]: eth0: probing address 10.0.2.15/243917client # [ 11.755321] dhcpcd[568]: eth0: soliciting a DHCP lease3918client # [ 11.911019] NET: Registered PF_PACKET protocol family3919client # [ 11.784835] dhcpcd[568]: eth0: offered 10.0.2.15 from 10.0.2.23920client # [ 11.790366] dhcpcd[568]: eth0: probing address 10.0.2.15/243921client # [ 12.082077] dhcpcd[568]: eth0: soliciting an IPv6 router3922client # [ 12.084255] dhcpcd[568]: eth0: Router Advertisement from fe80::23923client # [ 12.085395] dhcpcd[568]: eth0: adding address fec0::5054:ff:fe12:3456/643924client # [ 12.086582] dhcpcd[568]: eth0: adding route to fec0::/643925client # [ 12.087631] dhcpcd[568]: eth0: adding default route via fe80::23926lb # [ 12.106836] dhcpcd[770]: eth0: soliciting an IPv6 router3927lb # [ 12.108393] dhcpcd[770]: eth0: Router Advertisement from fe80::23928lb # [ 12.109430] dhcpcd[770]: eth0: adding address fec0::5054:ff:fe12:3456/643929lb # [ 12.110852] dhcpcd[770]: eth0: adding route to fec0::/643930lb # [ 12.111818] dhcpcd[770]: eth0: adding default route via fe80::23931lb # [ 12.686812] postgresql-pre-start[792]: selecting default time zone ... UTC3932lb # [ 12.691057] postgresql-pre-start[792]: creating configuration files ... ok3933lb # [ 12.918512] postgresql-pre-start[792]: running bootstrap script ... ok3934lb # [ 13.489942] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok3935lb # [ 13.622752] postgresql-pre-start[792]: syncing data to disk ... ok3936lb # [ 13.623866] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections3937lb # [ 13.626099] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3938lb # [ 13.628057] postgresql-pre-start[792]: Success. You can now start the database server using:3939lb # [ 13.629073] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3940lb # [ 13.738162] postgres[866]: [866] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3941lb # [ 13.742976] postgres[866]: [866] LOG: listening on IPv6 address "::1", port 54323942lb # [ 13.744082] postgres[866]: [866] LOG: listening on IPv4 address "127.0.0.1", port 54323943lb # [ 13.746271] postgres[866]: [866] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3944lb # [ 13.760230] postgres[875]: [875] LOG: database system was shut down at 2026-09-20 08:59:28 GMT3945lb # [ 13.764388] postgres[866]: [866] LOG: database system is ready to accept connections3946lb # [ 13.771104] systemd[1]: Started PostgreSQL Server.3947lb # [ 13.776832] systemd[1]: Starting PostgreSQL Setup Scripts...3948lb # [ 13.967837] postgresql-setup-start[886]: CREATE DATABASE3949lb # [ 14.009718] postgresql-setup-start[891]: CREATE ROLE3950lb # [ 14.029480] postgresql-setup-start[893]: ALTER DATABASE3951lb # [ 14.034815] systemd[1]: Finished PostgreSQL Setup Scripts.3952lb # [ 14.036536] systemd[1]: Reached target PostgreSQL.3953worker1 # [ 15.584267] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds3954worker1 # [ 15.585396] dhcpcd[695]: eth0: adding route to 10.0.2.0/243955worker1 # [ 15.586384] dhcpcd[695]: eth0: adding default route via 10.0.2.23956worker2 # [ 15.652805] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds3957worker2 # [ 15.656736] dhcpcd[691]: eth0: adding route to 10.0.2.0/243958worker2 # [ 15.659269] dhcpcd[691]: eth0: adding default route via 10.0.2.23959worker1 # [ 15.663908] systemd[1]: Started DHCP Client.3960worker1 # [ 15.665830] systemd[1]: Reached target Multi-User System.3961worker1 # [ 15.666834] systemd[1]: Startup finished in 883ms (kernel) + 4.003s (initrd) + 10.778s (userspace) = 15.665s.3962worker2 # [ 15.779576] systemd[1]: Started DHCP Client.3963worker2 # [ 15.780975] systemd[1]: Reached target Multi-User System.3964worker2 # [ 15.782467] systemd[1]: Startup finished in 852ms (kernel) + 4.073s (initrd) + 10.856s (userspace) = 15.782s.3965lb # [ 15.957506] dhcpcd[770]: eth0: leased 10.0.2.15 for 86400 seconds3966lb # [ 15.961452] dhcpcd[770]: eth0: adding route to 10.0.2.0/243967lb # [ 15.963904] dhcpcd[770]: eth0: adding default route via 10.0.2.23968lb # [ 16.074410] systemd[1]: Started DHCP Client.3969lb # [ 16.076441] systemd[1]: Reached target Network is Online.3970lb # [ 16.080613] systemd[1]: Started Envoy reverse proxy.3971lb # [ 16.083902] systemd[1]: Started mock-oidc.service.3972lb # [ 16.181366] mock-oidc-server[970]: Mock OIDC Server running3973lb # [ 16.182930] mock-oidc-server[970]: OIDC Address: 192.168.1.2:80803974lb # [ 16.183897] mock-oidc-server[970]: Issue Address: 0.0.0.0:80813975lb # [ 16.184742] mock-oidc-server[970]: Issuer: http://192.168.1.2:8080/oidc3976lb # [ 16.185776] mock-oidc-server[970]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3977lb # [ 16.186955] mock-oidc-server[970]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3978lb # [ 16.188444] mock-oidc-server[970]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3979lb # [ 16.631696] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3980lb # [ 16.633485] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:469] statically linked extensions:3981lb # [ 16.635188] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3982lb # [ 16.637050] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3983lb # [ 16.639756] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3984lb # [ 16.654307] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3985lb # [ 16.660932] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3986lb # [ 16.663072] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3987lb # [ 16.665143] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3988lb # [ 16.667124] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3989lb # [ 16.668852] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3990lb # [ 16.671603] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3991lb # [ 16.678137] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83992lb # [ 16.679788] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3993lb # [ 16.682416] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3994lb # [ 16.683962] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3995lb # [ 16.686589] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3996lb # [ 16.688897] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3997lb # [ 16.691256] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3998lb # [ 16.693542] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3999lb # [ 16.695161] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4000lb # [ 16.702410] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4001lb # [ 16.704196] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4002lb # [ 16.707993] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4003lb # [ 16.709870] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4004lb # [ 16.712910] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4005lb # [ 16.715131] envoy[969]: [2026-09-20 08:59:31.304][969][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4006lb # [ 16.716766] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4007lb # [ 16.719709] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14008lb # [ 16.721888] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4009lb # [ 16.724406] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4010lb # [ 16.727131] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4011lb # [ 16.728600] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4012lb # [ 16.730777] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4013lb # [ 16.733076] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4014lb # [ 16.734591] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4015lb # [ 16.738896] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4016lb # [ 16.740701] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4017lb # [ 16.742400] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4018lb # [ 16.744072] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4019lb # [ 16.746126] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4020lb # [ 16.748530] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4021lb # [ 16.750805] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4022lb # [ 16.753384] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4023lb # [ 16.755122] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4024lb # [ 16.756709] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4025lb # [ 16.758437] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4026lb # [ 16.761405] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4027lb # [ 16.763215] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4028lb # [ 16.765091] envoy[969]: [2026-09-20 08:59:31.308][969][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4029lb # [ 16.769221] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4030lb # [ 16.772342] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4031lb # [ 16.774347] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4032lb # [ 16.778268] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4033lb # [ 16.780181] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4034lb # [ 16.782384] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4035lb # [ 16.784814] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4036lb # [ 16.786986] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4037lb # [ 16.789430] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4038lb # [ 16.791200] envoy[969]: [2026-09-20 08:59:31.310][969][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24039lb # [ 16.792794] envoy[969]: [2026-09-20 08:59:31.313][969][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4040lb # [ 16.794407] envoy[969]: [2026-09-20 08:59:31.313][969][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4041lb # [ 16.799258] envoy[969]: [2026-09-20 08:59:31.313][969][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24042lb # [ 16.800965] envoy[969]: [2026-09-20 08:59:31.313][969][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4043lb # [ 16.810765] envoy[969]: [2026-09-20 08:59:31.313][969][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4044lb # [ 16.817118] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4045lb # [ 16.819750] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4046lb # [ 16.821439] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4047lb # [ 16.825044] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4048lb # [ 16.827376] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4049lb # [ 16.829273] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4050client # [ 16.849817] dhcpcd[568]: eth0: leased 10.0.2.15 for 86400 seconds4051lb # [ 16.831031] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4052client # [ 16.852720] dhcpcd[568]: eth0: adding route to 10.0.2.0/244053lb # [ 16.833728] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4054client # [ 16.854988] dhcpcd[568]: eth0: adding default route via 10.0.2.24055lb # [ 16.836375] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4056lb # [ 16.839355] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4057lb # [ 16.843673] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4058lb # [ 16.846231] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4059lb # [ 16.848170] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4060lb # [ 16.850150] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4061lb # [ 16.851827] envoy[969]: [2026-09-20 08:59:31.319][969][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4062lb # [ 16.854767] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4063lb # [ 16.856842] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4064lb # [ 16.859539] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4065lb # [ 16.861279] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4066lb # [ 16.863115] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4067lb # [ 16.864910] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4068lb # [ 16.867175] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4069lb # [ 16.869839] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4070lb # [ 16.872068] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4071lb # [ 16.874923] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4072lb # [ 16.876699] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4073lb # [ 16.881465] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4074lb # [ 16.893218] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4075lb # [ 16.894887] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4076lb # [ 16.896685] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4077lb # [ 16.898915] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4078lb # [ 16.901086] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4079lb # [ 16.902631] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4080lb # [ 16.904904] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4081lb # [ 16.910072] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24082lb # [ 16.912847] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4083lb # [ 16.915612] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4084lb # [ 16.917763] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4085lb # [ 16.921906] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4086lb # [ 16.927795] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4087client # [ 16.970778] systemd[1]: Started DHCP Client.4088client # [ 16.972888] systemd[1]: Reached target Multi-User System.4089client # [ 16.973844] systemd[1]: Startup finished in 870ms (kernel) + 3.963s (initrd) + 12.138s (userspace) = 16.973s.4090lb # [ 16.930069] envoy[969]: [2026-09-20 08:59:31.320][969][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4091lb # [ 16.955401] envoy[969]: [2026-09-20 08:59:31.431][969][info][main] [source/server/server.cc:531] HTTP header map info:4092lb # [ 16.956909] envoy[969]: [2026-09-20 08:59:31.489][969][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4093lb # [ 16.969838] envoy[969]: [2026-09-20 08:59:31.489][969][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4094lb # [ 16.972084] envoy[969]: [2026-09-20 08:59:31.489][969][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4095lb # [ 16.979424] envoy[969]: [2026-09-20 08:59:31.489][969][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4096lb # [ 17.021795] envoy[969]: [2026-09-20 08:59:31.695][969][info][main] [source/server/server.cc:968] runtime: {}4097lb # [ 17.028064] envoy[969]: [2026-09-20 08:59:31.701][969][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4098lb # [ 17.029958] envoy[969]: [2026-09-20 08:59:31.703][969][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014099lb # [ 17.032852] envoy[969]: [2026-09-20 08:59:31.706][969][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014100lb # [ 17.035573] envoy[969]: [2026-09-20 08:59:31.709][969][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4101lb # [ 17.037429] envoy[969]: [2026-09-20 08:59:31.710][969][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4102lb # [ 17.038853] envoy[969]: [2026-09-20 08:59:31.710][969][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4103worker1 # [ 17.080348] systemd[1]: Starting Nix worker-protocol over gRPC...4104lb # [ 17.081443] envoy[969]: [2026-09-20 08:59:31.754][969][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4105worker2 # [ 17.110683] systemd[1]: Starting Nix worker-protocol over gRPC...4106lb # [ 17.100977] envoy[969]: [2026-09-20 08:59:31.774][969][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4107lb # [ 17.103629] envoy[969]: [2026-09-20 08:59:31.777][969][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4108lb # [ 17.106627] envoy[969]: [2026-09-20 08:59:31.780][969][info][main] [source/server/server.cc:1077] starting main dispatch loop4109worker1 # [ 17.254396] nix-grpc-daemon[786]: ts=2026-09-20T08:59:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4110worker1 # [ 17.264925] nix-grpc-daemon[786]: ts=2026-09-20T08:59:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14111worker2 # [ 17.325200] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4112worker1 # [ 17.301831] nix-grpc-daemon[786]: ts=2026-09-20T08:59:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4113worker1 # [ 17.305797] systemd[1]: Started Nix worker-protocol over gRPC.4114worker2 # [ 17.335850] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14115worker2 # [ 17.366714] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4116worker2 # [ 17.369437] systemd[1]: Started Nix worker-protocol over gRPC.4117lb # [ 17.355610] envoy[969]: [2026-09-20 08:59:32.028][969][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4118lb # [ 17.359813] envoy[969]: [2026-09-20 08:59:32.028][969][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4119lb # [ 17.365087] envoy[969]: [2026-09-20 08:59:32.029][969][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4120worker1 # [ 17.366449] nix-grpc-daemon[786]: ts=2026-09-20T08:59:32Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4121lb # [ 17.369406] envoy[969]: [2026-09-20 08:59:32.037][969][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4122worker2 # [ 17.434581] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=scheduler_connected addr=lb:500514123worker2 # [ 17.459686] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4124worker1 # [ 17.567538] nix-grpc-daemon[786]: ts=2026-09-20T08:59:32Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4125worker2 # [ 17.660823] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=scheduler_connected addr=lb:500514126worker2 # [ 17.672717] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4127worker2 # [ 17.873276] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=scheduler_connected addr=lb:500514128worker2 # [ 17.876312] nix-grpc-daemon[783]: ts=2026-09-20T08:59:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4129worker1 # [ 17.968342] nix-grpc-daemon[786]: ts=2026-09-20T08:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4130worker2 # [ 18.077470] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_connected addr=lb:500514131worker2 # [ 18.081578] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4132worker2 # [ 18.282384] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_connected addr=lb:500514133worker2 # [ 18.287669] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4134worker2 # [ 18.489356] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_connected addr=lb:500514135worker2 # [ 18.493321] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker2 # [ 18.693510] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 18.696362] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4138worker1 # [ 18.770850] nix-grpc-daemon[786]: ts=2026-09-20T08:59:33Z level=info event=scheduler_connected addr=lb:500514139worker1 # [ 18.773962] nix-grpc-daemon[786]: ts=2026-09-20T08:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker2 # [ 18.897335] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 18.902338] nix-grpc-daemon[783]: ts=2026-09-20T08:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4142worker1 # [ 18.975135] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514143worker1 # [ 18.980158] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker2 # [ 19.103199] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514145worker2 # [ 19.109165] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker1 # [ 19.181243] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514147worker1 # [ 19.186168] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker2 # [ 19.314917] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514149worker2 # [ 19.317557] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker1 # [ 19.386507] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514151worker1 # [ 19.389051] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker2 # [ 19.520779] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514153worker2 # [ 19.523867] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker1 # [ 19.589574] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514155worker1 # [ 19.592135] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker2 # [ 19.721324] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514157worker2 # [ 19.723940] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker1 # [ 19.794512] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514159worker1 # [ 19.799593] nix-grpc-daemon[786]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker2 # [ 19.924544] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_connected addr=lb:500514161worker2 # [ 19.927064] nix-grpc-daemon[783]: ts=2026-09-20T08:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker1 # [ 20.000386] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514163worker1 # [ 20.005271] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker2 # [ 20.127823] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514165worker2 # [ 20.132942] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker1 # [ 20.206152] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514167worker1 # [ 20.210454] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker2 # [ 20.333534] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514169worker2 # [ 20.336143] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker1 # [ 20.411592] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514171worker1 # [ 20.416457] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker2 # [ 20.537235] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514173worker2 # [ 20.539732] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker1 # [ 20.617551] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514175worker1 # [ 20.622810] nix-grpc-daemon[786]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker2 # [ 20.740746] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 20.745825] nix-grpc-daemon[783]: ts=2026-09-20T08:59:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker1 # [ 20.826779] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514179worker1 # [ 20.829955] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker2 # [ 20.946493] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 20.949363] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker1 # [ 21.027610] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514183worker1 # [ 21.032777] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker2 # [ 21.149998] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514185worker2 # [ 21.152526] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4186worker1 # [ 21.233472] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514187worker1 # [ 21.236983] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker2 # [ 21.353518] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514189worker2 # [ 21.358529] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4190worker1 # [ 21.437890] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514191worker1 # [ 21.442588] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker2 # [ 21.559249] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514193worker2 # [ 21.561638] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4194worker1 # [ 21.643376] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514195worker1 # [ 21.645551] nix-grpc-daemon[786]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker2 # [ 21.762670] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_connected addr=lb:500514197worker2 # [ 21.767832] nix-grpc-daemon[783]: ts=2026-09-20T08:59:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker1 # [ 21.848924] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514199worker1 # [ 21.852265] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker2 # [ 21.968699] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 21.973888] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4202worker1 # [ 22.049428] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514203worker1 # [ 22.052169] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker2 # [ 22.174920] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514205worker2 # [ 22.179957] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4206worker1 # [ 22.253559] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514207worker1 # [ 22.259844] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker2 # [ 22.380810] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514209worker2 # [ 22.386185] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4210worker1 # [ 22.460969] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 22.466285] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker2 # [ 22.588923] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514213worker2 # [ 22.594689] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4214worker1 # [ 22.667063] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514215worker1 # [ 22.671478] nix-grpc-daemon[786]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker2 # [ 22.794844] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_connected addr=lb:500514217worker2 # [ 22.797229] nix-grpc-daemon[783]: ts=2026-09-20T08:59:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218worker1 # [ 22.872543] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514219worker1 # [ 22.875583] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker2 # [ 22.998198] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514221worker2 # [ 23.002680] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4222worker1 # [ 23.076672] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514223worker1 # [ 23.081710] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker2 # [ 23.203287] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 23.206120] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4226worker1 # [ 23.282698] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514227worker1 # [ 23.287443] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker2 # [ 23.406697] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514229worker2 # [ 23.409299] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4230worker1 # [ 23.488670] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514231worker1 # [ 23.493846] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker2 # [ 23.611213] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514233worker2 # [ 23.615835] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4234worker1 # [ 23.694532] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514235worker1 # [ 23.697144] nix-grpc-daemon[786]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker2 # [ 23.817068] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 23.821961] nix-grpc-daemon[783]: ts=2026-09-20T08:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4238worker1 # [ 23.898236] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514239worker1 # [ 23.900945] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker2 # [ 24.022988] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 24.027868] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4242worker1 # [ 24.101972] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514243worker1 # [ 24.106921] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker2 # [ 24.228832] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514245worker2 # [ 24.233763] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4246worker1 # [ 24.308127] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514247worker1 # [ 24.314703] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker2 # [ 24.434784] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 24.441545] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4250worker1 # [ 24.515421] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514251worker1 # [ 24.518289] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker2 # [ 24.643147] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514253worker2 # [ 24.647860] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4254worker1 # [ 24.719508] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514255worker1 # [ 24.724668] nix-grpc-daemon[786]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker2 # [ 24.848911] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_connected addr=lb:500514257worker2 # [ 24.853669] nix-grpc-daemon[783]: ts=2026-09-20T08:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4258worker1 # [ 24.927597] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514259worker1 # [ 24.931426] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker2 # [ 25.054772] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 25.059835] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262worker1 # [ 25.131967] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514263worker1 # [ 25.136774] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker2 # [ 25.260831] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514265worker2 # [ 25.265835] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4266worker1 # [ 25.338136] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514267worker1 # [ 25.343666] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker2 # [ 25.466724] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 25.471652] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4270worker1 # [ 25.544629] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514271worker1 # [ 25.549845] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker2 # [ 25.673445] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514273worker2 # [ 25.678230] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4274worker1 # [ 25.751256] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514275worker1 # [ 25.756821] nix-grpc-daemon[786]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker2 # [ 25.879126] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_connected addr=lb:500514277worker2 # [ 25.883889] nix-grpc-daemon[783]: ts=2026-09-20T08:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4278lb # [ 25.915431] rustfs-bucket-start[1069]: mb s3://farm4279lb # [ 25.921381] systemd[1]: Finished rustfs-bucket.service.4280lb # [ 25.928504] systemd[1]: Starting niks3 server...4281worker1 # [ 25.959831] nix-grpc-daemon[786]: ts=2026-09-20T08:59:41Z level=info event=scheduler_connected addr=lb:500514282worker1 # [ 25.963337] nix-grpc-daemon[786]: ts=2026-09-20T08:59:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4283worker2 # [ 26.084742] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=scheduler_connected addr=lb:500514284worker2 # [ 26.088593] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4285worker1 # [ 26.163661] nix-grpc-daemon[786]: ts=2026-09-20T08:59:41Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 26.166931] nix-grpc-daemon[786]: ts=2026-09-20T08:59:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287lb # [ 26.175862] postgres[1089]: [1089] ERROR: relation "goose_db_version" does not exist at character 364288lb # [ 26.177098] postgres[1089]: [1089] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4289lb # [ 26.220947] niks3-server[1078]: 2026/09/20 08:59:40 OK 20241026095416_initial_model.sql (19.45ms)4290lb # [ 26.224483] niks3-server[1078]: 2026/09/20 08:59:40 OK 20251210153512_drop_unused_gin_index.sql (3.63ms)4291lb # [ 26.229496] niks3-server[1078]: 2026/09/20 08:59:40 OK 20251218171726_add_pins.sql (4.78ms)4292lb # [ 26.234525] niks3-server[1078]: 2026/09/20 08:59:40 OK 20260628120000_add_object_size_and_stats.sql (5.15ms)4293lb # [ 26.239112] niks3-server[1078]: 2026/09/20 08:59:40 OK 20260905000000_add_claims.sql (4.56ms)4294lb # [ 26.243248] niks3-server[1078]: 2026/09/20 08:59:40 OK 20260920000000_drop_claims.sql (4.21ms)4295lb # [ 26.244670] niks3-server[1078]: 2026/09/20 08:59:40 goose: successfully migrated database to version: 202609200000004296lb # [ 26.250353] niks3-server[1078]: 2026/09/20 08:59:40 OK 1_commit_pending_closure.sql (5.75ms)4297lb # [ 26.253026] niks3-server[1078]: 2026/09/20 08:59:40 OK 2_object_stats_trigger.sql (1.52ms)4298lb # [ 26.254281] niks3-server[1078]: 2026/09/20 08:59:40 goose: up to current file version: 24299lb # [ 26.260762] niks3-server[1078]: 2026/09/20 08:59:40 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4300worker2 # [ 26.289730] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=scheduler_connected addr=lb:500514301worker2 # [ 26.294892] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4302lb # [ 26.344159] niks3-server[1078]: 2026/09/20 08:59:41 INFO Read proxy enabled — serving cache objects from S34303lb # [ 26.346161] niks3-server[1078]: 2026/09/20 08:59:41 INFO Using socket-activated listener address=0.0.0.0:57514304lb # [ 26.352228] niks3-server[1078]: 2026/09/20 08:59:41 INFO systemd watchdog enabled interval=15s4305lb # [ 26.353456] systemd[1]: Started niks3 server.4306lb # [ 26.354132] systemd[1]: Reached target Multi-User System.4307lb # [ 26.356236] niks3-server[1078]: 2026/09/20 08:59:41 INFO Starting HTTP server address=0.0.0.0:57514308lb # [ 26.358389] systemd[1]: Startup finished in 888ms (kernel) + 4.161s (initrd) + 21.307s (userspace) = 26.358s.4309lb # [ 26.364672] niks3-server[1078]: 2026/09/20 08:59:41 INFO lead: acquired remote=192.168.1.4:599884310worker1 # [ 26.367908] nix-grpc-daemon[786]: ts=2026-09-20T08:59:41Z level=info event=scheduler_connected addr=lb:500514311worker2 # [ 26.396178] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=scheduler_take_over4312worker1 # [ 26.374539] nix-grpc-daemon[786]: ts=2026-09-20T08:59:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4313worker2 # [ 26.495751] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=scheduler_connected addr=lb:500514314worker2 # [ 26.502149] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04315worker1 # [ 26.575136] nix-grpc-daemon[786]: ts=2026-09-20T08:59:41Z level=info event=scheduler_connected addr=lb:500514316worker2 # [ 26.602853] nix-grpc-daemon[783]: ts=2026-09-20T08:59:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04317lb: (finished: waiting for unit niks3.service, in 16.35 seconds)4318lb: waiting for TCP port 5751 on localhost4319lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4320lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4321lb: waiting for unit envoy.service4322lb: (finished: waiting for unit envoy.service, in 0.06 seconds)4323lb: waiting for TCP port 50051 on localhost4324lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4325lb # [ 27.455684] envoy[969]: conn peer=[::1]:55882 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24326lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4327lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4328??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4329 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284330lb: must succeed: curl -sf localhost:9901/clusters4331lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4332lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4333subtest: one node schedules and both builders hold a WorkerSession on it4334lb: must succeed: curl -sf localhost:9901/clusters4335lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4336worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4337worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4338(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.13 seconds)4339subtest: balancer auth: client cert, bearer token, nothing, unknown CN4340worker2 # [ 28.130896] nix-grpc-daemon[783]: ts=2026-09-20T08:59:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540064341worker2 # [ 28.141956] systemd[1]: Started Nix Daemon.4342worker2 # [ 28.381554] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4343worker2 # [ 28.432047] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5)4344worker2 # [ 28.523508] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 2/5)4345worker2 # [ 28.590418] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 329 ms (attempt 3/5)4346worker2 # [ 28.925355] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 4/5)4347worker2 # [ 28.942978] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4348worker1 # [ 28.953552] nix-grpc-daemon[786]: ts=2026-09-20T08:59:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:567844349worker1 # [ 28.965780] systemd[1]: Started Nix Daemon.4350worker1 # [ 29.192258] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4351worker1 # [ 29.225561] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5)4352worker1 # [ 29.290216] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 2/5)4353worker1 # [ 29.339547] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 3/5)4354worker1 # [ 29.505680] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 533 ms (attempt 4/5)4355worker1 # [ 30.050904] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4356worker1 # [ 30.069905] nix-grpc-daemon[786]: ts=2026-09-20T08:59:45Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4357worker2 # [ 30.103820] nix-grpc-daemon[783]: ts=2026-09-20T08:59:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:540064358worker2 # [ 30.115800] nix-grpc-daemon[783]: ts=2026-09-20T08:59:45Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4359client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4360client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)4361client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4362client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4363worker2 # [ 30.562491] nix-grpc-daemon[783]: ts=2026-09-20T08:59:45Z level=info event=oidc_jwks provider=mock keys=14364worker2 # [ 30.567330] nix-grpc-daemon[783]: ts=2026-09-20T08:59:45Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:540064365worker1 # [ 30.566502] nix-grpc-daemon[786]: ts=2026-09-20T08:59:45Z level=info event=oidc_jwks provider=mock keys=14366worker1 # [ 30.571200] nix-grpc-daemon[786]: ts=2026-09-20T08:59:45Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:567844367worker1 # [ 30.580682] nix-grpc-daemon[786]: ts=2026-09-20T08:59:45Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4368worker1 # [ 30.590427] nix-grpc-daemon[786]: ts=2026-09-20T08:59:45Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:567844369worker1 # [ 30.599246] nix-grpc-daemon[786]: ts=2026-09-20T08:59:45Z level=debug event=path_info_miss path=4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test error="error: path '/nix/store/4fcdv3jgvwyl2lbx84x5n85zs10yr52a-nixos-system-client-test' is required, but there is no substituter that can build it"4370client: must succeed: rm -r /var/lib/nix-grpc-store4371client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4372worker2 # [ 31.908834] nix-grpc-daemon[783]: ts=2026-09-20T08:59:46Z level=info event=denied method=QueryMissing cn=- role=none4373worker2 # [ 32.153347] nix-grpc-daemon[783]: ts=2026-09-20T08:59:47Z level=info event=denied method=QueryMissing cn=stranger role=none4374(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.34 seconds)4375subtest: DAG build is scheduled across workers and lands in the cache4376client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24377worker1 # [ 32.395416] nix-grpc-daemon[786]: ts=2026-09-20T08:59:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:567844378client # don't know how to build these paths:4379client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4380worker1 # [ 32.409220] nix-grpc-daemon[786]: ts=2026-09-20T08:59:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:567844381worker2 # [ 32.468688] nix-grpc-daemon[783]: ts=2026-09-20T08:59:47Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04382worker2 # [ 32.474696] nix-grpc-daemon[783]: ts=2026-09-20T08:59:47Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14383worker2 # [ 32.521428] nix-grpc-daemon[783]: ts=2026-09-20T08:59:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064384worker2 # [ 32.540073] nix-grpc-daemon[783]: ts=2026-09-20T08:59:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064385client # copying 1 paths to 'lb:50051'...4386worker2 # [ 32.549851] nix-grpc-daemon[783]: ts=2026-09-20T08:59:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064387client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4388worker2 # [ 32.572728] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4389worker2 # [ 32.585493] nix-grpc-daemon[783]: ts=2026-09-20T08:59:47Z level=info event=niks3_push_started pid=8584390worker2 # [ 33.016368] nix-daemon[845]: accepted connection from pid 869, user nix-grpc-daemon (trusted)4391worker2 # [ 33.032286] nix-daemon[845]: reaped child process 873, status = succeeded4392worker2 # [ 33.202934] nix-daemon[845]: accepted connection from pid 876, user nix-grpc-daemon (trusted)4393worker2 # [ 33.213651] nix-daemon[845]: reaped child process 879, status = succeeded4394lb # [ 33.206548] niks3-server[1078]: 2026/09/20 08:59:47 INFO Received uploads request method=POST path=/api/pending_closures4395worker2 # [ 33.273897] nix-grpc-daemon[858]: time=2026-09-20T08:59:48.342Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4396worker2 # [ 33.277530] nix-grpc-daemon[858]: time=2026-09-20T08:59:48.346Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4397lb # [ 33.277407] niks3-server[1078]: 2026/09/20 08:59:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4398lb # [ 33.298080] niks3-server[1078]: 2026/09/20 08:59:47 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4399lb # [ 33.304186] niks3-server[1078]: 2026/09/20 08:59:47 INFO Signed narinfos id=1 count=14400worker2 # [ 33.330683] nix-grpc-daemon[858]: time=2026-09-20T08:59:48.400Z level=INFO msg="Uploading 1 narinfos"4401lb # [ 33.315204] niks3-server[1078]: 2026/09/20 08:59:47 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4402lb # [ 33.323662] niks3-server[1078]: 2026/09/20 08:59:47 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4403lb # [ 33.330083] niks3-server[1078]: 2026/09/20 08:59:48 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4404lb # [ 33.346373] niks3-server[1078]: 2026/09/20 08:59:48 INFO Completed upload id=14405worker2 # [ 33.371908] nix-grpc-daemon[858]: time=2026-09-20T08:59:48.442Z level=INFO msg="Upload complete. (530ms)"4406worker2 # [ 33.377439] nix-grpc-daemon[783]: ts=2026-09-20T08:59:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=5044407worker2 # [ 33.384749] nix-grpc-daemon[783]: ts=2026-09-20T08:59:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064408worker2 # [ 33.396127] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4409worker2 # [ 33.404317] nix-daemon[845]: reaped child process 856, status = succeeded4410client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4411client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4412worker2 # [ 33.413765] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4413worker2 # [ 34.029230] nix-daemon[845]: reaped child process 883, status = succeeded4414client # farm-a> LOG-farm-a-t14415worker2 # [ 34.152304] nix-daemon[845]: accepted connection from pid 898, user nix-grpc-daemon (trusted)4416worker2 # [ 34.164299] nix-daemon[845]: reaped child process 901, status = succeeded4417lb # [ 34.149069] niks3-server[1078]: 2026/09/20 08:59:48 INFO Received uploads request method=POST path=/api/pending_closures4418worker2 # [ 34.184641] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.255Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4419worker2 # [ 34.186150] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.256Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4420lb # [ 34.197629] niks3-server[1078]: 2026/09/20 08:59:48 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4421lb # [ 34.211353] niks3-server[1078]: 2026/09/20 08:59:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4422lb # [ 34.217279] niks3-server[1078]: 2026/09/20 08:59:48 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4423lb # [ 34.220586] niks3-server[1078]: 2026/09/20 08:59:48 INFO Signed narinfos id=2 count=14424worker2 # [ 34.247691] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.318Z level=INFO msg="Uploading 1 narinfos"4425lb # [ 34.223559] niks3-server[1078]: 2026/09/20 08:59:48 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4426lb # [ 34.233572] niks3-server[1078]: 2026/09/20 08:59:48 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4427lb # [ 34.239337] niks3-server[1078]: 2026/09/20 08:59:48 INFO Completed upload id=24428worker2 # [ 34.264374] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.334Z level=INFO msg="Upload complete. (239ms)"4429lb # [ 34.240922] niks3-server[1078]: 2026/09/20 08:59:48 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4430worker2 # [ 34.270236] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14431worker2 # [ 34.287252] nix-daemon[845]: reaped child process 881, status = succeeded4432worker2 # [ 34.289415] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04433worker2 # [ 34.291108] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14434worker2 # [ 34.338162] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064435worker2 # [ 34.350988] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064436client # copying 1 paths to 'lb:50051'...4437worker2 # [ 34.366762] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.435Z level=INFO msg="All 1 paths already cached"4438client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4439worker2 # [ 34.370886] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064440worker2 # [ 34.384305] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4441worker2 # [ 34.557114] nix-daemon[845]: accepted connection from pid 907, user nix-grpc-daemon (trusted)4442worker2 # [ 34.569773] nix-daemon[845]: reaped child process 910, status = succeeded4443worker2 # [ 34.720037] nix-daemon[845]: accepted connection from pid 912, user nix-grpc-daemon (trusted)4444worker2 # [ 34.731859] nix-daemon[845]: reaped child process 915, status = succeeded4445lb # [ 34.723603] niks3-server[1078]: 2026/09/20 08:59:49 INFO Received uploads request method=POST path=/api/pending_closures4446worker2 # [ 34.762529] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.832Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4447worker2 # [ 34.764113] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.834Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4448lb # [ 34.759522] niks3-server[1078]: 2026/09/20 08:59:49 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4449lb # [ 34.770057] niks3-server[1078]: 2026/09/20 08:59:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4450worker2 # [ 34.802337] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.872Z level=INFO msg="Uploading 1 narinfos"4451lb # [ 34.777507] niks3-server[1078]: 2026/09/20 08:59:49 INFO Signed narinfos id=3 count=14452lb # [ 34.781834] niks3-server[1078]: 2026/09/20 08:59:49 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4453lb # [ 34.792093] niks3-server[1078]: 2026/09/20 08:59:49 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4454lb # [ 34.801707] niks3-server[1078]: 2026/09/20 08:59:49 INFO Completed upload id=34455worker2 # [ 34.826745] nix-grpc-daemon[858]: time=2026-09-20T08:59:49.897Z level=INFO msg="Upload complete. (427ms)"4456lb # [ 34.804396] niks3-server[1078]: 2026/09/20 08:59:49 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4457worker2 # [ 34.829484] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=6244458worker2 # [ 34.831884] nix-grpc-daemon[783]: ts=2026-09-20T08:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064459worker2 # [ 34.838056] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4460worker2 # [ 34.841380] nix-daemon[845]: reaped child process 905, status = succeeded4461worker2 # [ 34.846522] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4462client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4463client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4464client # farm-b> LOG-farm-b-t14465worker2 # [ 35.684198] nix-daemon[845]: reaped child process 919, status = succeeded4466worker2 # [ 35.816059] nix-daemon[845]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4467worker2 # [ 35.827034] nix-daemon[845]: reaped child process 938, status = succeeded4468lb # [ 35.817620] niks3-server[1078]: 2026/09/20 08:59:50 INFO Received uploads request method=POST path=/api/pending_closures4469worker2 # [ 35.851278] nix-grpc-daemon[858]: time=2026-09-20T08:59:50.921Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4470worker2 # [ 35.853373] nix-grpc-daemon[858]: time=2026-09-20T08:59:50.923Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4471lb # [ 35.852567] niks3-server[1078]: 2026/09/20 08:59:50 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4472lb # [ 35.862637] niks3-server[1078]: 2026/09/20 08:59:50 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4473lb # [ 35.872132] niks3-server[1078]: 2026/09/20 08:59:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4474worker2 # [ 35.902162] nix-grpc-daemon[858]: time=2026-09-20T08:59:50.972Z level=INFO msg="Uploading 1 narinfos"4475lb # [ 35.878123] niks3-server[1078]: 2026/09/20 08:59:50 INFO Signed narinfos id=4 count=14476lb # [ 35.888352] niks3-server[1078]: 2026/09/20 08:59:50 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4477lb # [ 35.991327] niks3-server[1078]: 2026/09/20 08:59:50 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4478lb # [ 36.000592] niks3-server[1078]: 2026/09/20 08:59:50 INFO Completed upload id=44479worker2 # [ 36.025842] nix-grpc-daemon[858]: time=2026-09-20T08:59:51.096Z level=INFO msg="Upload complete. (372ms)"4480lb # [ 36.008901] niks3-server[1078]: 2026/09/20 08:59:50 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4481worker2 # [ 36.031751] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14482worker2 # [ 36.045918] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04483worker2 # [ 36.050591] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14484worker2 # [ 36.059525] nix-daemon[845]: reaped child process 917, status = succeeded4485worker2 # [ 36.091146] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064486worker2 # [ 36.103136] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064487worker2 # [ 36.114494] nix-grpc-daemon[858]: time=2026-09-20T08:59:51.184Z level=INFO msg="All 2 paths already cached"4488client # copying 1 paths to 'lb:50051'...4489worker2 # [ 36.121984] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064490client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4491worker2 # [ 36.139531] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4492worker2 # [ 36.312757] nix-daemon[845]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4493worker2 # [ 36.325066] nix-daemon[845]: reaped child process 947, status = succeeded4494worker2 # [ 36.478370] nix-daemon[845]: accepted connection from pid 949, user nix-grpc-daemon (trusted)4495worker2 # [ 36.489881] nix-daemon[845]: reaped child process 952, status = succeeded4496lb # [ 36.477759] niks3-server[1078]: 2026/09/20 08:59:51 INFO Received uploads request method=POST path=/api/pending_closures4497worker2 # [ 36.511408] nix-grpc-daemon[858]: time=2026-09-20T08:59:51.581Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4498worker2 # [ 36.512834] nix-grpc-daemon[858]: time=2026-09-20T08:59:51.583Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4499lb # [ 36.507475] niks3-server[1078]: 2026/09/20 08:59:51 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4500lb # [ 36.518702] niks3-server[1078]: 2026/09/20 08:59:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4501worker2 # [ 36.549700] nix-grpc-daemon[858]: time=2026-09-20T08:59:51.620Z level=INFO msg="Uploading 1 narinfos"4502lb # [ 36.524692] niks3-server[1078]: 2026/09/20 08:59:51 INFO Signed narinfos id=5 count=14503lb # [ 36.528602] niks3-server[1078]: 2026/09/20 08:59:51 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4504lb # [ 36.539771] niks3-server[1078]: 2026/09/20 08:59:51 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4505lb # [ 36.546513] niks3-server[1078]: 2026/09/20 08:59:51 INFO Completed upload id=54506worker2 # [ 36.571469] nix-grpc-daemon[858]: time=2026-09-20T08:59:51.641Z level=INFO msg="Upload complete. (417ms)"4507worker2 # [ 36.574644] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=7524508lb # [ 36.551355] niks3-server[1078]: 2026/09/20 08:59:51 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4509worker2 # [ 36.580502] nix-grpc-daemon[783]: ts=2026-09-20T08:59:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064510worker2 # [ 36.588607] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4511worker2 # [ 36.593509] nix-daemon[845]: reaped child process 942, status = succeeded4512client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4513worker2 # [ 36.599314] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4514client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4515lb # [ 37.088557] envoy[969]: conn peer=[2001:db8:1::1]:44170 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=20404516lb # [ 37.092354] envoy[969]: conn peer=[2001:db8:1::1]:44174 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=954517lb # [ 37.095664] envoy[969]: conn peer=[2001:db8:1::1]:44188 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94518lb # [ 37.098894] envoy[969]: conn peer=[2001:db8:1::1]:44202 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=104519client # farm-top> LOG-farm-top-t14520worker2 # [ 37.824179] nix-daemon[845]: reaped child process 956, status = succeeded4521worker2 # [ 37.980185] nix-daemon[845]: accepted connection from pid 971, user nix-grpc-daemon (trusted)4522worker2 # [ 37.992701] nix-daemon[845]: reaped child process 974, status = succeeded4523lb # [ 37.983033] niks3-server[1078]: 2026/09/20 08:59:52 INFO Received uploads request method=POST path=/api/pending_closures4524worker2 # [ 38.012391] nix-grpc-daemon[858]: time=2026-09-20T08:59:53.082Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4525worker2 # [ 38.013876] nix-grpc-daemon[858]: time=2026-09-20T08:59:53.084Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4526lb # [ 38.004161] niks3-server[1078]: 2026/09/20 08:59:52 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4527lb # [ 38.006511] niks3-server[1078]: 2026/09/20 08:59:52 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4528lb # [ 38.011166] niks3-server[1078]: 2026/09/20 08:59:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4529lb # [ 38.012828] niks3-server[1078]: 2026/09/20 08:59:52 INFO Signed narinfos id=6 count=14530worker2 # [ 38.039073] nix-grpc-daemon[858]: time=2026-09-20T08:59:53.109Z level=INFO msg="Uploading 1 narinfos"4531lb # [ 38.017763] niks3-server[1078]: 2026/09/20 08:59:52 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4532lb # [ 38.022375] niks3-server[1078]: 2026/09/20 08:59:52 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4533lb # [ 38.027462] niks3-server[1078]: 2026/09/20 08:59:52 INFO Completed upload id=64534worker2 # [ 38.052159] nix-grpc-daemon[858]: time=2026-09-20T08:59:53.122Z level=INFO msg="Upload complete. (246ms)"4535lb # [ 38.029077] niks3-server[1078]: 2026/09/20 08:59:52 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4536worker2 # [ 38.054656] nix-grpc-daemon[783]: ts=2026-09-20T08:59:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14537worker2 # [ 38.061435] nix-daemon[845]: reaped child process 954, status = succeeded4538client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 5.90 seconds)4539client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4540client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4541client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4542client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4543client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4544client # copying 3 paths...4545client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4546client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4547client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4548client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.32 seconds)4549(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.53 seconds)4550subtest: repeat is answered Cached by the scheduler without building4551worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4552worker1 # finding garbage collector roots...4553worker1 # deleting specified paths...4554worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4555worker1 # deleting unused links...4556worker1 # note: hard linking is currently saving 0.0 KiB4557worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.32 seconds)4558worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4559worker2 # finding garbage collector roots...4560worker2 # deleting specified paths...4561worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4562worker2 # deleting unused links...4563worker2 # note: hard linking is currently saving 0.0 KiB4564worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4565client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24566client # don't know how to build these paths:4567client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4568worker1 # [ 39.472801] nix-grpc-daemon[786]: ts=2026-09-20T08:59:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:567844569worker2 # [ 39.502829] nix-grpc-daemon[783]: ts=2026-09-20T08:59:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064570worker2 # [ 39.511541] nix-grpc-daemon[858]: time=2026-09-20T08:59:54.581Z level=INFO msg="All 2 paths already cached"4571worker2 # [ 39.522965] nix-grpc-daemon[783]: ts=2026-09-20T08:59:54Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14572client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.28 seconds)4573client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4574client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds)4575lb: must succeed: curl -sf localhost:9901/clusters4576lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4577lb: must succeed: curl -sf localhost:9901/clusters4578lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4579worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4580worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.07 seconds)4581(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.27 seconds)4582subtest: inputs already in the cache are not sent to the scheduler4583lb: must succeed: curl -sf localhost:9901/clusters4584lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4585lb: must succeed: curl -sf localhost:9901/clusters4586lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4587worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4588worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4589client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24590worker1 # [ 40.333234] nix-grpc-daemon[786]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:567844591client # don't know how to build these paths:4592client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4593worker1 # [ 40.341843] nix-grpc-daemon[786]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:567844594worker2 # [ 40.391827] nix-grpc-daemon[783]: ts=2026-09-20T08:59:55Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04595worker2 # [ 40.397486] nix-grpc-daemon[783]: ts=2026-09-20T08:59:55Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14596worker2 # [ 40.403183] nix-grpc-daemon[783]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064597worker2 # [ 40.414218] nix-grpc-daemon[783]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064598worker2 # [ 40.427255] nix-grpc-daemon[858]: time=2026-09-20T08:59:55.497Z level=INFO msg="All 2 paths already cached"4599client # copying 1 paths to 'lb:50051'...4600client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4601worker2 # [ 40.435244] nix-grpc-daemon[783]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064602worker2 # [ 40.446157] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4603worker2 # [ 40.610120] nix-daemon[845]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4604worker2 # [ 40.623520] nix-daemon[845]: reaped child process 1009, status = succeeded4605worker2 # [ 40.782988] nix-daemon[845]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4606worker2 # [ 40.795199] nix-daemon[845]: reaped child process 1014, status = succeeded4607lb # [ 40.785357] niks3-server[1078]: 2026/09/20 08:59:55 INFO Received uploads request method=POST path=/api/pending_closures4608worker2 # [ 40.819428] nix-grpc-daemon[858]: time=2026-09-20T08:59:55.889Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4609worker2 # [ 40.820774] nix-grpc-daemon[858]: time=2026-09-20T08:59:55.889Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4610lb # [ 40.810553] niks3-server[1078]: 2026/09/20 08:59:55 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4611lb # [ 40.825247] niks3-server[1078]: 2026/09/20 08:59:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4612worker2 # [ 40.854843] nix-grpc-daemon[858]: time=2026-09-20T08:59:55.925Z level=INFO msg="Uploading 1 narinfos"4613lb # [ 40.830118] niks3-server[1078]: 2026/09/20 08:59:55 INFO Signed narinfos id=7 count=14614lb # [ 40.835570] niks3-server[1078]: 2026/09/20 08:59:55 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4615lb # [ 40.848173] niks3-server[1078]: 2026/09/20 08:59:55 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4616lb # [ 40.854914] niks3-server[1078]: 2026/09/20 08:59:55 INFO Completed upload id=74617lb # [ 40.857539] niks3-server[1078]: 2026/09/20 08:59:55 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4618worker2 # [ 40.882396] nix-grpc-daemon[858]: time=2026-09-20T08:59:55.952Z level=INFO msg="Upload complete. (424ms)"4619worker2 # [ 40.886706] nix-grpc-daemon[783]: ts=2026-09-20T08:59:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=7524620worker2 # [ 40.892260] nix-grpc-daemon[783]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064621worker2 # [ 40.902102] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4622worker2 # [ 40.908201] nix-daemon[845]: reaped child process 1004, status = succeeded4623worker2 # [ 40.913075] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4624client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4625client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4626client # farm-top> LOG-farm-top-t1b4627worker2 # [ 42.333985] nix-daemon[845]: reaped child process 1018, status = succeeded4628worker2 # [ 42.479080] nix-daemon[845]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4629worker2 # [ 42.490807] nix-daemon[845]: reaped child process 1037, status = succeeded4630lb # [ 42.481301] niks3-server[1078]: 2026/09/20 08:59:57 INFO Received uploads request method=POST path=/api/pending_closures4631worker2 # [ 42.511336] nix-grpc-daemon[858]: time=2026-09-20T08:59:57.581Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4632worker2 # [ 42.512948] nix-grpc-daemon[858]: time=2026-09-20T08:59:57.583Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4633lb # [ 42.506066] niks3-server[1078]: 2026/09/20 08:59:57 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4634lb # [ 42.512219] niks3-server[1078]: 2026/09/20 08:59:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4635lb # [ 42.514422] niks3-server[1078]: 2026/09/20 08:59:57 INFO Signed narinfos id=8 count=14636worker2 # [ 42.539313] nix-grpc-daemon[858]: time=2026-09-20T08:59:57.609Z level=INFO msg="Uploading 1 narinfos"4637lb # [ 42.517718] niks3-server[1078]: 2026/09/20 08:59:57 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4638lb # [ 42.520215] niks3-server[1078]: 2026/09/20 08:59:57 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4639lb # [ 42.525529] niks3-server[1078]: 2026/09/20 08:59:57 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4640lb # [ 42.529274] niks3-server[1078]: 2026/09/20 08:59:57 INFO Completed upload id=84641worker2 # [ 42.554100] nix-grpc-daemon[858]: time=2026-09-20T08:59:57.624Z level=INFO msg="Upload complete. (233ms)"4642lb # [ 42.530916] niks3-server[1078]: 2026/09/20 08:59:57 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4643worker2 # [ 42.556516] nix-grpc-daemon[783]: ts=2026-09-20T08:59:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14644worker2 # [ 42.563821] nix-daemon[845]: reaped child process 1016, status = succeeded4645client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.46 seconds)4646client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4647client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds)4648lb: must succeed: curl -sf localhost:9901/clusters4649lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4650lb: must succeed: curl -sf localhost:9901/clusters4651lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4652worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4653worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4654(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.93 seconds)4655subtest: two clients wanting the same drv build it once4656client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4657client # [ 42.979888] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4658client # Running as unit: dedup1.service; invocation ID: a1babf3e952e42478f4c264bbfb2000a4659client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.08 seconds)4660client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4661client # [ 43.187216] nix[894]: don't know how to build these paths:4662client # [ 43.188163] nix[894]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4663worker2 # [ 43.190115] nix-grpc-daemon[783]: ts=2026-09-20T08:59:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540064664worker2 # [ 43.199792] nix-grpc-daemon[783]: ts=2026-09-20T08:59:58Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04665worker2 # [ 43.204338] nix-grpc-daemon[783]: ts=2026-09-20T08:59:58Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14666worker1 # [ 43.179419] nix-grpc-daemon[786]: ts=2026-09-20T08:59:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:567844667worker1 # [ 43.194770] nix-grpc-daemon[786]: ts=2026-09-20T08:59:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:567844668client # [ 43.226725] nix[894]: copying 1 paths to 'lb:50051'...4669client # [ 43.227632] nix[894]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4670worker1 # [ 43.205530] nix-grpc-daemon[786]: ts=2026-09-20T08:59:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:567844671worker1 # [ 43.218481] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4672worker1 # [ 43.241842] nix-grpc-daemon[786]: ts=2026-09-20T08:59:58Z level=info event=niks3_push_started pid=8704673worker1 # [ 43.703060] nix-daemon[843]: accepted connection from pid 883, user nix-grpc-daemon (trusted)4674worker1 # [ 43.720855] nix-daemon[843]: reaped child process 886, status = succeeded4675worker1 # [ 43.898515] nix-daemon[843]: accepted connection from pid 888, user nix-grpc-daemon (trusted)4676worker1 # [ 43.914448] nix-daemon[843]: reaped child process 891, status = succeeded4677lb # [ 43.931517] niks3-server[1078]: 2026/09/20 08:59:58 INFO Received uploads request method=POST path=/api/pending_closures4678worker1 # [ 43.937828] nix-grpc-daemon[870]: time=2026-09-20T08:59:59.114Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4679worker1 # [ 43.940573] nix-grpc-daemon[870]: time=2026-09-20T08:59:59.117Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4680lb # [ 43.958288] niks3-server[1078]: 2026/09/20 08:59:58 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4681lb # [ 43.961721] niks3-server[1078]: 2026/09/20 08:59:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4682lb # [ 43.963400] niks3-server[1078]: 2026/09/20 08:59:58 INFO Signed narinfos id=9 count=14683worker1 # [ 43.963524] nix-grpc-daemon[870]: time=2026-09-20T08:59:59.140Z level=INFO msg="Uploading 1 narinfos"4684lb # [ 43.967484] niks3-server[1078]: 2026/09/20 08:59:58 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4685lb # [ 43.971983] niks3-server[1078]: 2026/09/20 08:59:58 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4686lb # [ 43.975873] niks3-server[1078]: 2026/09/20 08:59:58 INFO Completed upload id=94687worker1 # [ 43.975030] nix-grpc-daemon[870]: time=2026-09-20T08:59:59.153Z level=INFO msg="Upload complete. (464ms)"4688lb # [ 43.977700] niks3-server[1078]: 2026/09/20 08:59:58 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4689worker1 # [ 43.977373] nix-grpc-daemon[786]: ts=2026-09-20T08:59:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=0 paths=1 nar_bytes_in=4324690worker1 # [ 43.984487] nix-grpc-daemon[786]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:567844691worker1 # [ 43.989715] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4692worker1 # [ 43.992465] nix-daemon[843]: reaped child process 868, status = succeeded4693client # [ 44.019850] nix[894]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4694worker1 # [ 44.000069] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4695client # [ 44.060704] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4696client # Running as unit: dedup2.service; invocation ID: 0016aa9493644b05806cfca4b5a7011d4697client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4698worker1 # [ 44.311200] nix-grpc-daemon[786]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:567844699client # [ 44.345508] nix[909]: this derivation will be built:4700worker2 # [ 44.352547] nix-grpc-daemon[783]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:540064701worker2 # [ 44.363259] nix-grpc-daemon[783]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'...4702client # [ 44.381819] nix[909]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4703worker2 # [ 44.394411] nix-grpc-daemon[783]: ts=2026-09-20T08:59:59Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04704worker1 # [ 44.371648] nix-grpc-daemon[786]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:567844705client # [ 44.399555] nix[909]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4706client: must succeed: sleep 24707lb # [ 47.089459] envoy[969]: conn peer=[2001:db8:1::1]:44218 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=3826 ms=56774708lb # [ 47.093474] envoy[969]: conn peer=[2001:db8:1::1]:34940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=424709lb # [ 47.096853] envoy[969]: conn peer=[2001:db8:1::1]:34952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4139 tx=1713 ms=22124710client: (finished: must succeed: sleep 2, in 2.05 seconds)4711??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4712 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394713client: waiting for success: ! systemctl is-active dedup1 dedup24714??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4715 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394716worker1 # [ 47.618073] nix-daemon[843]: reaped child process 895, status = succeeded4717worker1 # [ 47.757063] nix-daemon[843]: accepted connection from pid 924, user nix-grpc-daemon (trusted)4718worker1 # [ 47.769077] nix-daemon[843]: reaped child process 927, status = succeeded4719lb # [ 47.785335] niks3-server[1078]: 2026/09/20 09:00:02 INFO Received uploads request method=POST path=/api/pending_closures4720worker1 # [ 47.794335] nix-grpc-daemon[870]: time=2026-09-20T09:00:02.972Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4721worker1 # [ 47.795960] nix-grpc-daemon[870]: time=2026-09-20T09:00:02.973Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4722lb # [ 47.838140] niks3-server[1078]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4723lb # [ 47.844702] niks3-server[1078]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4724lb # [ 47.849543] niks3-server[1078]: 2026/09/20 09:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4725lb # [ 47.856270] niks3-server[1078]: 2026/09/20 09:00:02 INFO Signed narinfos id=10 count=14726worker1 # [ 47.859091] nix-grpc-daemon[870]: time=2026-09-20T09:00:03.036Z level=INFO msg="Uploading 1 narinfos"4727lb # [ 47.861874] niks3-server[1078]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4728lb # [ 47.872263] niks3-server[1078]: 2026/09/20 09:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4729lb # [ 47.876171] niks3-server[1078]: 2026/09/20 09:00:02 INFO Completed upload id=104730lb # [ 47.877794] niks3-server[1078]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4731worker1 # [ 47.876545] nix-grpc-daemon[870]: time=2026-09-20T09:00:03.054Z level=INFO msg="Upload complete. (262ms)"4732worker1 # [ 47.882513] nix-grpc-daemon[786]: ts=2026-09-20T09:00:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14733worker1 # [ 47.888268] nix-grpc-daemon[786]: ts=2026-09-20T09:00:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14734worker1 # [ 47.898650] nix-daemon[843]: reaped child process 893, status = succeeded4735client # [ 47.953372] systemd[1]: dedup1.service: Deactivated successfully.4736client # [ 47.957345] systemd[1]: dedup1.service: Consumed 121ms CPU time over 4.976s wall clock time, 37.3M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4737client # [ 47.964281] systemd[1]: dedup2.service: Deactivated successfully.4738client # [ 47.966747] systemd[1]: dedup2.service: Consumed 143ms CPU time over 3.904s wall clock time, 33.2M memory peak, 8K incoming IP traffic, 6.8K outgoing IP traffic.4739client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4740client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4741client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds)4742worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4743worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4744worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4745worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4746worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4747worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4748worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4749worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4750(finished: subtest: two clients wanting the same drv build it once, in 5.98 seconds)4751subtest: build hook: nix-daemon with builders = grpc://lb4752client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4753client # [ 49.101105] systemd[1]: Started Nix Daemon.4754client # [ 49.252087] nix-daemon[950]: accepted connection from pid 947, user root (trusted)4755worker1 # [ 49.395369] nix-grpc-daemon[786]: ts=2026-09-20T09:00:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:567844756worker1 # [ 49.400492] nix-grpc-daemon[786]: ts=2026-09-20T09:00:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:567844757worker2 # [ 49.448151] nix-grpc-daemon[783]: ts=2026-09-20T09:00:04Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04758worker2 # [ 49.453946] nix-grpc-daemon[783]: ts=2026-09-20T09:00:04Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14759worker2 # [ 49.458797] nix-grpc-daemon[783]: ts=2026-09-20T09:00:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064760worker2 # [ 49.471278] nix-grpc-daemon[783]: ts=2026-09-20T09:00:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064761worker2 # [ 49.483301] nix-grpc-daemon[783]: ts=2026-09-20T09:00:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064762worker2 # [ 49.497170] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4763worker2 # [ 49.674592] nix-daemon[845]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)4764worker2 # [ 49.689860] nix-daemon[845]: reaped child process 1079, status = succeeded4765worker2 # [ 49.855177] nix-daemon[845]: accepted connection from pid 1081, user nix-grpc-daemon (trusted)4766worker2 # [ 49.868750] nix-daemon[845]: reaped child process 1084, status = succeeded4767lb # [ 49.858322] niks3-server[1078]: 2026/09/20 09:00:04 INFO Received uploads request method=POST path=/api/pending_closures4768worker2 # [ 49.891743] nix-grpc-daemon[858]: time=2026-09-20T09:00:04.961Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4769worker2 # [ 49.893567] nix-grpc-daemon[858]: time=2026-09-20T09:00:04.963Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4770lb # [ 49.890160] niks3-server[1078]: 2026/09/20 09:00:04 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4771lb # [ 49.900120] niks3-server[1078]: 2026/09/20 09:00:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4772lb # [ 49.904560] niks3-server[1078]: 2026/09/20 09:00:04 INFO Signed narinfos id=11 count=14773worker2 # [ 49.932789] nix-grpc-daemon[858]: time=2026-09-20T09:00:05.003Z level=INFO msg="Uploading 1 narinfos"4774lb # [ 49.911704] niks3-server[1078]: 2026/09/20 09:00:04 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4775lb # [ 49.921610] niks3-server[1078]: 2026/09/20 09:00:04 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4776lb # [ 49.928502] niks3-server[1078]: 2026/09/20 09:00:04 INFO Completed upload id=114777worker2 # [ 49.953550] nix-grpc-daemon[858]: time=2026-09-20T09:00:05.023Z level=INFO msg="Upload complete. (445ms)"4778worker2 # [ 49.957340] nix-grpc-daemon[783]: ts=2026-09-20T09:00:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=5124779lb # [ 49.934448] niks3-server[1078]: 2026/09/20 09:00:04 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4780worker2 # [ 49.963273] nix-grpc-daemon[783]: ts=2026-09-20T09:00:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064781worker2 # [ 49.971589] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4782worker2 # [ 49.980096] nix-daemon[845]: reaped child process 1074, status = succeeded4783worker2 # [ 49.983085] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4784worker2 # [ 50.811705] nix-daemon[845]: reaped child process 1088, status = succeeded4785worker2 # [ 50.966793] nix-daemon[845]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4786worker2 # [ 50.980981] nix-daemon[845]: reaped child process 1106, status = succeeded4787lb # [ 50.973057] niks3-server[1078]: 2026/09/20 09:00:05 INFO Received uploads request method=POST path=/api/pending_closures4788worker2 # [ 51.005751] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.075Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4789worker2 # [ 51.010241] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.077Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4790lb # [ 51.010658] niks3-server[1078]: 2026/09/20 09:00:05 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4791lb # [ 51.020566] niks3-server[1078]: 2026/09/20 09:00:05 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4792lb # [ 51.030109] niks3-server[1078]: 2026/09/20 09:00:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4793worker2 # [ 51.062306] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.132Z level=INFO msg="Uploading 1 narinfos"4794lb # [ 51.036993] niks3-server[1078]: 2026/09/20 09:00:05 INFO Signed narinfos id=12 count=14795lb # [ 51.040637] niks3-server[1078]: 2026/09/20 09:00:05 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4796lb # [ 51.052218] niks3-server[1078]: 2026/09/20 09:00:05 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4797lb # [ 51.056444] niks3-server[1078]: 2026/09/20 09:00:05 INFO Completed upload id=124798worker2 # [ 51.081368] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.151Z level=INFO msg="Upload complete. (291ms)"4799lb # [ 51.057956] niks3-server[1078]: 2026/09/20 09:00:05 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4800worker2 # [ 51.085277] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14801worker2 # [ 51.092210] nix-daemon[845]: reaped child process 1086, status = succeeded4802worker1 # [ 51.106422] nix-grpc-daemon[786]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:567844803worker1 # [ 51.126295] nix-grpc-daemon[786]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4804worker2 # [ 51.186860] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:540064805worker2 # [ 51.192759] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_out=1284806worker2 # [ 51.422951] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:540064807worker2 # [ 51.429282] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064808worker2 # [ 51.434391] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.503Z level=INFO msg="All 1 paths already cached"4809worker2 # [ 51.445241] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04810worker2 # [ 51.450828] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14811worker2 # [ 51.456320] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064812worker2 # [ 51.468864] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064813worker2 # [ 51.481244] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.551Z level=INFO msg="All 1 paths already cached"4814worker2 # [ 51.488402] nix-grpc-daemon[783]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064815worker2 # [ 51.500163] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4816worker2 # [ 51.679878] nix-daemon[845]: accepted connection from pid 1112, user nix-grpc-daemon (trusted)4817worker2 # [ 51.696696] nix-daemon[845]: reaped child process 1115, status = succeeded4818worker2 # [ 51.854817] nix-daemon[845]: accepted connection from pid 1117, user nix-grpc-daemon (trusted)4819worker2 # [ 51.866809] nix-daemon[845]: reaped child process 1120, status = succeeded4820lb # [ 51.852696] niks3-server[1078]: 2026/09/20 09:00:06 INFO Received uploads request method=POST path=/api/pending_closures4821worker2 # [ 51.885410] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.955Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4822worker2 # [ 51.886930] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.957Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4823lb # [ 51.880583] niks3-server[1078]: 2026/09/20 09:00:06 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4824lb # [ 51.890176] niks3-server[1078]: 2026/09/20 09:00:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4825lb # [ 51.894648] niks3-server[1078]: 2026/09/20 09:00:06 INFO Signed narinfos id=13 count=14826worker2 # [ 51.922452] nix-grpc-daemon[858]: time=2026-09-20T09:00:06.992Z level=INFO msg="Uploading 1 narinfos"4827lb # [ 51.908527] niks3-server[1078]: 2026/09/20 09:00:06 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4828lb # [ 51.913879] niks3-server[1078]: 2026/09/20 09:00:06 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4829lb # [ 51.919096] niks3-server[1078]: 2026/09/20 09:00:06 INFO Completed upload id=134830worker2 # [ 51.944235] nix-grpc-daemon[858]: time=2026-09-20T09:00:07.014Z level=INFO msg="Upload complete. (432ms)"4831lb # [ 51.923754] niks3-server[1078]: 2026/09/20 09:00:06 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4832worker2 # [ 51.948711] nix-grpc-daemon[783]: ts=2026-09-20T09:00:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=6244833worker2 # [ 51.952995] nix-grpc-daemon[783]: ts=2026-09-20T09:00:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064834worker2 # [ 51.963057] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4835worker2 # [ 51.964650] nix-daemon[845]: reaped child process 1110, status = succeeded4836worker2 # [ 51.969898] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4837worker2 # [ 52.588299] nix-daemon[845]: reaped child process 1124, status = succeeded4838worker2 # [ 52.740745] nix-daemon[845]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4839worker2 # [ 52.752764] nix-daemon[845]: reaped child process 1142, status = succeeded4840lb # [ 52.743975] niks3-server[1078]: 2026/09/20 09:00:07 INFO Received uploads request method=POST path=/api/pending_closures4841worker2 # [ 52.777152] nix-grpc-daemon[858]: time=2026-09-20T09:00:07.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4842worker2 # [ 52.778659] nix-grpc-daemon[858]: time=2026-09-20T09:00:07.849Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4843lb # [ 52.777163] niks3-server[1078]: 2026/09/20 09:00:07 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4844lb # [ 52.789391] niks3-server[1078]: 2026/09/20 09:00:07 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4845lb # [ 52.800565] niks3-server[1078]: 2026/09/20 09:00:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4846lb # [ 52.805757] niks3-server[1078]: 2026/09/20 09:00:07 INFO Signed narinfos id=14 count=14847worker2 # [ 52.833125] nix-grpc-daemon[858]: time=2026-09-20T09:00:07.903Z level=INFO msg="Uploading 1 narinfos"4848lb # [ 52.811205] niks3-server[1078]: 2026/09/20 09:00:07 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4849lb # [ 52.820286] niks3-server[1078]: 2026/09/20 09:00:07 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4850lb # [ 52.825360] niks3-server[1078]: 2026/09/20 09:00:07 INFO Completed upload id=144851lb # [ 52.828087] niks3-server[1078]: 2026/09/20 09:00:07 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4852worker2 # [ 52.851690] nix-grpc-daemon[858]: time=2026-09-20T09:00:07.921Z level=INFO msg="Upload complete. (273ms)"4853worker2 # [ 52.857567] nix-grpc-daemon[783]: ts=2026-09-20T09:00:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14854worker1 # [ 52.842545] nix-grpc-daemon[786]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:567844855worker2 # [ 52.871774] nix-daemon[845]: reaped child process 1122, status = succeeded4856worker1 # [ 52.848024] nix-grpc-daemon[786]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4857worker1 # [ 52.871200] nix-grpc-daemon[786]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:567844858worker1 # [ 52.873924] nix-grpc-daemon[786]: ts=2026-09-20T09:00:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=0 paths=1 nar_bytes_out=1764859worker2 # [ 53.146860] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:540064860worker2 # [ 53.153096] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064861worker2 # [ 53.158556] nix-grpc-daemon[858]: time=2026-09-20T09:00:08.228Z level=INFO msg="All 2 paths already cached"4862worker2 # [ 53.172713] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04863worker2 # [ 53.178239] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14864worker2 # [ 53.183700] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064865worker2 # [ 53.195218] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064866worker2 # [ 53.207743] nix-grpc-daemon[858]: time=2026-09-20T09:00:08.278Z level=INFO msg="All 2 paths already cached"4867worker2 # [ 53.215077] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064868worker2 # [ 53.226132] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4869worker2 # [ 53.361541] nix-daemon[845]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4870worker2 # [ 53.374111] nix-daemon[845]: reaped child process 1151, status = succeeded4871worker2 # [ 53.512853] nix-daemon[845]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)4872worker2 # [ 53.525151] nix-daemon[845]: reaped child process 1156, status = succeeded4873lb # [ 53.510280] niks3-server[1078]: 2026/09/20 09:00:08 INFO Received uploads request method=POST path=/api/pending_closures4874worker2 # [ 53.544201] nix-grpc-daemon[858]: time=2026-09-20T09:00:08.614Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4875worker2 # [ 53.545719] nix-grpc-daemon[858]: time=2026-09-20T09:00:08.616Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4876lb # [ 53.540272] niks3-server[1078]: 2026/09/20 09:00:08 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4877lb # [ 53.544481] niks3-server[1078]: 2026/09/20 09:00:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4878lb # [ 53.546730] niks3-server[1078]: 2026/09/20 09:00:08 INFO Signed narinfos id=15 count=14879worker2 # [ 53.572760] nix-grpc-daemon[858]: time=2026-09-20T09:00:08.643Z level=INFO msg="Uploading 1 narinfos"4880lb # [ 53.549839] niks3-server[1078]: 2026/09/20 09:00:08 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4881lb # [ 53.557302] niks3-server[1078]: 2026/09/20 09:00:08 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4882lb # [ 53.561484] niks3-server[1078]: 2026/09/20 09:00:08 INFO Completed upload id=154883worker2 # [ 53.586116] nix-grpc-daemon[858]: time=2026-09-20T09:00:08.656Z level=INFO msg="Upload complete. (348ms)"4884worker2 # [ 53.587574] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=7524885lb # [ 53.563336] niks3-server[1078]: 2026/09/20 09:00:08 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4886worker2 # [ 53.594329] nix-grpc-daemon[783]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540064887worker2 # [ 53.596052] nix-daemon[845]: reaped child process 1146, status = succeeded4888worker2 # [ 53.598955] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4889worker2 # [ 53.605533] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4890worker2 # [ 54.628826] nix-daemon[845]: reaped child process 1160, status = succeeded4891worker2 # [ 54.774080] nix-daemon[845]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4892worker2 # [ 54.785977] nix-daemon[845]: reaped child process 1178, status = succeeded4893lb # [ 54.778578] niks3-server[1078]: 2026/09/20 09:00:09 INFO Received uploads request method=POST path=/api/pending_closures4894worker2 # [ 54.813279] nix-grpc-daemon[858]: time=2026-09-20T09:00:09.882Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4895worker2 # [ 54.814675] nix-grpc-daemon[858]: time=2026-09-20T09:00:09.882Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4896lb # [ 54.815137] niks3-server[1078]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4897lb # [ 54.832548] niks3-server[1078]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4898lb # [ 54.840889] niks3-server[1078]: 2026/09/20 09:00:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4899lb # [ 54.846175] niks3-server[1078]: 2026/09/20 09:00:09 INFO Signed narinfos id=16 count=14900worker2 # [ 54.874094] nix-grpc-daemon[858]: time=2026-09-20T09:00:09.944Z level=INFO msg="Uploading 1 narinfos"4901lb # [ 54.851605] niks3-server[1078]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4902lb # [ 54.861290] niks3-server[1078]: 2026/09/20 09:00:09 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4903lb # [ 54.865218] niks3-server[1078]: 2026/09/20 09:00:09 INFO Completed upload id=164904worker2 # [ 54.890090] nix-grpc-daemon[858]: time=2026-09-20T09:00:09.960Z level=INFO msg="Upload complete. (276ms)"4905lb # [ 54.866727] niks3-server[1078]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4906worker1 # [ 54.873183] nix-grpc-daemon[786]: ts=2026-09-20T09:00:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:567844907worker2 # [ 54.897289] nix-grpc-daemon[783]: ts=2026-09-20T09:00:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14908worker1 # [ 54.878197] nix-grpc-daemon[786]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4909worker2 # [ 54.909990] nix-daemon[845]: reaped child process 1158, status = succeeded4910worker2 # [ 54.924893] nix-grpc-daemon[783]: ts=2026-09-20T09:00:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:540064911worker2 # [ 54.929311] nix-grpc-daemon[783]: ts=2026-09-20T09:00:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_out=2324912client # [ 55.038251] nix-daemon[950]: reaped child process 952, status = succeeded4913client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.15 seconds)4914client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4915client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4916client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4917client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4918client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4919client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4920(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.24 seconds)4921subtest: an input only one worker has still reaches the builder4922client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4923client # this derivation will be built:4924client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4925client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4926client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.65 seconds)4927client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4928client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4929worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4930worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.18 seconds)4931worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4932worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4933client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24934client # [ 56.368615] nix-daemon[950]: accepted connection from pid 1029, user root (trusted)4935client # this derivation will be built:4936client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4937worker2 # [ 56.559902] nix-grpc-daemon[783]: ts=2026-09-20T09:00:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:540064938worker2 # [ 56.562275] nix-grpc-daemon[783]: ts=2026-09-20T09:00:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540064939client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4940client # copying 1 paths...4941client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4942worker2 # [ 56.570768] nix-grpc-daemon[783]: ts=2026-09-20T09:00:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540064943worker2 # [ 56.574874] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4944worker2 # [ 56.725792] nix-daemon[845]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)4945worker2 # [ 56.738723] nix-daemon[845]: reaped child process 1188, status = succeeded4946lb # [ 56.728672] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received uploads request method=POST path=/api/pending_closures4947worker2 # [ 56.757758] nix-grpc-daemon[858]: time=2026-09-20T09:00:11.828Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4948worker2 # [ 56.759465] nix-grpc-daemon[858]: time=2026-09-20T09:00:11.829Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4949lb # [ 56.742185] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4950lb # [ 56.746726] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4951lb # [ 56.749301] niks3-server[1078]: 2026/09/20 09:00:11 INFO Signed narinfos id=17 count=14952worker2 # [ 56.774124] nix-grpc-daemon[858]: time=2026-09-20T09:00:11.844Z level=INFO msg="Uploading 1 narinfos"4953lb # [ 56.751546] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4954lb # [ 56.756150] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4955lb # [ 56.758773] niks3-server[1078]: 2026/09/20 09:00:11 INFO Completed upload id=174956worker2 # [ 56.783676] nix-grpc-daemon[858]: time=2026-09-20T09:00:11.854Z level=INFO msg="Upload complete. (203ms)"4957lb # [ 56.761156] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4958worker2 # [ 56.785507] nix-grpc-daemon[783]: ts=2026-09-20T09:00:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=0 paths=1 nar_bytes_in=1204959worker2 # [ 56.792083] nix-daemon[845]: reaped child process 1183, status = succeeded4960worker2 # [ 56.795438] nix-grpc-daemon[783]: ts=2026-09-20T09:00:11Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04961worker2 # [ 56.797545] nix-grpc-daemon[783]: ts=2026-09-20T09:00:11Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14962worker1 # [ 56.814339] nix-grpc-daemon[786]: ts=2026-09-20T09:00:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:567844963worker1 # [ 56.825750] nix-grpc-daemon[786]: ts=2026-09-20T09:00:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:567844964client # copying 2 paths to 'lb:50051'...4965client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4966client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4967worker1 # [ 56.838173] nix-grpc-daemon[786]: ts=2026-09-20T09:00:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:567844968worker1 # [ 56.848700] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4969worker1 # [ 57.021418] nix-daemon[843]: accepted connection from pid 950, user nix-grpc-daemon (trusted)4970worker1 # [ 57.035566] nix-daemon[843]: reaped child process 953, status = succeeded4971lb # [ 57.091229] envoy[969]: conn peer=[2001:db8:1::1]:33136 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1370 ms=47344972lb # [ 57.094853] envoy[969]: conn peer=[2001:db8:1::1]:33144 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1602 tx=1487 ms=35924973lb # [ 57.098428] envoy[969]: conn peer=[2001:db8:1::1]:33160 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3410 tx=1772 ms=17964974lb # [ 57.101934] envoy[969]: conn peer=[2001:db8:1::1]:33172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=304975lb # [ 57.105416] envoy[969]: conn peer=[2001:db8:1::1]:33182 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3837 tx=1972 ms=15324976lb # [ 57.108956] envoy[969]: conn peer=[2001:db8:1::1]:50146 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=564977lb # [ 57.112429] envoy[969]: conn peer=[2001:db8:1::1]:50154 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2197 ms=18364978lb # [ 57.116634] envoy[969]: conn peer=[2001:db8:1::1]:50156 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=574979worker1 # [ 57.187090] nix-daemon[843]: accepted connection from pid 955, user nix-grpc-daemon (trusted)4980worker1 # [ 57.197983] nix-daemon[843]: reaped child process 958, status = succeeded4981lb # [ 57.208140] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received uploads request method=POST path=/api/pending_closures4982lb # [ 57.216226] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received uploads request method=POST path=/api/pending_closures4983worker1 # [ 57.221861] nix-grpc-daemon[870]: time=2026-09-20T09:00:12.399Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4984worker1 # [ 57.224193] nix-grpc-daemon[870]: time=2026-09-20T09:00:12.401Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4985worker1 # [ 57.225795] nix-grpc-daemon[870]: time=2026-09-20T09:00:12.401Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4986lb # [ 57.236989] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4987lb # [ 57.242828] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4988lb # [ 57.248503] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4989lb # [ 57.250990] niks3-server[1078]: 2026/09/20 09:00:11 INFO Signed narinfos id=18 count=14990lb # [ 57.252726] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4991lb # [ 57.255031] niks3-server[1078]: 2026/09/20 09:00:11 INFO Signed narinfos id=19 count=24992worker1 # [ 57.254576] nix-grpc-daemon[870]: time=2026-09-20T09:00:12.432Z level=INFO msg="Uploading 3 narinfos"4993lb # [ 57.257166] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4994lb # [ 57.267756] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4995lb # [ 57.276469] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4996lb # [ 57.279212] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4997lb # [ 57.283471] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4998lb # [ 57.286692] niks3-server[1078]: 2026/09/20 09:00:11 INFO Completed upload id=184999lb # [ 57.288025] niks3-server[1078]: 2026/09/20 09:00:11 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5000lb # [ 57.289741] niks3-server[1078]: 2026/09/20 09:00:11 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5001lb # [ 57.292384] niks3-server[1078]: 2026/09/20 09:00:11 INFO Completed upload id=195002worker1 # [ 57.292665] nix-grpc-daemon[870]: time=2026-09-20T09:00:12.470Z level=INFO msg="Upload complete. (426ms)"5003worker1 # [ 57.295885] nix-grpc-daemon[786]: ts=2026-09-20T09:00:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=0 paths=2 nar_bytes_in=9765004worker1 # [ 57.300512] nix-grpc-daemon[786]: ts=2026-09-20T09:00:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:567845005worker1 # [ 57.309060] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5006worker1 # [ 57.313350] nix-daemon[843]: reaped child process 948, status = succeeded5007worker1 # [ 57.318378] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5008client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5009client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5010worker1 # [ 58.133457] nix-daemon[843]: reaped child process 962, status = succeeded5011worker1 # [ 58.273298] nix-daemon[843]: accepted connection from pid 977, user nix-grpc-daemon (trusted)5012worker1 # [ 58.284901] nix-daemon[843]: reaped child process 980, status = succeeded5013lb # [ 58.297487] niks3-server[1078]: 2026/09/20 09:00:12 INFO Received uploads request method=POST path=/api/pending_closures5014worker1 # [ 58.303581] nix-grpc-daemon[870]: time=2026-09-20T09:00:13.481Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5015lb # [ 58.326745] niks3-server[1078]: 2026/09/20 09:00:12 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5016lb # [ 58.331694] niks3-server[1078]: 2026/09/20 09:00:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5017worker1 # [ 58.338023] nix-grpc-daemon[870]: time=2026-09-20T09:00:13.515Z level=INFO msg="Uploading 1 narinfos"5018lb # [ 58.338698] niks3-server[1078]: 2026/09/20 09:00:13 INFO Signed narinfos id=20 count=15019lb # [ 58.344642] niks3-server[1078]: 2026/09/20 09:00:13 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5020lb # [ 58.356961] niks3-server[1078]: 2026/09/20 09:00:13 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5021lb # [ 58.363571] niks3-server[1078]: 2026/09/20 09:00:13 INFO Completed upload id=205022worker1 # [ 58.362637] nix-grpc-daemon[870]: time=2026-09-20T09:00:13.540Z level=INFO msg="Upload complete. (237ms)"5023lb # [ 58.366323] niks3-server[1078]: 2026/09/20 09:00:13 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5024worker1 # [ 58.367652] nix-grpc-daemon[786]: ts=2026-09-20T09:00:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15025worker1 # [ 58.378815] nix-daemon[843]: reaped child process 960, status = succeeded5026client # copying 1 paths...5027worker2 # [ 58.442973] nix-grpc-daemon[783]: ts=2026-09-20T09:00:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:540065028worker2 # [ 58.457186] nix-grpc-daemon[783]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5029client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5030worker1 # [ 58.464312] nix-grpc-daemon[786]: ts=2026-09-20T09:00:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:567845031worker1 # [ 58.468937] nix-grpc-daemon[786]: ts=2026-09-20T09:00:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=0 paths=1 nar_bytes_out=1205032client # [ 58.559257] nix-daemon[950]: reaped child process 1032, status = succeeded5033client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.41 seconds)5034client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25035client # [ 58.746124] nix-daemon[950]: accepted connection from pid 1050, user root (trusted)5036client # this derivation will be built:5037client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5038worker1 # [ 58.906871] nix-grpc-daemon[786]: ts=2026-09-20T09:00:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:567845039client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5040worker2 # [ 58.939323] nix-grpc-daemon[783]: ts=2026-09-20T09:00:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540065041worker2 # [ 58.945133] nix-grpc-daemon[858]: time=2026-09-20T09:00:14.015Z level=INFO msg="All 1 paths already cached"5042worker2 # [ 58.953704] nix-grpc-daemon[783]: ts=2026-09-20T09:00:14Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05043worker2 # [ 58.956378] nix-grpc-daemon[783]: ts=2026-09-20T09:00:14Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15044worker2 # [ 58.997759] nix-grpc-daemon[783]: ts=2026-09-20T09:00:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540065045worker2 # [ 59.005228] nix-grpc-daemon[783]: ts=2026-09-20T09:00:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540065046client # copying 1 paths to 'lb:50051'...5047worker2 # [ 59.014946] nix-grpc-daemon[783]: ts=2026-09-20T09:00:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540065048client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5049worker2 # [ 59.023307] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5050worker2 # [ 59.031164] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)5051worker2 # [ 59.108987] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 2/5)5052worker2 # [ 59.122740] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 3/5)5053worker2 # [ 59.248498] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 446 ms (attempt 4/5)5054worker2 # [ 59.699645] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5055worker2 # [ 59.702131] nix-grpc-daemon[783]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5056worker2 # [ 59.870780] nix-daemon[845]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5057worker2 # [ 59.883183] nix-daemon[845]: reaped child process 1204, status = succeeded5058worker2 # [ 60.025827] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5059worker2 # [ 60.038570] nix-daemon[845]: reaped child process 1209, status = succeeded5060lb # [ 60.026322] niks3-server[1078]: 2026/09/20 09:00:14 INFO Received uploads request method=POST path=/api/pending_closures5061worker2 # [ 60.059981] nix-grpc-daemon[858]: time=2026-09-20T09:00:15.129Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5062worker2 # [ 60.061377] nix-grpc-daemon[858]: time=2026-09-20T09:00:15.130Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5063lb # [ 60.054514] niks3-server[1078]: 2026/09/20 09:00:14 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5064lb # [ 60.062192] niks3-server[1078]: 2026/09/20 09:00:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5065lb # [ 60.066947] niks3-server[1078]: 2026/09/20 09:00:14 INFO Signed narinfos id=21 count=15066worker2 # [ 60.095500] nix-grpc-daemon[858]: time=2026-09-20T09:00:15.165Z level=INFO msg="Uploading 1 narinfos"5067lb # [ 60.078103] niks3-server[1078]: 2026/09/20 09:00:14 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5068lb # [ 60.086364] niks3-server[1078]: 2026/09/20 09:00:14 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5069lb # [ 60.092208] niks3-server[1078]: 2026/09/20 09:00:14 INFO Completed upload id=215070worker2 # [ 60.120286] nix-grpc-daemon[858]: time=2026-09-20T09:00:15.190Z level=INFO msg="Upload complete. (405ms)"5071lb # [ 60.096623] niks3-server[1078]: 2026/09/20 09:00:14 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5072worker2 # [ 60.125208] nix-grpc-daemon[783]: ts=2026-09-20T09:00:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=1 paths=1 nar_bytes_in=5605073worker2 # [ 60.130852] nix-grpc-daemon[783]: ts=2026-09-20T09:00:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540065074worker2 # [ 60.141827] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5075worker2 # [ 60.147919] nix-daemon[845]: reaped child process 1195, status = succeeded5076worker2 # [ 60.151026] nix-daemon[845]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5077client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5078client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5079worker2 # [ 61.371983] nix-daemon[845]: reaped child process 1213, status = succeeded5080worker2 # [ 61.523952] nix-daemon[845]: accepted connection from pid 1228, user nix-grpc-daemon (trusted)5081worker2 # [ 61.536413] nix-daemon[845]: reaped child process 1231, status = succeeded5082lb # [ 61.528401] niks3-server[1078]: 2026/09/20 09:00:16 INFO Received uploads request method=POST path=/api/pending_closures5083worker2 # [ 61.794121] nix-grpc-daemon[858]: time=2026-09-20T09:00:16.860Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5084lb # [ 61.791297] niks3-server[1078]: 2026/09/20 09:00:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5085lb # [ 61.797787] niks3-server[1078]: 2026/09/20 09:00:16 INFO Signed narinfos id=22 count=15086worker2 # [ 61.823228] nix-grpc-daemon[858]: time=2026-09-20T09:00:16.893Z level=INFO msg="Uploading 1 narinfos"5087lb # [ 61.814765] niks3-server[1078]: 2026/09/20 09:00:16 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5088lb # [ 61.821890] niks3-server[1078]: 2026/09/20 09:00:16 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5089lb # [ 61.825454] niks3-server[1078]: 2026/09/20 09:00:16 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5090lb # [ 61.830711] niks3-server[1078]: 2026/09/20 09:00:16 INFO Completed upload id=225091worker2 # [ 61.855503] nix-grpc-daemon[858]: time=2026-09-20T09:00:16.925Z level=WARN msg="Failed to register uploaded object" key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo error="server returned 404: object is not pending upload\n"5092worker2 # [ 61.863512] nix-grpc-daemon[858]: time=2026-09-20T09:00:16.931Z level=INFO msg="Upload complete. (503ms)"5093worker2 # [ 61.870163] nix-grpc-daemon[783]: ts=2026-09-20T09:00:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54006 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15094worker2 # [ 61.882708] nix-daemon[845]: reaped child process 1211, status = succeeded5095client # copying 1 paths...5096worker1 # [ 61.888614] nix-grpc-daemon[786]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:567845097worker1 # [ 61.896917] nix-grpc-daemon[786]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5098client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5099worker1 # [ 61.926321] nix-grpc-daemon[786]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:567845100worker1 # [ 61.929239] nix-grpc-daemon[786]: ts=2026-09-20T09:00:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=0 paths=1 nar_bytes_out=1205101client # [ 62.060289] nix-daemon[950]: reaped child process 1053, status = succeeded5102client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.50 seconds)5103client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25104client # [ 62.249857] nix-daemon[950]: accepted connection from pid 1071, user root (trusted)5105client # this derivation will be built:5106client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5107worker2 # [ 62.427901] nix-grpc-daemon[783]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:540065108client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5109worker1 # [ 62.406537] nix-grpc-daemon[786]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:567845110worker1 # [ 62.416394] nix-grpc-daemon[870]: time=2026-09-20T09:00:17.593Z level=INFO msg="All 1 paths already cached"5111worker2 # [ 62.456411] nix-grpc-daemon[783]: ts=2026-09-20T09:00:17Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05112worker2 # [ 62.461756] nix-grpc-daemon[783]: ts=2026-09-20T09:00:17Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15113worker1 # [ 62.438102] nix-grpc-daemon[786]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:567845114worker1 # [ 62.450267] nix-grpc-daemon[786]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:567845115worker1 # [ 62.462467] nix-grpc-daemon[870]: time=2026-09-20T09:00:17.640Z level=INFO msg="All 1 paths already cached"5116client # copying 1 paths to 'lb:50051'...5117client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5118worker1 # [ 62.469700] nix-grpc-daemon[786]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:567845119worker1 # [ 62.481681] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5120worker1 # [ 62.646581] nix-daemon[843]: accepted connection from pid 985, user nix-grpc-daemon (trusted)5121worker1 # [ 62.659925] nix-daemon[843]: reaped child process 988, status = succeeded5122worker1 # [ 62.817972] nix-daemon[843]: accepted connection from pid 990, user nix-grpc-daemon (trusted)5123worker1 # [ 62.830276] nix-daemon[843]: reaped child process 993, status = succeeded5124lb # [ 62.844705] niks3-server[1078]: 2026/09/20 09:00:17 INFO Received uploads request method=POST path=/api/pending_closures5125worker1 # [ 62.852726] nix-grpc-daemon[870]: time=2026-09-20T09:00:18.030Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5126worker1 # [ 62.854310] nix-grpc-daemon[870]: time=2026-09-20T09:00:18.032Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5127lb # [ 62.865944] niks3-server[1078]: 2026/09/20 09:00:17 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5128lb # [ 62.870470] niks3-server[1078]: 2026/09/20 09:00:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5129lb # [ 62.872988] niks3-server[1078]: 2026/09/20 09:00:17 INFO Signed narinfos id=23 count=15130worker1 # [ 62.872245] nix-grpc-daemon[870]: time=2026-09-20T09:00:18.050Z level=INFO msg="Uploading 1 narinfos"5131lb # [ 62.878873] niks3-server[1078]: 2026/09/20 09:00:17 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5132lb # [ 62.882508] niks3-server[1078]: 2026/09/20 09:00:17 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5133lb # [ 62.885839] niks3-server[1078]: 2026/09/20 09:00:17 INFO Completed upload id=235134worker1 # [ 62.884870] nix-grpc-daemon[870]: time=2026-09-20T09:00:18.062Z level=INFO msg="Upload complete. (391ms)"5135worker1 # [ 62.886810] nix-grpc-daemon[786]: ts=2026-09-20T09:00:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=0 paths=1 nar_bytes_in=5605136lb # [ 62.888435] niks3-server[1078]: 2026/09/20 09:00:17 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5137worker1 # [ 62.890447] nix-grpc-daemon[786]: ts=2026-09-20T09:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:567845138worker1 # [ 62.896938] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5139worker1 # [ 62.899210] nix-daemon[843]: reaped child process 983, status = succeeded5140worker1 # [ 62.904339] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)5141client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5142client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5143worker1 # [ 64.317451] nix-daemon[843]: reaped child process 997, status = succeeded5144worker1 # [ 64.461275] nix-daemon[843]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)5145worker1 # [ 64.472162] nix-daemon[843]: reaped child process 1015, status = succeeded5146lb # [ 64.488370] niks3-server[1078]: 2026/09/20 09:00:19 INFO Received uploads request method=POST path=/api/pending_closures5147worker1 # [ 64.495736] nix-grpc-daemon[870]: time=2026-09-20T09:00:19.673Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5148lb # [ 64.520140] niks3-server[1078]: 2026/09/20 09:00:19 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5149lb # [ 64.524696] niks3-server[1078]: 2026/09/20 09:00:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5150worker1 # [ 64.530337] nix-grpc-daemon[870]: time=2026-09-20T09:00:19.708Z level=INFO msg="Uploading 1 narinfos"5151lb # [ 64.531116] niks3-server[1078]: 2026/09/20 09:00:19 INFO Signed narinfos id=24 count=15152lb # [ 64.537148] niks3-server[1078]: 2026/09/20 09:00:19 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5153lb # [ 64.550129] niks3-server[1078]: 2026/09/20 09:00:19 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5154lb # [ 64.555180] niks3-server[1078]: 2026/09/20 09:00:19 INFO Completed upload id=245155worker1 # [ 64.554280] nix-grpc-daemon[870]: time=2026-09-20T09:00:19.732Z level=INFO msg="Upload complete. (241ms)"5156lb # [ 64.560125] niks3-server[1078]: 2026/09/20 09:00:19 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5157worker1 # [ 64.559623] nix-grpc-daemon[786]: ts=2026-09-20T09:00:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15158worker1 # [ 64.571439] nix-daemon[843]: reaped child process 995, status = succeeded5159client # copying 1 paths...5160worker2 # [ 64.631335] nix-grpc-daemon[783]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:540065161worker2 # [ 64.639477] nix-grpc-daemon[783]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5162client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5163worker1 # [ 64.641877] nix-grpc-daemon[786]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:567845164worker1 # [ 64.647773] nix-grpc-daemon[786]: ts=2026-09-20T09:00:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56784 duration_s=0 paths=1 nar_bytes_out=1205165client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.66 seconds)5166(finished: subtest: an input only one worker has still reaches the builder, in 9.60 seconds)5167subtest: upload whose reference the worker lacks is completed from the cache5168client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5169client # [ 64.748267] nix-daemon[950]: reaped child process 1074, status = succeeded5170client # this derivation will be built:5171client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5172client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5173client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.37 seconds)5174client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5175client # this derivation will be built:5176client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5177client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5178client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.67 seconds)5179client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5180client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5181worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5182worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds)5183worker2 # [ 66.202714] systemd[1]: Stopping Nix worker-protocol over gRPC...5184worker2 # [ 66.387182] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=signal_exit5185worker2 # [ 66.631690] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=scheduler_yield5186worker1 # [ 66.610317] nix-grpc-daemon[786]: ts=2026-09-20T09:00:21Z level=info event=scheduler_restarting addr=lb:500515187lb # [ 66.611475] niks3-server[1078]: 2026/09/20 09:00:21 INFO lead: released remote=192.168.1.4:599885188worker2 # [ 66.640921] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:412985189worker2 # [ 66.646348] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=worker_gone addr=192.168.1.3:500515190worker2 # [ 66.649421] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=scheduler_restarting addr=lb:500515191worker2 # [ 66.652486] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:412985192worker2 # [ 66.655777] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=worker_gone addr=192.168.1.4:500515193worker1 # [ 66.810621] nix-grpc-daemon[786]: ts=2026-09-20T09:00:21Z level=info event=scheduler_connected addr=lb:500515194worker2 # [ 66.842881] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=scheduler_connected addr=lb:500515195worker2 # [ 66.849932] nix-grpc-daemon[783]: ts=2026-09-20T09:00:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5196worker1 # [ 66.829728] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5197worker2 # [ 67.049559] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=scheduler_connected addr=lb:500515198worker2 # [ 67.055283] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5199worker1 # [ 67.030751] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_connected addr=lb:500515200worker1 # [ 67.035825] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5201lb # [ 67.091589] envoy[969]: conn peer=[2001:db8:1::1]:50180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=175202lb # [ 67.095259] envoy[969]: conn peer=[2001:db8:1::1]:50168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4203 tx=1863 ms=19475203lb # [ 67.098760] envoy[969]: conn peer=[2001:db8:1::1]:50184 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1914 ms=30775204lb # [ 67.102339] envoy[969]: conn peer=[2001:db8:1::1]:50194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=575205lb # [ 67.105716] envoy[969]: conn peer=[2001:db8:1::1]:50200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1917 ms=22565206lb # [ 67.109296] envoy[969]: conn peer=[2001:db8:1::1]:35584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=185207worker2 # [ 67.256394] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=scheduler_connected addr=lb:500515208worker1 # [ 67.236462] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_connected addr=lb:500515209worker2 # [ 67.262074] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5210worker1 # [ 67.239031] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5211worker1 # [ 67.439624] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_connected addr=lb:500515212worker2 # [ 67.463799] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=scheduler_connected addr=lb:500515213worker1 # [ 67.442940] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5214worker2 # [ 67.469656] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5215worker2 # [ 67.632517] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=scheduler_restarting5216worker1 # [ 67.644190] nix-grpc-daemon[786]: ts=2026-09-20T09:00:22Z level=info event=scheduler_connected addr=lb:500515217worker2 # [ 67.674247] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5218worker2 # [ 67.680487] nix-grpc-daemon[783]: E0000 00:00:1789894822.743648 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5219worker2 # [ 67.693574] nix-grpc-daemon[783]: ts=2026-09-20T09:00:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5220worker2 # [ 67.812323] nix-daemon[845]: reaped child process 847, status = succeeded5221worker2 # [ 68.528413] nix-grpc-daemon[783]: E0000 00:00:1789894823.597870 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5222worker2 # [ 68.533639] nix-grpc-daemon[783]: E0000 00:00:1789894823.598059 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5223worker1 # [ 68.907387] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5224worker2 # [ 68.948549] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5225worker2 # [ 68.952866] systemd[1]: Stopped Nix worker-protocol over gRPC.5226worker2 # [ 68.956292] systemd[1]: nix-grpc-daemon.service: Consumed 2.652s CPU time over 51.837s wall clock time, 64M memory peak, 93.8K incoming IP traffic, 181K outgoing IP traffic.5227worker2 # [ 68.966662] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5228worker2 # [ 68.970807] systemd[1]: Closed Nix worker-protocol over gRPC.5229worker2 # [ 68.974243] systemd[1]: nix-grpc-daemon.socket: Consumed 287us CPU time over 59.610s wall clock time, 256K memory peak, 111.8K incoming IP traffic, 85.4K outgoing IP traffic.5230lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5231lb: must succeed: curl -sf localhost:9901/clusters5232lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5233lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5234client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25235worker1 # [ 69.107781] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_connected addr=lb:500515236worker1 # [ 69.113272] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5237worker1 # [ 69.232293] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:567845238client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5239worker1 # [ 69.237530] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:567845240client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.23 seconds)5241worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5242worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5243worker1 # [ 69.313972] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_connected addr=lb:500515244worker1 # [ 69.317994] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5245worker2 # [ 69.374840] systemd[1]: Listening on Nix worker-protocol over gRPC.5246worker1 # [ 69.408106] systemd[1]: Stopping Nix worker-protocol over gRPC...5247worker1 # [ 69.518469] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_connected addr=lb:500515248worker1 # [ 69.520920] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5249worker1 # [ 69.722068] nix-grpc-daemon[786]: ts=2026-09-20T09:00:24Z level=info event=scheduler_connected addr=lb:500515250worker2 # [ 69.757996] systemd[1]: Starting Nix worker-protocol over gRPC...5251worker2 # [ 69.950071] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5252worker2 # [ 69.952201] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15253worker2 # [ 69.961066] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5254worker2 # [ 69.966674] systemd[1]: Started Nix worker-protocol over gRPC.5255worker1 # [ 69.948563] nix-grpc-daemon[786]: ts=2026-09-20T09:00:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5256lb # [ 69.951727] niks3-server[1078]: 2026/09/20 09:00:24 INFO lead: acquired remote=192.168.1.4:571685257worker2 # [ 69.980141] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=scheduler_take_over5258worker2 # [ 69.997246] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=scheduler_connected addr=lb:500515259worker2 # [ 69.999317] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5260worker1 # [ 70.148910] nix-grpc-daemon[786]: ts=2026-09-20T09:00:25Z level=info event=scheduler_connected addr=lb:500515261worker2 # [ 70.178538] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05262worker2 # [ 70.200384] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=scheduler_connected addr=lb:500515263worker2 # [ 70.204451] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5264worker1 # [ 70.331734] nix-grpc-daemon[786]: ts=2026-09-20T09:00:25Z level=info event=signal_exit5265worker2 # [ 70.405294] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=scheduler_connected addr=lb:500515266worker2 # [ 70.409591] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05267worker1 # [ 71.577325] nix-grpc-daemon[786]: ts=2026-09-20T09:00:26Z level=info event=scheduler_restarting5268worker2 # [ 71.611970] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416925269worker2 # [ 71.615689] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:26Z level=info event=worker_gone addr=192.168.1.3:500515270worker1 # [ 71.597450] nix-grpc-daemon[786]: ts=2026-09-20T09:00:26Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5271worker1 # [ 71.617168] nix-daemon[843]: reaped child process 846, status = succeeded5272worker1 # [ 72.452762] nix-grpc-daemon[786]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5273worker1 # [ 72.456304] nix-grpc-daemon[786]: E0000 00:00:1789894827.630073 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5274worker1 # [ 72.460930] nix-grpc-daemon[786]: E0000 00:00:1789894827.630739 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5275worker1 # [ 72.861903] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5276worker1 # [ 72.867828] systemd[1]: Stopped Nix worker-protocol over gRPC.5277worker1 # [ 72.870147] systemd[1]: nix-grpc-daemon.service: Consumed 1.406s CPU time over 55.780s wall clock time, 50.3M memory peak, 48.1K incoming IP traffic, 86.6K outgoing IP traffic.5278worker1 # [ 72.880360] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5279worker1 # [ 72.884367] systemd[1]: Closed Nix worker-protocol over gRPC.5280worker1 # [ 72.887884] systemd[1]: nix-grpc-daemon.socket: Consumed 295us CPU time over 1min 3.656s wall clock time, 256K memory peak, 85.5K incoming IP traffic, 73K outgoing IP traffic.5281lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5282lb: must succeed: curl -sf localhost:9901/clusters5283lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5284lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5285client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25286worker2 # [ 73.164104] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359505287worker2 # [ 73.170414] nix-daemon[845]: accepted connection from pid 1255, user nix-grpc-daemon (trusted)5288worker2 # [ 73.178989] nix-grpc-daemon[1255]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5)5289worker2 # [ 73.203438] nix-grpc-daemon[1255]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 2/5)5290worker2 # [ 73.347169] nix-grpc-daemon[1255]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 271 ms (attempt 3/5)5291worker2 # [ 73.621516] nix-grpc-daemon[1255]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 474 ms (attempt 4/5)5292worker2 # [ 74.102268] nix-grpc-daemon[1255]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5293client # copying 2 paths...5294client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5295worker2 # [ 74.123558] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359505296client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5297worker2 # [ 74.136172] nix-daemon[845]: accepted connection from pid 1255, user nix-grpc-daemon (trusted)5298worker2 # [ 74.158714] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:29Z level=info event=niks3_push_started pid=13115299worker2 # [ 74.540644] nix-daemon[845]: accepted connection from pid 1324, user nix-grpc-daemon (trusted)5300worker2 # [ 74.556152] nix-daemon[845]: reaped child process 1327, status = succeeded5301lb # [ 74.548956] niks3-server[1078]: 2026/09/20 09:00:29 INFO Received uploads request method=POST path=/api/pending_closures5302lb # [ 74.554755] niks3-server[1078]: 2026/09/20 09:00:29 INFO Received uploads request method=POST path=/api/pending_closures5303worker2 # [ 74.583760] nix-grpc-daemon[1311]: time=2026-09-20T09:00:29.653Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5304worker2 # [ 74.588053] nix-grpc-daemon[1311]: time=2026-09-20T09:00:29.655Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5305worker2 # [ 74.589708] nix-grpc-daemon[1311]: time=2026-09-20T09:00:29.655Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5306lb # [ 74.584983] niks3-server[1078]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5307lb # [ 74.594116] niks3-server[1078]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5308lb # [ 74.602143] niks3-server[1078]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5309lb # [ 74.604398] niks3-server[1078]: 2026/09/20 09:00:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5310lb # [ 74.606761] niks3-server[1078]: 2026/09/20 09:00:29 INFO Signed narinfos id=25 count=15311lb # [ 74.608625] niks3-server[1078]: 2026/09/20 09:00:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5312lb # [ 74.611308] niks3-server[1078]: 2026/09/20 09:00:29 INFO Signed narinfos id=26 count=25313worker2 # [ 74.637089] nix-grpc-daemon[1311]: time=2026-09-20T09:00:29.706Z level=INFO msg="Uploading 3 narinfos"5314lb # [ 74.615395] niks3-server[1078]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5315lb # [ 74.625053] niks3-server[1078]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5316lb # [ 74.627353] niks3-server[1078]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5317lb # [ 74.633040] niks3-server[1078]: 2026/09/20 09:00:29 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5318lb # [ 74.636043] niks3-server[1078]: 2026/09/20 09:00:29 INFO Completed upload id=255319lb # [ 74.637499] niks3-server[1078]: 2026/09/20 09:00:29 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5320lb # [ 74.640261] niks3-server[1078]: 2026/09/20 09:00:29 INFO Completed upload id=265321worker2 # [ 74.666481] nix-grpc-daemon[1311]: time=2026-09-20T09:00:29.736Z level=INFO msg="Upload complete. (304ms)"5322lb # [ 74.641842] niks3-server[1078]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5323worker2 # [ 74.669984] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35950 duration_s=0 paths=2 nar_bytes_in=3125324worker2 # [ 74.680480] nix-daemon[845]: reaped child process 1309, status = succeeded5325client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.73 seconds)5326worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5327worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5328worker1 # [ 74.764455] systemd[1]: Listening on Nix worker-protocol over gRPC.5329worker1 # [ 74.771849] systemd[1]: Starting Nix worker-protocol over gRPC...5330worker1 # [ 74.917528] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5331worker1 # [ 74.919953] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15332worker1 # [ 74.925906] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5333worker1 # [ 74.930154] systemd[1]: Started Nix worker-protocol over gRPC.5334lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5335lb: must succeed: curl -sf localhost:9901/clusters5336worker1 # [ 74.956766] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:30Z level=info event=scheduler_connected addr=lb:500515337worker2 # [ 74.985810] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:30Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05338lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5339lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5340(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.29 seconds)5341subtest: scheduler down: the other node takes the lock and keeps it5342lb: must succeed: curl -sf localhost:9901/clusters5343lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5344lb: must succeed: curl -sf localhost:9901/clusters5345lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5346lb: must succeed: curl -sf localhost:9901/clusters5347lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5348lb: must succeed: curl -sf localhost:9901/clusters5349lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5350worker2 # [ 75.294891] systemd[1]: Stopping Nix worker-protocol over gRPC...5351worker2 # [ 75.967324] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=signal_exit5352lb # [ 76.157613] niks3-server[1078]: 2026/09/20 09:00:30 INFO lead: released remote=192.168.1.4:571685353worker2 # [ 76.181389] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_yield5354worker1 # [ 76.159916] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:31Z level=info event=scheduler_restarting addr=lb:500515355worker2 # [ 76.185686] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416925356worker2 # [ 76.191757] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=worker_gone addr=192.168.1.3:500515357worker2 # [ 76.194832] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416925358worker2 # [ 76.198154] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=worker_gone addr=192.168.1.4:500515359worker2 # [ 76.201159] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_restarting addr=lb:500515360worker1 # [ 76.360144] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:31Z level=info event=scheduler_connected addr=lb:500515361worker2 # [ 76.394164] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_connected addr=lb:500515362worker1 # [ 76.367690] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5363worker2 # [ 76.403641] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5364worker1 # [ 76.568873] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:31Z level=info event=scheduler_connected addr=lb:500515365worker1 # [ 76.574256] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5366worker2 # [ 76.604860] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_connected addr=lb:500515367worker2 # [ 76.610654] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5368worker1 # [ 76.775089] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:31Z level=info event=scheduler_connected addr=lb:500515369worker1 # [ 76.779815] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5370worker2 # [ 76.811615] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_connected addr=lb:500515371worker2 # [ 76.816692] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5372worker1 # [ 76.980299] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:32Z level=info event=scheduler_connected addr=lb:500515373worker1 # [ 76.982859] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5374worker2 # [ 77.017764] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:32Z level=info event=scheduler_connected addr=lb:500515375worker2 # [ 77.019968] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5376lb # [ 77.091790] envoy[969]: conn peer=[2001:db8:1::4]:49082 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11466 tx=2590 ms=502545377lb # [ 77.095730] envoy[969]: conn peer=[2001:db8:1::1]:35594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=155378lb # [ 77.099373] envoy[969]: conn peer=[2001:db8:1::3]:46242 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10745 tx=2140 ms=533595379lb # [ 77.103057] envoy[969]: conn peer=[2001:db8:1::1]:46282 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=305 ms=15165380worker2 # [ 77.185567] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:32Z level=info event=scheduler_restarting5381worker2 # [ 77.207832] nix-daemon[845]: reaped child process 1304, status = succeeded5382worker1 # [ 77.185766] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:32Z level=info event=scheduler_connected addr=lb:500515383worker1 # [ 77.189696] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5384worker2 # [ 77.231937] nix-grpc-daemon[1255]: ts=2026-09-20T09:00:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5385worker1 # [ 77.387408] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:32Z level=info event=scheduler_connected addr=lb:500515386worker2 # [ 77.415923] nix-grpc-daemon[1255]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5387worker2 # [ 77.419668] nix-grpc-daemon[1255]: E0000 00:00:1789894832.486109 1298 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5388worker1 # [ 77.945336] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5389worker2 # [ 77.990743] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5390worker2 # [ 77.993860] systemd[1]: Stopped Nix worker-protocol over gRPC.5391worker2 # [ 77.997977] systemd[1]: nix-grpc-daemon.service: Consumed 406ms CPU time over 8.231s wall clock time, 32.8M memory peak, 17.6K incoming IP traffic, 22.7K outgoing IP traffic.5392worker2 # [ 78.010193] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5393worker2 # [ 78.013805] systemd[1]: Closed Nix worker-protocol over gRPC.5394worker2 # [ 78.016520] systemd[1]: nix-grpc-daemon.socket: Consumed 288us CPU time over 8.642s wall clock time, 256K memory peak, 27.7K incoming IP traffic, 23.2K outgoing IP traffic.5395worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5396worker1 # [ 78.146398] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515397worker1 # [ 78.151587] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5398worker1 # [ 78.353602] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515399worker1 # [ 78.357438] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5400worker1 # [ 78.558271] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515401worker1 # [ 78.562859] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5402worker1 # [ 78.763615] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515403worker1 # [ 78.767624] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5404worker1 # [ 78.968324] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515405worker1 # [ 78.971139] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5406worker1 # [ 79.172121] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515407worker1 # [ 79.176085] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5408worker1 # [ 79.377478] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515409worker1 # [ 79.382182] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5410worker1 # [ 79.583555] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515411worker1 # [ 79.587562] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5412worker1 # [ 79.788430] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515413worker1 # [ 79.793691] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5414lb # [ 79.938939] niks3-server[1078]: 2026/09/20 09:00:34 INFO lead: acquired remote=192.168.1.3:386085415worker1 # [ 79.938248] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:35Z level=info event=scheduler_take_over5416worker1 # [ 79.994525] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500515417worker1 # [ 79.998622] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05418worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.19 seconds)5419worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5420worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5421client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25422worker1 # [ 80.456392] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492845423worker1 # [ 80.463074] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5424client # don't know how to build these paths:5425client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5426worker1 # [ 80.472986] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492845427worker1 # [ 80.480086] nix-grpc-daemon[1038]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)5428worker1 # [ 80.568330] nix-grpc-daemon[1038]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 101 ms (attempt 2/5)5429worker1 # [ 80.672877] nix-grpc-daemon[1038]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 3/5)5430worker1 # [ 80.821256] nix-grpc-daemon[1038]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 324 ms (attempt 4/5)5431worker1 # [ 81.145652] nix-grpc-daemon[1038]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5432worker1 # [ 81.168330] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:36Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05433worker1 # [ 81.170306] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:36Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15434worker1 # [ 81.214512] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845435worker1 # [ 81.224804] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492845436client # copying 1 paths to 'lb:50051'...5437client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5438worker1 # [ 81.237252] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492845439worker1 # [ 81.245750] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5440worker1 # [ 81.267383] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:36Z level=info event=niks3_push_started pid=11195441worker1 # [ 81.576804] nix-daemon[843]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5442worker1 # [ 81.589579] nix-daemon[843]: reaped child process 1135, status = succeeded5443worker1 # [ 81.716081] nix-daemon[843]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)5444worker1 # [ 81.727956] nix-daemon[843]: reaped child process 1140, status = succeeded5445lb # [ 81.743479] niks3-server[1078]: 2026/09/20 09:00:36 INFO Received uploads request method=POST path=/api/pending_closures5446worker1 # [ 81.752304] nix-grpc-daemon[1119]: time=2026-09-20T09:00:36.930Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5447worker1 # [ 81.755572] nix-grpc-daemon[1119]: time=2026-09-20T09:00:36.931Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5448lb # [ 81.777724] niks3-server[1078]: 2026/09/20 09:00:36 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5449lb # [ 81.790558] niks3-server[1078]: 2026/09/20 09:00:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5450lb # [ 81.798749] niks3-server[1078]: 2026/09/20 09:00:36 INFO Signed narinfos id=27 count=15451worker1 # [ 81.801150] nix-grpc-daemon[1119]: time=2026-09-20T09:00:36.978Z level=INFO msg="Uploading 1 narinfos"5452lb # [ 81.817595] niks3-server[1078]: 2026/09/20 09:00:36 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5453lb # [ 81.824638] niks3-server[1078]: 2026/09/20 09:00:36 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5454lb # [ 81.832655] niks3-server[1078]: 2026/09/20 09:00:36 INFO Completed upload id=275455worker1 # [ 81.832182] nix-grpc-daemon[1119]: time=2026-09-20T09:00:37.010Z level=INFO msg="Upload complete. (392ms)"5456lb # [ 81.837293] niks3-server[1078]: 2026/09/20 09:00:36 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5457worker1 # [ 81.837304] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=0 paths=1 nar_bytes_in=5205458worker1 # [ 81.841757] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845459worker1 # [ 81.850870] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5460worker1 # [ 81.855925] nix-daemon[843]: reaped child process 1117, status = succeeded5461worker1 # [ 81.860812] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5462client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5463client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5464client # farm-a> LOG-farm-a-on-standby5465worker1 # [ 83.073521] nix-daemon[843]: reaped child process 1144, status = succeeded5466worker1 # [ 83.188206] nix-daemon[843]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5467worker1 # [ 83.200191] nix-daemon[843]: reaped child process 1162, status = succeeded5468lb # [ 83.216383] niks3-server[1078]: 2026/09/20 09:00:37 INFO Received uploads request method=POST path=/api/pending_closures5469worker1 # [ 83.229292] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.405Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5470worker1 # [ 83.230634] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.405Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5471lb # [ 83.262771] niks3-server[1078]: 2026/09/20 09:00:37 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5472lb # [ 83.268282] niks3-server[1078]: 2026/09/20 09:00:37 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5473lb # [ 83.279740] niks3-server[1078]: 2026/09/20 09:00:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5474worker1 # [ 83.284558] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.462Z level=INFO msg="Uploading 1 narinfos"5475lb # [ 83.284983] niks3-server[1078]: 2026/09/20 09:00:37 INFO Signed narinfos id=28 count=15476lb # [ 83.287631] niks3-server[1078]: 2026/09/20 09:00:37 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5477lb # [ 83.297567] niks3-server[1078]: 2026/09/20 09:00:37 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5478lb # [ 83.301198] niks3-server[1078]: 2026/09/20 09:00:37 INFO Completed upload id=285479worker1 # [ 83.300306] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.478Z level=INFO msg="Upload complete. (233ms)"5480lb # [ 83.302937] niks3-server[1078]: 2026/09/20 09:00:37 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5481worker1 # [ 83.302840] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15482worker1 # [ 83.314581] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05483worker1 # [ 83.316467] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15484worker1 # [ 83.318491] nix-daemon[843]: reaped child process 1142, status = succeeded5485worker1 # [ 83.358428] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845486worker1 # [ 83.367879] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492845487worker1 # [ 83.377531] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.555Z level=INFO msg="All 1 paths already cached"5488client # copying 1 paths to 'lb:50051'...5489client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5490worker1 # [ 83.381896] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492845491worker1 # [ 83.385765] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5492worker1 # [ 83.533069] nix-daemon[843]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5493worker1 # [ 83.545383] nix-daemon[843]: reaped child process 1171, status = succeeded5494worker1 # [ 83.696490] nix-daemon[843]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5495worker1 # [ 83.708451] nix-daemon[843]: reaped child process 1176, status = succeeded5496lb # [ 83.723144] niks3-server[1078]: 2026/09/20 09:00:38 INFO Received uploads request method=POST path=/api/pending_closures5497worker1 # [ 83.732546] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.910Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5498worker1 # [ 83.733938] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.910Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5499lb # [ 83.746137] niks3-server[1078]: 2026/09/20 09:00:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5500lb # [ 83.751471] niks3-server[1078]: 2026/09/20 09:00:38 INFO Signed narinfos id=29 count=15501worker1 # [ 83.754121] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.931Z level=INFO msg="Uploading 1 narinfos"5502lb # [ 83.758429] niks3-server[1078]: 2026/09/20 09:00:38 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5503lb # [ 83.766881] niks3-server[1078]: 2026/09/20 09:00:38 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5504lb # [ 83.776391] niks3-server[1078]: 2026/09/20 09:00:38 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5505lb # [ 83.782601] niks3-server[1078]: 2026/09/20 09:00:38 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5506lb # [ 83.786272] niks3-server[1078]: 2026/09/20 09:00:38 INFO Completed upload id=295507worker1 # [ 83.785399] nix-grpc-daemon[1119]: time=2026-09-20T09:00:38.963Z level=INFO msg="Upload complete. (393ms)"5508worker1 # [ 83.787390] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=0 paths=1 nar_bytes_in=6405509worker1 # [ 83.790057] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845510worker1 # [ 83.795556] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5511worker1 # [ 83.799738] nix-daemon[843]: reaped child process 1166, status = succeeded5512client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5513client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5514worker1 # [ 83.804626] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5515client # farm-b> LOG-farm-b-on-standby5516worker1 # [ 84.629445] nix-daemon[843]: reaped child process 1180, status = succeeded5517worker1 # [ 84.790221] nix-daemon[843]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5518worker1 # [ 84.802797] nix-daemon[843]: reaped child process 1198, status = succeeded5519lb # [ 84.817549] niks3-server[1078]: 2026/09/20 09:00:39 INFO Received uploads request method=POST path=/api/pending_closures5520worker1 # [ 84.825085] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.002Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5521worker1 # [ 84.826607] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.004Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5522lb # [ 84.849649] niks3-server[1078]: 2026/09/20 09:00:39 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5523lb # [ 84.866171] niks3-server[1078]: 2026/09/20 09:00:39 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5524lb # [ 84.874764] niks3-server[1078]: 2026/09/20 09:00:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5525worker1 # [ 84.878485] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.056Z level=INFO msg="Uploading 1 narinfos"5526lb # [ 84.880248] niks3-server[1078]: 2026/09/20 09:00:39 INFO Signed narinfos id=30 count=15527lb # [ 84.884950] niks3-server[1078]: 2026/09/20 09:00:39 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5528lb # [ 84.893056] niks3-server[1078]: 2026/09/20 09:00:39 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5529lb # [ 84.900048] niks3-server[1078]: 2026/09/20 09:00:39 INFO Completed upload id=305530lb # [ 84.901278] niks3-server[1078]: 2026/09/20 09:00:39 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5531worker1 # [ 84.899363] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.077Z level=INFO msg="Upload complete. (286ms)"5532worker1 # [ 84.905515] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15533worker1 # [ 84.917748] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05534worker1 # [ 84.921524] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15535worker1 # [ 84.929911] nix-daemon[843]: reaped child process 1178, status = succeeded5536worker1 # [ 84.962617] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845537worker1 # [ 84.975060] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492845538worker1 # [ 84.987929] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.165Z level=INFO msg="All 2 paths already cached"5539client # copying 1 paths to 'lb:50051'...5540client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5541worker1 # [ 84.996373] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492845542worker1 # [ 85.006163] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5543worker1 # [ 85.136190] nix-daemon[843]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5544worker1 # [ 85.148905] nix-daemon[843]: reaped child process 1207, status = succeeded5545worker1 # [ 85.269714] nix-daemon[843]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5546worker1 # [ 85.281944] nix-daemon[843]: reaped child process 1212, status = succeeded5547lb # [ 85.292297] niks3-server[1078]: 2026/09/20 09:00:39 INFO Received uploads request method=POST path=/api/pending_closures5548worker1 # [ 85.301566] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.479Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5549worker1 # [ 85.303420] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.481Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5550lb # [ 85.324582] niks3-server[1078]: 2026/09/20 09:00:39 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5551lb # [ 85.333320] niks3-server[1078]: 2026/09/20 09:00:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5552worker1 # [ 85.339439] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.517Z level=INFO msg="Uploading 1 narinfos"5553lb # [ 85.340418] niks3-server[1078]: 2026/09/20 09:00:40 INFO Signed narinfos id=31 count=15554lb # [ 85.344738] niks3-server[1078]: 2026/09/20 09:00:40 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5555lb # [ 85.356763] niks3-server[1078]: 2026/09/20 09:00:40 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5556worker1 # [ 85.362426] nix-grpc-daemon[1119]: time=2026-09-20T09:00:40.540Z level=INFO msg="Upload complete. (345ms)"5557lb # [ 85.363638] niks3-server[1078]: 2026/09/20 09:00:40 INFO Completed upload id=315558worker1 # [ 85.364873] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=0 paths=1 nar_bytes_in=7685559lb # [ 85.366822] niks3-server[1078]: 2026/09/20 09:00:40 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5560worker1 # [ 85.369934] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845561worker1 # [ 85.379833] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5562worker1 # [ 85.384625] nix-daemon[843]: reaped child process 1202, status = succeeded5563worker1 # [ 85.389409] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5564client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5565client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5566client # farm-top> LOG-farm-top-on-standby5567worker1 # [ 86.814862] nix-daemon[843]: reaped child process 1216, status = succeeded5568worker1 # [ 86.957319] nix-daemon[843]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5569worker1 # [ 86.971871] nix-daemon[843]: reaped child process 1234, status = succeeded5570lb # [ 86.983229] niks3-server[1078]: 2026/09/20 09:00:41 INFO Received uploads request method=POST path=/api/pending_closures5571worker1 # [ 86.992294] nix-grpc-daemon[1119]: time=2026-09-20T09:00:42.168Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5572worker1 # [ 86.993608] nix-grpc-daemon[1119]: time=2026-09-20T09:00:42.168Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5573lb # [ 87.018881] niks3-server[1078]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5574lb # [ 87.025552] niks3-server[1078]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5575lb # [ 87.037118] niks3-server[1078]: 2026/09/20 09:00:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5576worker1 # [ 87.042628] nix-grpc-daemon[1119]: time=2026-09-20T09:00:42.220Z level=INFO msg="Uploading 1 narinfos"5577lb # [ 87.043207] niks3-server[1078]: 2026/09/20 09:00:41 INFO Signed narinfos id=32 count=15578lb # [ 87.049522] niks3-server[1078]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5579lb # [ 87.058060] niks3-server[1078]: 2026/09/20 09:00:41 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5580lb # [ 87.061831] niks3-server[1078]: 2026/09/20 09:00:41 INFO Completed upload id=325581worker1 # [ 87.061258] nix-grpc-daemon[1119]: time=2026-09-20T09:00:42.239Z level=INFO msg="Upload complete. (264ms)"5582lb # [ 87.064495] niks3-server[1078]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5583worker1 # [ 87.068461] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15584worker1 # [ 87.079449] nix-daemon[843]: reaped child process 1214, status = succeeded5585lb # [ 87.091878] envoy[969]: conn peer=[2001:db8:1::4]:59310 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1711 tx=441 ms=72295586lb # [ 87.093613] envoy[969]: conn peer=[2001:db8:1::1]:46290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9577 tx=3859 ms=66255587client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.87 seconds)5588client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5589client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.19 seconds)5590worker2 # [ 87.360992] systemd[1]: Listening on Nix worker-protocol over gRPC.5591worker2 # [ 87.365633] systemd[1]: Starting Nix worker-protocol over gRPC...5592worker2 # [ 87.546333] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5593worker2 # [ 87.549984] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15594worker2 # [ 87.557389] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5595worker2 # [ 87.558986] systemd[1]: Started Nix worker-protocol over gRPC.5596lb: must succeed: curl -sf localhost:9901/clusters5597worker2 # [ 87.595632] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:42Z level=info event=scheduler_connected addr=lb:500515598worker1 # [ 87.572697] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05599lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5600worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5601worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5602lb: must succeed: curl -sf localhost:9901/clusters5603lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5604lb: must succeed: curl -sf localhost:9901/clusters5605lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5606worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5607worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5608(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.85 seconds)5609subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5610client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5611client # [ 87.926114] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5612client # Running as unit: rs.service; invocation ID: 3158cfd3ae2c4e349d4db5052ebb442b5613client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5614worker1 # [ 88.130343] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492845615client # [ 88.158463] nix[1172]: don't know how to build these paths:5616client # [ 88.159338] nix[1172]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5617worker1 # [ 88.149064] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05618worker1 # [ 88.154711] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15619worker1 # [ 88.161194] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845620worker1 # [ 88.171405] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492845621client # [ 88.207063] nix[1172]: copying 1 paths to 'lb:50051'...5622client # [ 88.208720] nix[1172]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5623worker1 # [ 88.186371] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492845624worker1 # [ 88.198067] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5625worker1 # [ 88.365632] nix-daemon[843]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5626worker1 # [ 88.378295] nix-daemon[843]: reaped child process 1252, status = succeeded5627worker1 # [ 88.531954] nix-daemon[843]: accepted connection from pid 1254, user nix-grpc-daemon (trusted)5628worker1 # [ 88.544334] nix-daemon[843]: reaped child process 1257, status = succeeded5629lb # [ 88.560278] niks3-server[1078]: 2026/09/20 09:00:43 INFO Received uploads request method=POST path=/api/pending_closures5630worker1 # [ 88.567412] nix-grpc-daemon[1119]: time=2026-09-20T09:00:43.745Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5631worker1 # [ 88.569343] nix-grpc-daemon[1119]: time=2026-09-20T09:00:43.746Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5632lb # [ 88.589414] niks3-server[1078]: 2026/09/20 09:00:43 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5633lb # [ 88.602371] niks3-server[1078]: 2026/09/20 09:00:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5634worker1 # [ 88.607187] nix-grpc-daemon[1119]: time=2026-09-20T09:00:43.785Z level=INFO msg="Uploading 1 narinfos"5635lb # [ 88.607879] niks3-server[1078]: 2026/09/20 09:00:43 INFO Signed narinfos id=33 count=15636lb # [ 88.613990] niks3-server[1078]: 2026/09/20 09:00:43 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5637lb # [ 88.625972] niks3-server[1078]: 2026/09/20 09:00:43 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5638lb # [ 88.631937] niks3-server[1078]: 2026/09/20 09:00:43 INFO Completed upload id=335639worker1 # [ 88.630907] nix-grpc-daemon[1119]: time=2026-09-20T09:00:43.808Z level=INFO msg="Upload complete. (421ms)"5640lb # [ 88.635095] niks3-server[1078]: 2026/09/20 09:00:43 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5641worker1 # [ 88.635162] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=0 paths=1 nar_bytes_in=4165642worker1 # [ 88.639835] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492845643worker1 # [ 88.650103] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5644worker1 # [ 88.653930] nix-daemon[843]: reaped child process 1247, status = succeeded5645worker1 # [ 88.658769] nix-daemon[843]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)5646client # [ 88.680035] nix[1172]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5647lb: must succeed: curl -sf localhost:9901/clusters5648lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5649lb: must succeed: curl -sf localhost:9901/clusters5650lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5651lb: must succeed: curl -sf localhost:9901/clusters5652lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5653lb: must succeed: curl -sf localhost:9901/clusters5654lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5655worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5656worker2 # [ 90.844645] systemd-journald[287]: Received client request to rotate journal, rotating.5657worker2 # [ 90.863052] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/cd67081ded68438f96ce6d6326896744.5658worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5659worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5660worker1 # [ 90.753811] systemd[1]: Stopping Nix worker-protocol over gRPC...5661worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5662??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5663 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735664client: must succeed: sleep 5.05665worker1 # [ 90.932179] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:46Z level=info event=draining5666client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5667worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5668worker1 # [ 96.086555] nix-daemon[843]: reaped child process 1261, status = succeeded5669worker1 # [ 96.249832] nix-daemon[843]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5670worker1 # [ 96.262118] nix-daemon[843]: reaped child process 1304, status = succeeded5671lb # [ 96.280136] niks3-server[1078]: 2026/09/20 09:00:50 INFO Received uploads request method=POST path=/api/pending_closures5672worker1 # [ 96.285363] nix-grpc-daemon[1119]: time=2026-09-20T09:00:51.463Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5673worker1 # [ 96.287713] nix-grpc-daemon[1119]: time=2026-09-20T09:00:51.464Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5674lb # [ 96.307407] niks3-server[1078]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5675lb # [ 96.310537] niks3-server[1078]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5676lb # [ 96.315302] niks3-server[1078]: 2026/09/20 09:00:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5677lb # [ 96.317289] niks3-server[1078]: 2026/09/20 09:00:50 INFO Signed narinfos id=34 count=15678worker1 # [ 96.316489] nix-grpc-daemon[1119]: time=2026-09-20T09:00:51.494Z level=INFO msg="Uploading 1 narinfos"5679lb # [ 96.320134] niks3-server[1078]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5680lb # [ 96.325487] niks3-server[1078]: 2026/09/20 09:00:50 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5681lb # [ 96.328330] niks3-server[1078]: 2026/09/20 09:00:51 INFO Completed upload id=345682worker1 # [ 96.328813] nix-grpc-daemon[1119]: time=2026-09-20T09:00:51.506Z level=INFO msg="Upload complete. (256ms)"5683lb # [ 96.330215] niks3-server[1078]: 2026/09/20 09:00:51 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5684worker1 # [ 96.333112] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49284 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15685worker1 # [ 96.338849] nix-daemon[843]: reaped child process 1259, status = succeeded5686client # [ 96.392337] systemd[1]: rs.service: Deactivated successfully.5687client # [ 96.395204] systemd[1]: rs.service: Consumed 117ms CPU time over 8.465s wall clock time, 37.1M memory peak, 8.3K incoming IP traffic, 8.8K outgoing IP traffic.5688worker1 # [ 96.933619] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=signal_exit5689lb # [ 97.094544] envoy[969]: conn peer=[2001:db8:1::1]:44210 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1331 ms=82195690worker1 # [ 97.164178] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=scheduler_yield5691worker2 # [ 97.193337] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:52Z level=info event=scheduler_restarting addr=lb:500515692lb # [ 97.167489] niks3-server[1078]: 2026/09/20 09:00:51 INFO lead: released remote=192.168.1.3:386085693worker1 # [ 97.171494] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=scheduler_restarting addr=lb:500515694worker1 # [ 97.176364] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492745695worker1 # [ 97.179688] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=worker_gone addr=192.168.1.4:500515696worker1 # [ 97.182634] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492745697worker1 # [ 97.185870] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=worker_gone addr=192.168.1.3:500515698worker2 # [ 97.393883] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:52Z level=info event=scheduler_connected addr=lb:500515699worker1 # [ 97.376269] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=scheduler_connected addr=lb:500515700worker2 # [ 97.401949] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5701worker1 # [ 97.383423] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5702lb # [ 97.545073] niks3-server[1078]: 2026/09/20 09:00:52 INFO lead: acquired remote=192.168.1.4:432365703worker2 # [ 97.570711] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:52Z level=info event=scheduler_take_over5704worker2 # [ 97.602928] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:52Z level=info event=scheduler_connected addr=lb:500515705worker2 # [ 97.607513] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05706worker1 # [ 97.584176] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=scheduler_connected addr=lb:500515707worker1 # [ 97.589588] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5708worker1 # [ 97.790812] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:52Z level=info event=scheduler_connected addr=lb:500515709worker2 # [ 97.818841] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05710worker1 # [ 98.169161] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:53Z level=info event=scheduler_restarting5711worker2 # [ 98.203247] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:402925712worker2 # [ 98.206834] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:53Z level=info event=worker_gone addr=192.168.1.3:500515713worker1 # [ 98.188717] nix-grpc-daemon[1038]: ts=2026-09-20T09:00:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5714worker1 # [ 98.205432] nix-daemon[843]: reaped child process 1110, status = succeeded5715worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.15 seconds)5716client: waiting for success: ! systemctl is-active rs5717client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds)5718client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5719client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5720client: must fail: journalctl -u rs | grep -q 'reconnecting'5721client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5722lb: must succeed: curl -sf localhost:9901/clusters5723lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5724worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5725worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5726worker1 # [ 98.983127] nix-grpc-daemon[1038]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5727worker1 # [ 98.986528] nix-grpc-daemon[1038]: E0000 00:00:1789894854.160233 1081 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5728worker1 # [ 98.991202] nix-grpc-daemon[1038]: E0000 00:00:1789894854.160392 1081 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5729lb: must succeed: curl -sf localhost:9901/clusters5730lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5731worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5732worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5733worker1 # [ 99.721932] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5734worker1 # [ 99.725134] systemd[1]: Stopped Nix worker-protocol over gRPC.5735worker1 # [ 99.727338] systemd[1]: nix-grpc-daemon.service: Consumed 1.259s CPU time over 24.950s wall clock time, 35.8M memory peak, 46K incoming IP traffic, 86.4K outgoing IP traffic.5736worker1 # [ 99.743326] systemd[1]: Starting Nix worker-protocol over gRPC...5737worker1 # [ 99.887811] nix-grpc-daemon[1311]: ts=2026-09-20T09:00:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5738worker1 # [ 99.890243] nix-grpc-daemon[1311]: ts=2026-09-20T09:00:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15739worker1 # [ 99.897063] nix-grpc-daemon[1311]: ts=2026-09-20T09:00:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5740worker1 # [ 99.900145] systemd[1]: Started Nix worker-protocol over gRPC.5741worker1 # [ 99.923798] nix-grpc-daemon[1311]: ts=2026-09-20T09:00:55Z level=info event=scheduler_connected addr=lb:500515742worker2 # [ 99.952866] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05743lb: must succeed: curl -sf localhost:9901/clusters5744lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5745worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5746worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5747(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.88 seconds)5748subtest: scheduler restart mid-build: build finishes, no double build5749client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5750client # [ 100.810625] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5751client # Running as unit: mid.service; invocation ID: f9423dcf3652451db5868127df43ad6e5752client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5753worker1 # [ 101.000740] nix-grpc-daemon[1311]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:387985754worker1 # [ 101.005994] nix-daemon[843]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5755client # [ 101.034364] nix[1207]: don't know how to build these paths:5756client # [ 101.035340] nix[1207]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5757worker2 # [ 101.050663] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:56Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05758worker2 # [ 101.055179] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:56Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15759worker2 # [ 101.099944] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403005760worker2 # [ 101.112622] nix-daemon[845]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5761worker2 # [ 101.129774] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)5762worker2 # [ 101.214184] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 2/5)5763worker2 # [ 101.300439] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 394 ms (attempt 3/5)5764worker2 # [ 101.700625] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 669 ms (attempt 4/5)5765worker2 # [ 102.376155] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5766worker2 # [ 102.386396] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403005767client # [ 102.387353] nix[1207]: copying 1 paths to 'lb:50051'...5768worker2 # [ 102.391613] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403005769client # [ 102.388856] nix[1207]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5770worker2 # [ 102.398440] nix-daemon[845]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5771worker2 # [ 102.411161] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:57Z level=info event=niks3_push_started pid=14815772worker2 # [ 102.767817] nix-daemon[845]: accepted connection from pid 1494, user nix-grpc-daemon (trusted)5773worker2 # [ 102.785228] nix-daemon[845]: reaped child process 1497, status = succeeded5774worker2 # [ 102.961497] nix-daemon[845]: accepted connection from pid 1499, user nix-grpc-daemon (trusted)5775worker2 # [ 102.973685] nix-daemon[845]: reaped child process 1502, status = succeeded5776lb # [ 102.966247] niks3-server[1078]: 2026/09/20 09:00:57 INFO Received uploads request method=POST path=/api/pending_closures5777worker2 # [ 103.000326] nix-grpc-daemon[1481]: time=2026-09-20T09:00:58.069Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5778worker2 # [ 103.001693] nix-grpc-daemon[1481]: time=2026-09-20T09:00:58.069Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5779lb # [ 103.003437] niks3-server[1078]: 2026/09/20 09:00:57 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5780lb # [ 103.010785] niks3-server[1078]: 2026/09/20 09:00:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5781lb # [ 103.015493] niks3-server[1078]: 2026/09/20 09:00:57 INFO Signed narinfos id=35 count=15782worker2 # [ 103.044057] nix-grpc-daemon[1481]: time=2026-09-20T09:00:58.114Z level=INFO msg="Uploading 1 narinfos"5783lb # [ 103.029987] niks3-server[1078]: 2026/09/20 09:00:57 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5784lb # [ 103.037770] niks3-server[1078]: 2026/09/20 09:00:57 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5785lb # [ 103.044517] niks3-server[1078]: 2026/09/20 09:00:57 INFO Completed upload id=355786worker2 # [ 103.069564] nix-grpc-daemon[1481]: time=2026-09-20T09:00:58.139Z level=INFO msg="Upload complete. (470ms)"5787lb # [ 103.047892] niks3-server[1078]: 2026/09/20 09:00:57 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5788worker2 # [ 103.073338] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40300 duration_s=0 paths=1 nar_bytes_in=4245789worker2 # [ 103.079303] nix-grpc-daemon[1348]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403005790worker2 # [ 103.089099] nix-daemon[845]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5791worker2 # [ 103.093380] nix-daemon[845]: reaped child process 1479, status = succeeded5792worker2 # [ 103.098403] nix-daemon[845]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5793client # [ 103.093949] nix[1207]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5794lb: must succeed: curl -sf localhost:9901/clusters5795lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5796lb: must succeed: curl -sf localhost:9901/clusters5797lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5798worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5799worker2 # [ 105.679341] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1348 (nix-grpc-daemon) on client request.5800worker2 # [ 105.680948] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5801client # [ 105.682531] nix[1207]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5802worker1 # [ 105.659946] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5803lb # [ 105.662410] niks3-server[1078]: 2026/09/20 09:01:00 INFO lead: released remote=192.168.1.4:432365804client # [ 105.684215] nix[1207]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5805worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5806client: must succeed: sleep 5.05807worker2 # [ 105.709843] nix-daemon[845]: reaped child process 1504, status = succeeded5808worker2 # [ 105.710876] nix-daemon[845]: reaped child process 1470, status = succeeded5809worker2 # [ 105.715215] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5810worker2 # [ 105.716723] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5811worker2 # [ 105.718397] systemd[1]: nix-grpc-daemon.service: Consumed 451ms CPU time over 18.347s wall clock time, 32.8M memory peak, 13.8K incoming IP traffic, 21K outgoing IP traffic.5812worker2 # [ 105.728248] nix-daemon[1506]: unexpected Nix daemon error: error: interrupted by the user5813worker2 # [ 105.731312] nix-daemon[845]: reaped child process 1506, status = failed with exit code 15814worker2 # [ 105.877332] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5815worker2 # [ 105.881449] systemd[1]: Starting Nix worker-protocol over gRPC...5816worker1 # [ 105.860548] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:01Z level=info event=scheduler_connected addr=lb:500515817worker2 # [ 106.042807] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5818worker2 # [ 106.046113] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15819worker2 # [ 106.052059] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5820worker2 # [ 106.056062] systemd[1]: Started Nix worker-protocol over gRPC.5821worker2 # [ 106.063953] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=info event=scheduler_take_over5822lb # [ 106.039120] niks3-server[1078]: 2026/09/20 09:01:00 INFO lead: acquired remote=192.168.1.4:597085823worker2 # [ 106.067853] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05824worker2 # [ 106.087839] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=info event=scheduler_connected addr=lb:500515825worker2 # [ 106.089396] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05826worker2 # [ 106.193589] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05827worker2 # [ 106.195380] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:01Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15828worker1 # [ 106.213131] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387985829worker1 # [ 106.225257] nix-grpc-daemon[1311]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5)5830worker1 # [ 106.262954] nix-grpc-daemon[1311]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 2/5)5831worker1 # [ 106.310073] nix-grpc-daemon[1311]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 358 ms (attempt 3/5)5832worker1 # [ 106.674248] nix-grpc-daemon[1311]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 4/5)5833worker1 # [ 107.016980] nix-grpc-daemon[1311]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5834worker1 # [ 107.032619] nix-grpc-daemon[1311]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5835worker1 # [ 107.055901] nix-daemon[843]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5836worker1 # [ 107.068520] nix-daemon[843]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5837client # [ 107.090548] nix[1207]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5838lb # [ 107.094587] envoy[969]: conn peer=[2001:db8:1::3]:43856 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5185 tx=1291 ms=232265839lb # [ 107.098687] envoy[969]: conn peer=[2001:db8:1::4]:60846 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=978 tx=389 ms=180975840client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5841client: waiting for success: ! systemctl is-active mid5842worker1 # [ 111.092968] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:06Z level=info event=niks3_push_started pid=14165843worker1 # [ 111.127607] nix-daemon[843]: reaped child process 1392, status = succeeded5844worker1 # [ 111.413459] nix-daemon[843]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5845worker1 # [ 111.426343] nix-daemon[843]: reaped child process 1432, status = succeeded5846lb # [ 111.439406] niks3-server[1078]: 2026/09/20 09:01:06 INFO Received uploads request method=POST path=/api/pending_closures5847worker1 # [ 111.447303] nix-grpc-daemon[1416]: time=2026-09-20T09:01:06.625Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5848worker1 # [ 111.450069] nix-grpc-daemon[1416]: time=2026-09-20T09:01:06.626Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5849lb # [ 111.485602] niks3-server[1078]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5850lb # [ 111.494356] niks3-server[1078]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5851lb # [ 111.504733] niks3-server[1078]: 2026/09/20 09:01:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5852lb # [ 111.508611] niks3-server[1078]: 2026/09/20 09:01:06 INFO Signed narinfos id=36 count=15853worker1 # [ 111.511912] nix-grpc-daemon[1416]: time=2026-09-20T09:01:06.689Z level=INFO msg="Uploading 1 narinfos"5854lb # [ 111.516104] niks3-server[1078]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5855lb # [ 111.524056] niks3-server[1078]: 2026/09/20 09:01:06 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5856lb # [ 111.528459] niks3-server[1078]: 2026/09/20 09:01:06 INFO Completed upload id=365857worker1 # [ 111.527820] nix-grpc-daemon[1416]: time=2026-09-20T09:01:06.705Z level=INFO msg="Upload complete. (247ms)"5858worker1 # [ 111.532332] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38798 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15859worker1 # [ 111.537659] nix-grpc-daemon[1416]: time=2026-09-20T09:01:06.715Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo error="server returned 404: object is not pending upload\n"5860worker1 # [ 111.548762] nix-daemon[843]: reaped child process 1390, status = succeeded5861client # [ 111.589275] systemd[1]: mid.service: Deactivated successfully.5862client # [ 111.591260] systemd[1]: mid.service: Consumed 127ms CPU time over 10.781s wall clock time, 39.3M memory peak, 9.8K incoming IP traffic, 10.6K outgoing IP traffic.5863client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds)5864client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5865client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5866(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.33 seconds)5867subtest: interrupting the client stops the build on the worker5868client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5869client # [ 112.115808] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5870client # Running as unit: intr.service; invocation ID: 55cb8cd72a30420b96d5f957df10cce35871client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5872worker1 # [ 112.299883] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:387985873client # [ 112.323741] nix[1242]: don't know how to build these paths:5874client # [ 112.324671] nix[1242]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5875worker2 # [ 112.341329] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:07Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05876worker2 # [ 112.345378] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:07Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15877worker2 # [ 112.386624] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363945878worker2 # [ 112.397323] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5879worker2 # [ 112.414420] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5)5880worker2 # [ 112.485350] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5)5881worker2 # [ 112.688347] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 3/5)5882worker2 # [ 112.767188] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 309 ms (attempt 4/5)5883worker2 # [ 113.082223] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5884worker2 # [ 113.101788] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363945885client # [ 113.108271] nix[1242]: copying 1 paths to 'lb:50051'...5886client # [ 113.112179] nix[1242]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5887worker2 # [ 113.116457] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363945888worker2 # [ 113.124725] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5889worker2 # [ 113.146392] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:08Z level=info event=niks3_push_started pid=16185890worker2 # [ 113.483631] nix-daemon[845]: accepted connection from pid 1635, user nix-grpc-daemon (trusted)5891worker2 # [ 113.495561] nix-daemon[845]: reaped child process 1638, status = succeeded5892worker2 # [ 113.643524] nix-daemon[845]: accepted connection from pid 1640, user nix-grpc-daemon (trusted)5893worker2 # [ 113.656289] nix-daemon[845]: reaped child process 1643, status = succeeded5894lb # [ 113.642655] niks3-server[1078]: 2026/09/20 09:01:08 INFO Received uploads request method=POST path=/api/pending_closures5895worker2 # [ 113.673889] nix-grpc-daemon[1618]: time=2026-09-20T09:01:08.744Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5896worker2 # [ 113.675618] nix-grpc-daemon[1618]: time=2026-09-20T09:01:08.745Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5897lb # [ 113.681403] niks3-server[1078]: 2026/09/20 09:01:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5898lb # [ 113.697581] niks3-server[1078]: 2026/09/20 09:01:08 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5899lb # [ 113.702684] niks3-server[1078]: 2026/09/20 09:01:08 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5900lb # [ 113.709708] niks3-server[1078]: 2026/09/20 09:01:08 INFO Signed narinfos id=37 count=15901worker2 # [ 113.735090] nix-grpc-daemon[1618]: time=2026-09-20T09:01:08.805Z level=INFO msg="Uploading 1 narinfos"5902lb # [ 113.717681] niks3-server[1078]: 2026/09/20 09:01:08 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5903lb # [ 113.722060] niks3-server[1078]: 2026/09/20 09:01:08 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5904lb # [ 113.727533] niks3-server[1078]: 2026/09/20 09:01:08 INFO Completed upload id=375905worker2 # [ 113.752561] nix-grpc-daemon[1618]: time=2026-09-20T09:01:08.822Z level=INFO msg="Upload complete. (412ms)"5906worker2 # [ 113.755109] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=0 paths=1 nar_bytes_in=4245907worker2 # [ 113.758954] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363945908worker2 # [ 113.764330] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5909worker2 # [ 113.770195] nix-daemon[845]: reaped child process 1616, status = succeeded5910worker2 # [ 113.775685] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5911client # [ 113.771721] nix[1242]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5912client: must succeed: systemctl kill -s INT intr5913client # [ 114.486455] systemd[1]: intr.service: Sent signal SIGINT to main process 1242 (nix) on client request.5914client # [ 114.489052] nix[1242]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5915client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds)5916client # [ 114.492972] nix[1242]: error: interrupted by the user5917client # [ 114.517929] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5918client # [ 114.519366] systemd[1]: intr.service: Failed with result 'exit-code'.5919client # [ 114.521410] systemd[1]: intr.service: Consumed 105ms CPU time over 2.405s wall clock time, 39.1M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5920worker2 # [ 114.596124] nix-daemon[845]: reaped child process 1645, status = succeeded5921worker2 # [ 114.598226] nix-daemon[1647]: unexpected Nix daemon error: error: interrupted by the user5922worker2 # [ 114.602788] nix-daemon[845]: reaped child process 1647, status = failed with exit code 15923(finished: subtest: interrupting the client stops the build on the worker, in 2.53 seconds)5924subtest: a deploy mid-build drains: the build finishes, the new generation takes over5925client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5926client # [ 114.665471] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5927client # Running as unit: sw.service; invocation ID: 5dfff62fe5814599bf85c07df5c5473e5928client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5929worker2 # [ 114.875622] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:363945930client # [ 114.878781] nix[1261]: don't know how to build these paths:5931client # [ 114.879695] nix[1261]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5932worker2 # [ 114.893901] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:09Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05933worker2 # [ 114.897796] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:09Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=15934worker1 # [ 114.912846] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387985935worker1 # [ 114.921373] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:387985936client # [ 114.950171] nix[1261]: copying 1 paths to 'lb:50051'...5937worker1 # [ 114.928766] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:387985938client # [ 114.952332] nix[1261]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5939worker1 # [ 114.937328] nix-daemon[843]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5940worker1 # [ 115.093520] nix-daemon[843]: accepted connection from pid 1456, user nix-grpc-daemon (trusted)5941worker1 # [ 115.105914] nix-daemon[843]: reaped child process 1459, status = succeeded5942worker1 # [ 115.267059] nix-daemon[843]: accepted connection from pid 1461, user nix-grpc-daemon (trusted)5943worker1 # [ 115.278954] nix-daemon[843]: reaped child process 1464, status = succeeded5944lb # [ 115.297580] niks3-server[1078]: 2026/09/20 09:01:09 INFO Received uploads request method=POST path=/api/pending_closures5945worker1 # [ 115.310373] nix-grpc-daemon[1416]: time=2026-09-20T09:01:10.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5946worker1 # [ 115.311837] nix-grpc-daemon[1416]: time=2026-09-20T09:01:10.487Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5947lb # [ 115.330423] niks3-server[1078]: 2026/09/20 09:01:10 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5948lb # [ 115.342477] niks3-server[1078]: 2026/09/20 09:01:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5949worker1 # [ 115.347971] nix-grpc-daemon[1416]: time=2026-09-20T09:01:10.525Z level=INFO msg="Uploading 1 narinfos"5950lb # [ 115.348742] niks3-server[1078]: 2026/09/20 09:01:10 INFO Signed narinfos id=38 count=15951lb # [ 115.354481] niks3-server[1078]: 2026/09/20 09:01:10 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5952lb # [ 115.362109] niks3-server[1078]: 2026/09/20 09:01:10 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5953lb # [ 115.372320] niks3-server[1078]: 2026/09/20 09:01:10 INFO Completed upload id=385954worker1 # [ 115.371413] nix-grpc-daemon[1416]: time=2026-09-20T09:01:10.549Z level=INFO msg="Upload complete. (427ms)"5955lb # [ 115.374243] niks3-server[1078]: 2026/09/20 09:01:10 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5956worker1 # [ 115.373577] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38798 duration_s=0 paths=1 nar_bytes_in=4165957worker1 # [ 115.379402] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:387985958worker1 # [ 115.383894] nix-daemon[843]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5959worker1 # [ 115.386182] nix-daemon[843]: reaped child process 1454, status = succeeded5960worker1 # [ 115.391830] nix-daemon[843]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5961client # [ 115.412778] nix[1261]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5962lb # [ 117.094713] envoy[969]: conn peer=[2001:db8:1::1]:56344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1685 ms=105455963lb # [ 117.098905] envoy[969]: conn peer=[2001:db8:1::1]:60342 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=756 ms=21825964worker1: must succeed: systemctl reload nix-grpc-daemon.service5965worker1 # [ 117.214849] systemd[1]: Reloading Nix worker-protocol over gRPC...5966worker1 # [ 117.253776] systemd[1]: Reloaded Nix worker-protocol over gRPC.5967worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds)5968worker1: must succeed: pgrep -f 'read -t [9]0 x'5969worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds)5970client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25971worker1 # [ 117.550501] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:387985972client # don't know how to build these paths:5973client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5974worker2 # [ 117.583454] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363945975worker2 # [ 117.608978] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:12Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05976worker2 # [ 117.613878] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:12Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=15977worker2 # [ 117.659711] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363945978worker2 # [ 117.672875] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363945979client # copying 1 paths to 'lb:50051'...5980worker2 # [ 117.687098] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363945981client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5982worker2 # [ 117.709766] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5983worker2 # [ 117.883554] nix-daemon[845]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)5984worker2 # [ 117.895198] nix-daemon[845]: reaped child process 1696, status = succeeded5985worker1 # [ 117.904698] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:13Z level=info event=draining5986worker2 # [ 118.054461] nix-daemon[845]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)5987worker2 # [ 118.065431] nix-daemon[845]: reaped child process 1701, status = succeeded5988lb # [ 118.054416] niks3-server[1078]: 2026/09/20 09:01:12 INFO Received uploads request method=POST path=/api/pending_closures5989worker2 # [ 118.087888] nix-grpc-daemon[1618]: time=2026-09-20T09:01:13.158Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5990worker2 # [ 118.089341] nix-grpc-daemon[1618]: time=2026-09-20T09:01:13.159Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5991lb # [ 118.088978] niks3-server[1078]: 2026/09/20 09:01:12 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5992lb # [ 118.101825] niks3-server[1078]: 2026/09/20 09:01:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5993worker2 # [ 118.134189] nix-grpc-daemon[1618]: time=2026-09-20T09:01:13.204Z level=INFO msg="Uploading 1 narinfos"5994lb # [ 118.109085] niks3-server[1078]: 2026/09/20 09:01:12 INFO Signed narinfos id=39 count=15995lb # [ 118.113979] niks3-server[1078]: 2026/09/20 09:01:12 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5996lb # [ 118.124245] niks3-server[1078]: 2026/09/20 09:01:12 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5997lb # [ 118.129517] niks3-server[1078]: 2026/09/20 09:01:12 INFO Completed upload id=395998lb # [ 118.131679] niks3-server[1078]: 2026/09/20 09:01:12 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5999worker2 # [ 118.155925] nix-grpc-daemon[1618]: time=2026-09-20T09:01:13.226Z level=INFO msg="Upload complete. (434ms)"6000worker2 # [ 118.159564] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=0 paths=1 nar_bytes_in=5286001worker2 # [ 118.166125] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946002worker2 # [ 118.174738] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6003worker2 # [ 118.182952] nix-daemon[845]: reaped child process 1691, status = succeeded6004worker2 # [ 118.187200] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6005client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6006client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6007client # farm-a> LOG-farm-a-during-drain6008worker2 # [ 119.412406] nix-daemon[845]: reaped child process 1705, status = succeeded6009worker2 # [ 119.578618] nix-daemon[845]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6010worker2 # [ 119.590423] nix-daemon[845]: reaped child process 1723, status = succeeded6011lb # [ 119.585464] niks3-server[1078]: 2026/09/20 09:01:14 INFO Received uploads request method=POST path=/api/pending_closures6012worker2 # [ 119.619133] nix-grpc-daemon[1618]: time=2026-09-20T09:01:14.689Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6013worker2 # [ 119.620644] nix-grpc-daemon[1618]: time=2026-09-20T09:01:14.691Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6014lb # [ 119.620883] niks3-server[1078]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6015lb # [ 119.637256] niks3-server[1078]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6016lb # [ 119.648784] niks3-server[1078]: 2026/09/20 09:01:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6017lb # [ 119.653481] niks3-server[1078]: 2026/09/20 09:01:14 INFO Signed narinfos id=40 count=16018worker2 # [ 119.681528] nix-grpc-daemon[1618]: time=2026-09-20T09:01:14.751Z level=INFO msg="Uploading 1 narinfos"6019lb # [ 119.659637] niks3-server[1078]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6020lb # [ 119.668165] niks3-server[1078]: 2026/09/20 09:01:14 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6021lb # [ 119.672404] niks3-server[1078]: 2026/09/20 09:01:14 INFO Completed upload id=406022worker2 # [ 119.697525] nix-grpc-daemon[1618]: time=2026-09-20T09:01:14.767Z level=INFO msg="Upload complete. (302ms)"6023lb # [ 119.674288] niks3-server[1078]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6024worker2 # [ 119.707415] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16025worker2 # [ 119.717118] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:14Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06026worker2 # [ 119.720263] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:14Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16027worker2 # [ 119.728717] nix-daemon[845]: reaped child process 1703, status = succeeded6028worker2 # [ 119.758930] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946029worker2 # [ 119.772451] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946030worker2 # [ 119.785718] nix-grpc-daemon[1618]: time=2026-09-20T09:01:14.856Z level=INFO msg="All 1 paths already cached"6031client # copying 1 paths to 'lb:50051'...6032worker2 # [ 119.794305] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363946033client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6034worker2 # [ 119.814143] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6035worker2 # [ 120.004265] nix-daemon[845]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)6036worker2 # [ 120.016148] nix-daemon[845]: reaped child process 1732, status = succeeded6037worker2 # [ 120.179241] nix-daemon[845]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)6038worker2 # [ 120.190787] nix-daemon[845]: reaped child process 1737, status = succeeded6039lb # [ 120.183775] niks3-server[1078]: 2026/09/20 09:01:14 INFO Received uploads request method=POST path=/api/pending_closures6040worker2 # [ 120.217834] nix-grpc-daemon[1618]: time=2026-09-20T09:01:15.288Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6041worker2 # [ 120.219352] nix-grpc-daemon[1618]: time=2026-09-20T09:01:15.289Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6042lb # [ 120.212684] niks3-server[1078]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6043lb # [ 120.224995] niks3-server[1078]: 2026/09/20 09:01:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6044worker2 # [ 120.256030] nix-grpc-daemon[1618]: time=2026-09-20T09:01:15.326Z level=INFO msg="Uploading 1 narinfos"6045lb # [ 120.230902] niks3-server[1078]: 2026/09/20 09:01:14 INFO Signed narinfos id=41 count=16046lb # [ 120.235182] niks3-server[1078]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6047lb # [ 120.248771] niks3-server[1078]: 2026/09/20 09:01:14 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6048lb # [ 120.253608] niks3-server[1078]: 2026/09/20 09:01:14 INFO Completed upload id=416049worker2 # [ 120.280763] nix-grpc-daemon[1618]: time=2026-09-20T09:01:15.351Z level=INFO msg="Upload complete. (454ms)"6050lb # [ 120.256518] niks3-server[1078]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6051worker2 # [ 120.282700] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=0 paths=1 nar_bytes_in=6406052worker2 # [ 120.287918] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946053worker2 # [ 120.296994] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6054worker2 # [ 120.299849] nix-daemon[845]: reaped child process 1727, status = succeeded6055worker2 # [ 120.305401] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6056client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6057client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6058client # farm-b> LOG-farm-b-during-drain6059worker2 # [ 121.730688] nix-daemon[845]: reaped child process 1741, status = succeeded6060worker2 # [ 121.892427] nix-daemon[845]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6061worker2 # [ 121.904302] nix-daemon[845]: reaped child process 1759, status = succeeded6062lb # [ 121.897994] niks3-server[1078]: 2026/09/20 09:01:16 INFO Received uploads request method=POST path=/api/pending_closures6063worker2 # [ 121.931370] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.001Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6064worker2 # [ 121.932965] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.003Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6065lb # [ 121.934921] niks3-server[1078]: 2026/09/20 09:01:16 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6066lb # [ 121.940663] niks3-server[1078]: 2026/09/20 09:01:16 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6067lb # [ 121.953139] niks3-server[1078]: 2026/09/20 09:01:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6068lb # [ 121.958493] niks3-server[1078]: 2026/09/20 09:01:16 INFO Signed narinfos id=42 count=16069worker2 # [ 121.986062] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.056Z level=INFO msg="Uploading 1 narinfos"6070lb # [ 121.963494] niks3-server[1078]: 2026/09/20 09:01:16 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6071lb # [ 121.973255] niks3-server[1078]: 2026/09/20 09:01:16 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6072lb # [ 121.978471] niks3-server[1078]: 2026/09/20 09:01:16 INFO Completed upload id=426073worker2 # [ 122.003476] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.073Z level=INFO msg="Upload complete. (288ms)"6074lb # [ 121.980913] niks3-server[1078]: 2026/09/20 09:01:16 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6075worker2 # [ 122.012411] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16076worker2 # [ 122.021655] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06077worker2 # [ 122.025391] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16078worker2 # [ 122.034104] nix-daemon[845]: reaped child process 1739, status = succeeded6079worker2 # [ 122.066095] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946080worker2 # [ 122.078752] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946081worker2 # [ 122.092382] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.162Z level=INFO msg="All 2 paths already cached"6082client # copying 1 paths to 'lb:50051'...6083worker2 # [ 122.100159] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363946084client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6085worker2 # [ 122.120132] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6086worker2 # [ 122.298186] nix-daemon[845]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6087worker2 # [ 122.310075] nix-daemon[845]: reaped child process 1768, status = succeeded6088worker2 # [ 122.472702] nix-daemon[845]: accepted connection from pid 1770, user nix-grpc-daemon (trusted)6089worker2 # [ 122.484579] nix-daemon[845]: reaped child process 1773, status = succeeded6090lb # [ 122.477275] niks3-server[1078]: 2026/09/20 09:01:17 INFO Received uploads request method=POST path=/api/pending_closures6091worker2 # [ 122.510631] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.581Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6092worker2 # [ 122.512138] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.582Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6093lb # [ 122.506775] niks3-server[1078]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6094lb # [ 122.519171] niks3-server[1078]: 2026/09/20 09:01:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6095worker2 # [ 122.549166] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.619Z level=INFO msg="Uploading 1 narinfos"6096lb # [ 122.525276] niks3-server[1078]: 2026/09/20 09:01:17 INFO Signed narinfos id=43 count=16097lb # [ 122.531356] niks3-server[1078]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6098lb # [ 122.541697] niks3-server[1078]: 2026/09/20 09:01:17 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6099lb # [ 122.548219] niks3-server[1078]: 2026/09/20 09:01:17 INFO Completed upload id=436100worker2 # [ 122.573227] nix-grpc-daemon[1618]: time=2026-09-20T09:01:17.643Z level=INFO msg="Upload complete. (440ms)"6101lb # [ 122.550946] niks3-server[1078]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6102worker2 # [ 122.576871] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=0 paths=1 nar_bytes_in=7686103worker2 # [ 122.582711] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946104worker2 # [ 122.592818] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6105worker2 # [ 122.596198] nix-daemon[845]: reaped child process 1763, status = succeeded6106worker2 # [ 122.601405] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6107client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6108client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6109client # farm-top> LOG-farm-top-during-drain6110worker2 # [ 124.029278] nix-daemon[845]: reaped child process 1777, status = succeeded6111worker2 # [ 124.176570] nix-daemon[845]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6112worker2 # [ 124.188647] nix-daemon[845]: reaped child process 1795, status = succeeded6113lb # [ 124.177797] niks3-server[1078]: 2026/09/20 09:01:18 INFO Received uploads request method=POST path=/api/pending_closures6114worker2 # [ 124.213285] nix-grpc-daemon[1618]: time=2026-09-20T09:01:19.282Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6115worker2 # [ 124.214723] nix-grpc-daemon[1618]: time=2026-09-20T09:01:19.282Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6116lb # [ 124.210235] niks3-server[1078]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6117lb # [ 124.220071] niks3-server[1078]: 2026/09/20 09:01:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6118worker2 # [ 124.252546] nix-grpc-daemon[1618]: time=2026-09-20T09:01:19.322Z level=INFO msg="Uploading 1 narinfos"6119lb # [ 124.227495] niks3-server[1078]: 2026/09/20 09:01:18 INFO Signed narinfos id=44 count=16120lb # [ 124.231461] niks3-server[1078]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6121lb # [ 124.235586] niks3-server[1078]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6122lb # [ 124.242033] niks3-server[1078]: 2026/09/20 09:01:18 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6123lb # [ 124.244697] niks3-server[1078]: 2026/09/20 09:01:18 INFO Completed upload id=446124worker2 # [ 124.269652] nix-grpc-daemon[1618]: time=2026-09-20T09:01:19.340Z level=INFO msg="Upload complete. (258ms)"6125lb # [ 124.246805] niks3-server[1078]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6126worker2 # [ 124.273378] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16127worker2 # [ 124.284813] nix-daemon[845]: reaped child process 1775, status = succeeded6128client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.99 seconds)6129client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6130client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.21 seconds)6131worker1: must succeed: pkill -f 'read -t [9]0 x'6132worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6133client: waiting for success: ! systemctl is-active sw6134worker1 # [ 124.613668] nix-daemon[843]: reaped child process 1468, status = succeeded6135worker1 # [ 124.779040] nix-daemon[843]: accepted connection from pid 1509, user nix-grpc-daemon (trusted)6136worker1 # [ 124.790307] nix-daemon[843]: reaped child process 1512, status = succeeded6137lb # [ 124.804396] niks3-server[1078]: 2026/09/20 09:01:19 INFO Received uploads request method=POST path=/api/pending_closures6138worker1 # [ 124.812492] nix-grpc-daemon[1416]: time=2026-09-20T09:01:19.990Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6139worker1 # [ 124.814733] nix-grpc-daemon[1416]: time=2026-09-20T09:01:19.992Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6140lb # [ 124.831152] niks3-server[1078]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6141lb # [ 124.846960] niks3-server[1078]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6142lb # [ 124.857876] niks3-server[1078]: 2026/09/20 09:01:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6143worker1 # [ 124.861558] nix-grpc-daemon[1416]: time=2026-09-20T09:01:20.039Z level=INFO msg="Uploading 1 narinfos"6144lb # [ 124.862482] niks3-server[1078]: 2026/09/20 09:01:19 INFO Signed narinfos id=45 count=16145lb # [ 124.867606] niks3-server[1078]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6146lb # [ 124.872972] niks3-server[1078]: 2026/09/20 09:01:19 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6147lb # [ 124.877098] niks3-server[1078]: 2026/09/20 09:01:19 INFO Completed upload id=456148worker1 # [ 124.876209] nix-grpc-daemon[1416]: time=2026-09-20T09:01:20.054Z level=INFO msg="Upload complete. (269ms)"6149lb # [ 124.879090] niks3-server[1078]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6150worker1 # [ 124.882368] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38798 duration_s=9 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16151worker1 # [ 124.892825] nix-daemon[843]: reaped child process 1466, status = succeeded6152worker1 # [ 124.908449] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:20Z level=info event=signal_exit6153client # [ 124.942692] systemd[1]: sw.service: Deactivated successfully.6154client # [ 124.946639] systemd[1]: sw.service: Consumed 116ms CPU time over 10.279s wall clock time, 39.2M memory peak, 8.3K incoming IP traffic, 8.8K outgoing IP traffic.6155client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6156client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6157client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6158worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6159worker2 # [ 126.164666] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:363826160worker1 # [ 126.134570] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:21Z level=info event=scheduler_restarting6161worker1 # [ 126.142938] nix-grpc-daemon[1311]: ts=2026-09-20T09:01:21Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6162worker2 # [ 126.168795] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:21Z level=info event=worker_gone addr=192.168.1.3:500516163worker1 # [ 126.158519] nix-daemon[843]: reaped child process 1364, status = succeeded6164worker1 # [ 126.761795] nix-grpc-daemon[1311]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6165worker1 # [ 126.765269] nix-grpc-daemon[1311]: E0000 00:00:1789894881.939610 1354 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6166worker1 # [ 126.769752] nix-grpc-daemon[1311]: E0000 00:00:1789894881.939765 1354 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6167lb # [ 127.095116] envoy[969]: conn peer=[2001:db8:1::1]:51266 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9628 tx=3841 ms=67256168lb # [ 127.096726] envoy[969]: conn peer=[2001:db8:1::1]:51254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2919 tx=1307 ms=100446169lb # [ 127.098274] envoy[969]: conn peer=[2001:db8:1::3]:55382 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1114 tx=448 ms=262186170worker1 # [ 127.948537] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6171worker1 # [ 127.951150] systemd[1]: nix-grpc-daemon.service: Consumed 617ms CPU time over 28.203s wall clock time, 32.3M memory peak, 20.6K incoming IP traffic, 27K outgoing IP traffic.6172worker1 # [ 127.968244] systemd[1]: Starting Nix worker-protocol over gRPC...6173worker1 # [ 128.126070] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6174worker1 # [ 128.127820] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16175worker1 # [ 128.133575] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6176worker1 # [ 128.137141] systemd[1]: Started Nix worker-protocol over gRPC.6177worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.47 seconds)6178lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6179lb: must succeed: curl -sf localhost:9901/clusters6180worker1 # [ 128.168512] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:23Z level=info event=scheduler_connected addr=lb:500516181worker2 # [ 128.197715] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06182lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6183lb: must succeed: curl -sf localhost:9901/clusters6184lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6185lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.16 seconds)6186lb: must succeed: curl -sf localhost:9901/clusters6187lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6188worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6189worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)6190(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.84 seconds)6191subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6192client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16193worker2 # [ 129.681472] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:363946194worker2 # [ 129.688806] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946195worker2 # [ 129.732224] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:24Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06196worker2 # [ 129.736527] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:24Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16197worker2 # [ 129.740848] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:24Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06198worker2 # [ 129.744648] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:24Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06199worker1 # [ 129.753427] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526200worker1 # [ 129.758835] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6201worker1 # [ 129.767076] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)6202worker1 # [ 129.853600] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 2/5)6203worker1 # [ 129.972168] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 233 ms (attempt 3/5)6204worker1 # [ 130.207804] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 510 ms (attempt 4/5)6205worker1 # [ 130.718327] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6206worker1 # [ 130.731480] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526207worker1 # [ 130.739723] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526208worker1 # [ 130.744955] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6209worker1 # [ 130.758799] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:25Z level=info event=niks3_push_started pid=15826210worker1 # [ 131.076921] nix-daemon[843]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)6211worker1 # [ 131.088922] nix-daemon[843]: reaped child process 1598, status = succeeded6212worker1 # [ 131.234456] nix-daemon[843]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6213worker1 # [ 131.246877] nix-daemon[843]: reaped child process 1603, status = succeeded6214lb # [ 131.261711] niks3-server[1078]: 2026/09/20 09:01:25 INFO Received uploads request method=POST path=/api/pending_closures6215worker1 # [ 131.267650] nix-grpc-daemon[1582]: time=2026-09-20T09:01:26.445Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6216worker1 # [ 131.270866] nix-grpc-daemon[1582]: time=2026-09-20T09:01:26.447Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6217lb # [ 131.291844] niks3-server[1078]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6218lb # [ 131.300806] niks3-server[1078]: 2026/09/20 09:01:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6219lb # [ 131.305781] niks3-server[1078]: 2026/09/20 09:01:25 INFO Signed narinfos id=46 count=16220worker1 # [ 131.308085] nix-grpc-daemon[1582]: time=2026-09-20T09:01:26.485Z level=INFO msg="Uploading 1 narinfos"6221lb # [ 131.318389] niks3-server[1078]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6222lb # [ 131.325958] niks3-server[1078]: 2026/09/20 09:01:25 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6223worker1 # [ 131.331553] nix-grpc-daemon[1582]: time=2026-09-20T09:01:26.509Z level=INFO msg="Upload complete. (400ms)"6224lb # [ 131.332161] niks3-server[1078]: 2026/09/20 09:01:26 INFO Completed upload id=466225worker1 # [ 131.334050] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=5046226lb # [ 131.335732] niks3-server[1078]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6227worker1 # [ 131.339550] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526228worker1 # [ 131.344708] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6229worker1 # [ 131.347038] nix-daemon[843]: reaped child process 1580, status = succeeded6230worker1 # [ 131.352228] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6231worker1 # [ 132.567202] nix-daemon[843]: reaped child process 1607, status = succeeded6232worker1 # [ 132.706112] nix-daemon[843]: accepted connection from pid 1622, user nix-grpc-daemon (trusted)6233worker1 # [ 132.717919] nix-daemon[843]: reaped child process 1625, status = succeeded6234lb # [ 132.734263] niks3-server[1078]: 2026/09/20 09:01:27 INFO Received uploads request method=POST path=/api/pending_closures6235worker1 # [ 132.743305] nix-grpc-daemon[1582]: time=2026-09-20T09:01:27.919Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6236worker1 # [ 132.744753] nix-grpc-daemon[1582]: time=2026-09-20T09:01:27.919Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6237lb # [ 132.764132] niks3-server[1078]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6238lb # [ 132.779204] niks3-server[1078]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6239lb # [ 132.792266] niks3-server[1078]: 2026/09/20 09:01:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6240lb # [ 132.796532] niks3-server[1078]: 2026/09/20 09:01:27 INFO Signed narinfos id=47 count=16241worker1 # [ 132.799095] nix-grpc-daemon[1582]: time=2026-09-20T09:01:27.976Z level=INFO msg="Uploading 1 narinfos"6242lb # [ 132.801598] niks3-server[1078]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6243lb # [ 132.811898] niks3-server[1078]: 2026/09/20 09:01:27 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6244lb # [ 132.817305] niks3-server[1078]: 2026/09/20 09:01:27 INFO Completed upload id=476245worker1 # [ 132.816468] nix-grpc-daemon[1582]: time=2026-09-20T09:01:27.994Z level=INFO msg="Upload complete. (257ms)"6246lb # [ 132.820055] niks3-server[1078]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6247worker1 # [ 132.820229] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16248worker2 # [ 132.846589] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:27Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16249worker1 # [ 132.826440] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526250worker1 # [ 132.829227] nix-daemon[843]: reaped child process 1605, status = succeeded6251worker1 # [ 132.832754] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526252worker2 # [ 132.856881] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:27Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06253worker1 # [ 132.837778] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526254worker1 # [ 132.841764] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6255worker1 # [ 132.970837] nix-daemon[843]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6256worker1 # [ 132.983124] nix-daemon[843]: reaped child process 1632, status = succeeded6257worker1 # [ 133.109660] nix-daemon[843]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6258worker1 # [ 133.121970] nix-daemon[843]: reaped child process 1637, status = succeeded6259lb # [ 133.131379] niks3-server[1078]: 2026/09/20 09:01:27 INFO Received uploads request method=POST path=/api/pending_closures6260worker1 # [ 133.138861] nix-grpc-daemon[1582]: time=2026-09-20T09:01:28.316Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6261worker1 # [ 133.140387] nix-grpc-daemon[1582]: time=2026-09-20T09:01:28.316Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6262lb # [ 133.161485] niks3-server[1078]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6263lb # [ 133.165846] niks3-server[1078]: 2026/09/20 09:01:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6264lb # [ 133.170656] niks3-server[1078]: 2026/09/20 09:01:27 INFO Signed narinfos id=48 count=16265worker1 # [ 133.172813] nix-grpc-daemon[1582]: time=2026-09-20T09:01:28.350Z level=INFO msg="Uploading 1 narinfos"6266lb # [ 133.184298] niks3-server[1078]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6267lb # [ 133.191049] niks3-server[1078]: 2026/09/20 09:01:27 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6268lb # [ 133.196841] niks3-server[1078]: 2026/09/20 09:01:27 INFO Completed upload id=486269worker1 # [ 133.195681] nix-grpc-daemon[1582]: time=2026-09-20T09:01:28.373Z level=INFO msg="Upload complete. (348ms)"6270worker1 # [ 133.197746] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=5046271lb # [ 133.200158] niks3-server[1078]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6272worker1 # [ 133.203417] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526273worker1 # [ 133.208249] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6274worker1 # [ 133.210519] nix-daemon[843]: reaped child process 1627, status = succeeded6275worker1 # [ 133.215824] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6276worker1 # [ 134.642813] nix-daemon[843]: reaped child process 1641, status = succeeded6277worker1 # [ 134.796965] nix-daemon[843]: accepted connection from pid 1656, user nix-grpc-daemon (trusted)6278worker1 # [ 134.808288] nix-daemon[843]: reaped child process 1659, status = succeeded6279lb # [ 134.824415] niks3-server[1078]: 2026/09/20 09:01:29 INFO Received uploads request method=POST path=/api/pending_closures6280worker1 # [ 134.827683] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.005Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6281worker1 # [ 134.829183] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.007Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6282lb # [ 134.857109] niks3-server[1078]: 2026/09/20 09:01:29 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6283lb # [ 134.861961] niks3-server[1078]: 2026/09/20 09:01:29 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6284lb # [ 134.870232] niks3-server[1078]: 2026/09/20 09:01:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6285lb # [ 134.874948] niks3-server[1078]: 2026/09/20 09:01:29 INFO Signed narinfos id=49 count=16286worker1 # [ 134.877023] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.054Z level=INFO msg="Uploading 1 narinfos"6287lb # [ 134.880416] niks3-server[1078]: 2026/09/20 09:01:29 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6288lb # [ 134.885194] niks3-server[1078]: 2026/09/20 09:01:29 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6289lb # [ 134.888829] niks3-server[1078]: 2026/09/20 09:01:29 INFO Completed upload id=496290worker1 # [ 134.887889] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.065Z level=INFO msg="Upload complete. (264ms)"6291lb # [ 134.891586] niks3-server[1078]: 2026/09/20 09:01:29 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6292worker2 # [ 134.916975] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:29Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16293worker2 # [ 134.921707] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:29Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06294worker1 # [ 134.892167] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16295worker1 # [ 134.898932] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526296worker1 # [ 134.908309] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526297worker1 # [ 134.910977] nix-daemon[843]: reaped child process 1639, status = succeeded6298worker1 # [ 134.914460] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526299worker1 # [ 134.918566] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6300worker1 # [ 135.069192] nix-daemon[843]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)6301worker1 # [ 135.081641] nix-daemon[843]: reaped child process 1666, status = succeeded6302worker1 # [ 135.221924] nix-daemon[843]: accepted connection from pid 1668, user nix-grpc-daemon (trusted)6303worker1 # [ 135.234046] nix-daemon[843]: reaped child process 1671, status = succeeded6304lb # [ 135.246897] niks3-server[1078]: 2026/09/20 09:01:29 INFO Received uploads request method=POST path=/api/pending_closures6305worker1 # [ 135.257166] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.435Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6306worker1 # [ 135.259107] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.436Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6307lb # [ 135.278463] niks3-server[1078]: 2026/09/20 09:01:29 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6308lb # [ 135.292997] niks3-server[1078]: 2026/09/20 09:01:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6309lb # [ 135.299257] niks3-server[1078]: 2026/09/20 09:01:29 INFO Signed narinfos id=50 count=16310worker1 # [ 135.301262] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.479Z level=INFO msg="Uploading 1 narinfos"6311lb # [ 135.302173] niks3-server[1078]: 2026/09/20 09:01:29 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6312lb # [ 135.313060] niks3-server[1078]: 2026/09/20 09:01:29 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6313lb # [ 135.317164] niks3-server[1078]: 2026/09/20 09:01:29 INFO Completed upload id=506314worker1 # [ 135.317709] nix-grpc-daemon[1582]: time=2026-09-20T09:01:30.495Z level=INFO msg="Upload complete. (393ms)"6315lb # [ 135.319042] niks3-server[1078]: 2026/09/20 09:01:29 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6316worker1 # [ 135.320389] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=5046317worker1 # [ 135.324753] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526318worker1 # [ 135.334937] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6319worker1 # [ 135.341102] nix-daemon[843]: reaped child process 1661, status = succeeded6320worker1 # [ 135.344077] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6321worker1 # [ 136.557372] nix-daemon[843]: reaped child process 1675, status = succeeded6322worker1 # [ 136.704135] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6323worker1 # [ 136.716299] nix-daemon[843]: reaped child process 1693, status = succeeded6324lb # [ 136.734512] niks3-server[1078]: 2026/09/20 09:01:31 INFO Received uploads request method=POST path=/api/pending_closures6325worker1 # [ 136.744193] nix-grpc-daemon[1582]: time=2026-09-20T09:01:31.921Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6326worker1 # [ 136.745779] nix-grpc-daemon[1582]: time=2026-09-20T09:01:31.923Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6327lb # [ 136.775265] niks3-server[1078]: 2026/09/20 09:01:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6328lb # [ 136.783764] niks3-server[1078]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6329lb # [ 136.789158] niks3-server[1078]: 2026/09/20 09:01:31 INFO Signed narinfos id=51 count=16330worker1 # [ 136.791305] nix-grpc-daemon[1582]: time=2026-09-20T09:01:31.969Z level=INFO msg="Uploading 1 narinfos"6331lb # [ 136.796433] niks3-server[1078]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6332lb # [ 136.803190] niks3-server[1078]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6333lb # [ 136.812109] niks3-server[1078]: 2026/09/20 09:01:31 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6334lb # [ 136.817716] niks3-server[1078]: 2026/09/20 09:01:31 INFO Completed upload id=516335worker1 # [ 136.816729] nix-grpc-daemon[1582]: time=2026-09-20T09:01:31.994Z level=INFO msg="Upload complete. (265ms)"6336lb # [ 136.819428] niks3-server[1078]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6337worker1 # [ 136.819164] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16338worker1 # [ 136.826215] nix-daemon[843]: reaped child process 1673, status = succeeded6339worker2 # [ 136.848424] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:31Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16340worker2 # [ 136.858371] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:31Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06341worker1 # [ 136.871367] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526342worker1 # [ 136.879605] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526343worker1 # [ 136.887961] nix-grpc-daemon[1582]: time=2026-09-20T09:01:32.066Z level=INFO msg="All 1 paths already cached"6344worker1 # [ 136.891967] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526345worker1 # [ 136.897325] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6346worker1 # [ 137.061771] nix-daemon[843]: accepted connection from pid 1697, user nix-grpc-daemon (trusted)6347worker1 # [ 137.074321] nix-daemon[843]: reaped child process 1700, status = succeeded6348worker1 # [ 137.240674] nix-daemon[843]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)6349worker1 # [ 137.252767] nix-daemon[843]: reaped child process 1705, status = succeeded6350lb # [ 137.268904] niks3-server[1078]: 2026/09/20 09:01:31 INFO Received uploads request method=POST path=/api/pending_closures6351worker1 # [ 137.275565] nix-grpc-daemon[1582]: time=2026-09-20T09:01:32.453Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6352worker1 # [ 137.277058] nix-grpc-daemon[1582]: time=2026-09-20T09:01:32.453Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6353lb # [ 137.295592] niks3-server[1078]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6354lb # [ 137.304292] niks3-server[1078]: 2026/09/20 09:01:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6355worker1 # [ 137.307845] nix-grpc-daemon[1582]: time=2026-09-20T09:01:32.485Z level=INFO msg="Uploading 1 narinfos"6356lb # [ 137.310400] niks3-server[1078]: 2026/09/20 09:01:31 INFO Signed narinfos id=52 count=16357lb # [ 137.314929] niks3-server[1078]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6358lb # [ 137.326207] niks3-server[1078]: 2026/09/20 09:01:31 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6359worker1 # [ 137.331584] nix-grpc-daemon[1582]: time=2026-09-20T09:01:32.509Z level=INFO msg="Upload complete. (429ms)"6360lb # [ 137.332779] niks3-server[1078]: 2026/09/20 09:01:32 INFO Completed upload id=526361worker1 # [ 137.335077] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=6246362lb # [ 137.336335] niks3-server[1078]: 2026/09/20 09:01:32 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6363worker1 # [ 137.339408] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526364worker1 # [ 137.344266] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6365worker1 # [ 137.346520] nix-daemon[843]: reaped child process 1695, status = succeeded6366worker1 # [ 137.352054] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6367worker1 # [ 138.365741] nix-daemon[843]: reaped child process 1709, status = succeeded6368worker1 # [ 138.512977] nix-daemon[843]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6369worker1 # [ 138.525270] nix-daemon[843]: reaped child process 1727, status = succeeded6370lb # [ 138.540968] niks3-server[1078]: 2026/09/20 09:01:33 INFO Received uploads request method=POST path=/api/pending_closures6371worker1 # [ 138.549299] nix-grpc-daemon[1582]: time=2026-09-20T09:01:33.725Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6372worker1 # [ 138.550625] nix-grpc-daemon[1582]: time=2026-09-20T09:01:33.726Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6373lb # [ 138.576169] niks3-server[1078]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6374lb # [ 138.589342] niks3-server[1078]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6375lb # [ 138.604636] niks3-server[1078]: 2026/09/20 09:01:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6376lb # [ 138.608850] niks3-server[1078]: 2026/09/20 09:01:33 INFO Signed narinfos id=53 count=16377worker1 # [ 138.608129] nix-grpc-daemon[1582]: time=2026-09-20T09:01:33.785Z level=INFO msg="Uploading 1 narinfos"6378lb # [ 138.613769] niks3-server[1078]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6379lb # [ 138.622676] niks3-server[1078]: 2026/09/20 09:01:33 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6380lb # [ 138.626146] niks3-server[1078]: 2026/09/20 09:01:33 INFO Completed upload id=536381lb # [ 138.627437] niks3-server[1078]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6382worker1 # [ 138.625413] nix-grpc-daemon[1582]: time=2026-09-20T09:01:33.803Z level=INFO msg="Upload complete. (266ms)"6383worker2 # [ 138.657538] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:33Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16384worker1 # [ 138.634280] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16385worker1 # [ 138.639886] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526386worker2 # [ 138.666689] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:33Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06387worker1 # [ 138.649918] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526388worker1 # [ 138.658927] nix-daemon[843]: reaped child process 1707, status = succeeded6389worker1 # [ 138.660570] nix-grpc-daemon[1582]: time=2026-09-20T09:01:33.838Z level=INFO msg="All 1 paths already cached"6390worker1 # [ 138.664326] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526391worker1 # [ 138.668271] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6392worker1 # [ 138.816575] nix-daemon[843]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6393worker1 # [ 138.828942] nix-daemon[843]: reaped child process 1734, status = succeeded6394worker1 # [ 138.981248] nix-daemon[843]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6395worker1 # [ 138.993446] nix-daemon[843]: reaped child process 1739, status = succeeded6396lb # [ 139.007569] niks3-server[1078]: 2026/09/20 09:01:33 INFO Received uploads request method=POST path=/api/pending_closures6397worker1 # [ 139.015088] nix-grpc-daemon[1582]: time=2026-09-20T09:01:34.192Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6398worker1 # [ 139.016548] nix-grpc-daemon[1582]: time=2026-09-20T09:01:34.192Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6399lb # [ 139.031738] niks3-server[1078]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6400lb # [ 139.042848] niks3-server[1078]: 2026/09/20 09:01:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6401lb # [ 139.047873] niks3-server[1078]: 2026/09/20 09:01:33 INFO Signed narinfos id=54 count=16402worker1 # [ 139.049911] nix-grpc-daemon[1582]: time=2026-09-20T09:01:34.227Z level=INFO msg="Uploading 1 narinfos"6403lb # [ 139.054665] niks3-server[1078]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6404lb # [ 139.065656] niks3-server[1078]: 2026/09/20 09:01:33 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6405worker1 # [ 139.069372] nix-grpc-daemon[1582]: time=2026-09-20T09:01:34.247Z level=INFO msg="Upload complete. (395ms)"6406lb # [ 139.070357] niks3-server[1078]: 2026/09/20 09:01:33 INFO Completed upload id=546407lb # [ 139.073687] niks3-server[1078]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6408worker1 # [ 139.071800] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=6246409worker1 # [ 139.076913] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526410worker1 # [ 139.086499] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6411worker1 # [ 139.091197] nix-daemon[843]: reaped child process 1729, status = succeeded6412worker1 # [ 139.096036] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6413worker1 # [ 139.709393] nix-daemon[843]: reaped child process 1743, status = succeeded6414worker1 # [ 139.827879] nix-daemon[843]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)6415worker1 # [ 139.840818] nix-daemon[843]: reaped child process 1761, status = succeeded6416lb # [ 139.851738] niks3-server[1078]: 2026/09/20 09:01:34 INFO Received uploads request method=POST path=/api/pending_closures6417worker1 # [ 139.858743] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.036Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6418worker1 # [ 139.861705] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.038Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6419lb # [ 139.885590] niks3-server[1078]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6420lb # [ 139.893204] niks3-server[1078]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6421lb # [ 139.904667] niks3-server[1078]: 2026/09/20 09:01:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6422worker1 # [ 139.909123] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.086Z level=INFO msg="Uploading 1 narinfos"6423lb # [ 139.910086] niks3-server[1078]: 2026/09/20 09:01:34 INFO Signed narinfos id=55 count=16424lb # [ 139.914640] niks3-server[1078]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6425lb # [ 139.923758] niks3-server[1078]: 2026/09/20 09:01:34 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6426worker1 # [ 139.927749] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.105Z level=INFO msg="Upload complete. (226ms)"6427lb # [ 139.928691] niks3-server[1078]: 2026/09/20 09:01:34 INFO Completed upload id=556428worker1 # [ 139.930330] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16429lb # [ 139.932622] niks3-server[1078]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6430worker1 # [ 139.934253] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526431worker2 # [ 139.957819] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:35Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16432worker1 # [ 139.940362] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526433worker1 # [ 139.944443] nix-daemon[843]: reaped child process 1741, status = succeeded6434worker2 # [ 139.967868] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:35Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06435worker1 # [ 139.946450] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.124Z level=INFO msg="All 1 paths already cached"6436worker1 # [ 139.949916] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526437worker1 # [ 139.954608] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6438worker1 # [ 140.092941] nix-daemon[843]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6439worker1 # [ 140.105330] nix-daemon[843]: reaped child process 1768, status = succeeded6440worker1 # [ 140.254065] nix-daemon[843]: accepted connection from pid 1770, user nix-grpc-daemon (trusted)6441worker1 # [ 140.266753] nix-daemon[843]: reaped child process 1773, status = succeeded6442lb # [ 140.278678] niks3-server[1078]: 2026/09/20 09:01:34 INFO Received uploads request method=POST path=/api/pending_closures6443worker1 # [ 140.286301] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.464Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6444worker1 # [ 140.287684] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.464Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6445lb # [ 140.304633] niks3-server[1078]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6446lb # [ 140.315311] niks3-server[1078]: 2026/09/20 09:01:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6447lb # [ 140.322054] niks3-server[1078]: 2026/09/20 09:01:34 INFO Signed narinfos id=56 count=16448worker1 # [ 140.324380] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.502Z level=INFO msg="Uploading 1 narinfos"6449lb # [ 140.329877] niks3-server[1078]: 2026/09/20 09:01:35 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6450lb # [ 140.341332] niks3-server[1078]: 2026/09/20 09:01:35 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6451lb # [ 140.348817] niks3-server[1078]: 2026/09/20 09:01:35 INFO Completed upload id=566452worker1 # [ 140.350090] nix-grpc-daemon[1582]: time=2026-09-20T09:01:35.528Z level=INFO msg="Upload complete. (389ms)"6453lb # [ 140.351532] niks3-server[1078]: 2026/09/20 09:01:35 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6454worker1 # [ 140.353648] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=6246455worker1 # [ 140.360334] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526456worker1 # [ 140.368493] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6457worker1 # [ 140.375891] nix-daemon[843]: reaped child process 1763, status = succeeded6458worker1 # [ 140.381084] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6459worker1 # [ 141.004531] nix-daemon[843]: reaped child process 1777, status = succeeded6460worker1 # [ 141.148633] nix-daemon[843]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6461worker1 # [ 141.160630] nix-daemon[843]: reaped child process 1795, status = succeeded6462lb # [ 141.174914] niks3-server[1078]: 2026/09/20 09:01:35 INFO Received uploads request method=POST path=/api/pending_closures6463worker1 # [ 141.180179] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.358Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6464worker1 # [ 141.181686] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.359Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6465lb # [ 141.209562] niks3-server[1078]: 2026/09/20 09:01:35 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6466lb # [ 141.218973] niks3-server[1078]: 2026/09/20 09:01:35 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6467lb # [ 141.228684] niks3-server[1078]: 2026/09/20 09:01:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6468worker1 # [ 141.232823] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.410Z level=INFO msg="Uploading 1 narinfos"6469lb # [ 141.234070] niks3-server[1078]: 2026/09/20 09:01:35 INFO Signed narinfos id=57 count=16470lb # [ 141.239298] niks3-server[1078]: 2026/09/20 09:01:35 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6471lb # [ 141.247837] niks3-server[1078]: 2026/09/20 09:01:35 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6472lb # [ 141.253271] niks3-server[1078]: 2026/09/20 09:01:35 INFO Completed upload id=576473worker1 # [ 141.251941] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.429Z level=INFO msg="Upload complete. (264ms)"6474lb # [ 141.256183] niks3-server[1078]: 2026/09/20 09:01:35 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6475worker1 # [ 141.256488] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16476worker2 # [ 141.284582] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:36Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16477worker1 # [ 141.266130] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526478worker2 # [ 141.295429] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:36Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06479worker1 # [ 141.277555] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526480worker1 # [ 141.280699] nix-daemon[843]: reaped child process 1775, status = succeeded6481worker1 # [ 141.285366] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.463Z level=INFO msg="All 2 paths already cached"6482worker1 # [ 141.290101] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526483worker1 # [ 141.293983] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6484worker1 # [ 141.443846] nix-daemon[843]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)6485worker1 # [ 141.456946] nix-daemon[843]: reaped child process 1802, status = succeeded6486worker1 # [ 141.601848] nix-daemon[843]: accepted connection from pid 1804, user nix-grpc-daemon (trusted)6487worker1 # [ 141.613836] nix-daemon[843]: reaped child process 1807, status = succeeded6488lb # [ 141.628133] niks3-server[1078]: 2026/09/20 09:01:36 INFO Received uploads request method=POST path=/api/pending_closures6489worker1 # [ 141.635818] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.813Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6490worker1 # [ 141.637176] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.813Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6491lb # [ 141.654509] niks3-server[1078]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6492lb # [ 141.663252] niks3-server[1078]: 2026/09/20 09:01:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6493lb # [ 141.667637] niks3-server[1078]: 2026/09/20 09:01:36 INFO Signed narinfos id=58 count=16494worker1 # [ 141.669814] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.847Z level=INFO msg="Uploading 1 narinfos"6495lb # [ 141.677212] niks3-server[1078]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6496lb # [ 141.687672] niks3-server[1078]: 2026/09/20 09:01:36 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6497lb # [ 141.693368] niks3-server[1078]: 2026/09/20 09:01:36 INFO Completed upload id=586498worker1 # [ 141.694734] nix-grpc-daemon[1582]: time=2026-09-20T09:01:36.872Z level=INFO msg="Upload complete. (394ms)"6499lb # [ 141.696332] niks3-server[1078]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6500worker1 # [ 141.696704] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=7526501worker1 # [ 141.701685] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526502worker1 # [ 141.711731] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6503worker1 # [ 141.714170] nix-daemon[843]: reaped child process 1797, status = succeeded6504worker1 # [ 141.719115] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6505worker1 # [ 142.944393] nix-daemon[843]: reaped child process 1811, status = succeeded6506worker1 # [ 143.089852] nix-daemon[843]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)6507worker1 # [ 143.102315] nix-daemon[843]: reaped child process 1829, status = succeeded6508lb # [ 143.114699] niks3-server[1078]: 2026/09/20 09:01:37 INFO Received uploads request method=POST path=/api/pending_closures6509worker1 # [ 143.123242] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.301Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6510worker1 # [ 143.124761] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.302Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6511lb # [ 143.157785] niks3-server[1078]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6512lb # [ 143.168241] niks3-server[1078]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6513lb # [ 143.175385] niks3-server[1078]: 2026/09/20 09:01:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6514lb # [ 143.180669] niks3-server[1078]: 2026/09/20 09:01:37 INFO Signed narinfos id=59 count=16515worker1 # [ 143.182610] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.360Z level=INFO msg="Uploading 1 narinfos"6516lb # [ 143.189545] niks3-server[1078]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6517lb # [ 143.194023] niks3-server[1078]: 2026/09/20 09:01:37 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6518lb # [ 143.197289] niks3-server[1078]: 2026/09/20 09:01:37 INFO Completed upload id=596519worker1 # [ 143.196595] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.374Z level=INFO msg="Upload complete. (269ms)"6520lb # [ 143.199563] niks3-server[1078]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6521worker2 # [ 143.227854] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:38Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16522worker1 # [ 143.204259] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16523worker1 # [ 143.214654] nix-daemon[843]: reaped child process 1809, status = succeeded6524worker1 # [ 143.245905] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526525worker1 # [ 143.257428] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526526worker1 # [ 143.268922] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.446Z level=INFO msg="All 2 paths already cached"6527worker1 # [ 143.276157] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526528worker1 # [ 143.286157] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6529worker1 # [ 143.445337] nix-daemon[843]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6530worker1 # [ 143.458112] nix-daemon[843]: reaped child process 1836, status = succeeded6531worker1 # [ 143.607067] nix-daemon[843]: accepted connection from pid 1838, user nix-grpc-daemon (trusted)6532worker1 # [ 143.619228] nix-daemon[843]: reaped child process 1841, status = succeeded6533lb # [ 143.629825] niks3-server[1078]: 2026/09/20 09:01:38 INFO Received uploads request method=POST path=/api/pending_closures6534worker1 # [ 143.637317] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.815Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6535worker1 # [ 143.638895] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.816Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6536lb # [ 143.662785] niks3-server[1078]: 2026/09/20 09:01:38 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6537lb # [ 143.672475] niks3-server[1078]: 2026/09/20 09:01:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6538worker1 # [ 143.677646] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.855Z level=INFO msg="Uploading 1 narinfos"6539lb # [ 143.678554] niks3-server[1078]: 2026/09/20 09:01:38 INFO Signed narinfos id=60 count=16540lb # [ 143.682692] niks3-server[1078]: 2026/09/20 09:01:38 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6541lb # [ 143.693372] niks3-server[1078]: 2026/09/20 09:01:38 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6542lb # [ 143.699604] niks3-server[1078]: 2026/09/20 09:01:38 INFO Completed upload id=606543worker1 # [ 143.698758] nix-grpc-daemon[1582]: time=2026-09-20T09:01:38.876Z level=INFO msg="Upload complete. (402ms)"6544worker1 # [ 143.702301] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=7526545lb # [ 143.704447] niks3-server[1078]: 2026/09/20 09:01:38 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6546worker1 # [ 143.708201] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526547worker1 # [ 143.718403] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6548worker1 # [ 143.721862] nix-daemon[843]: reaped child process 1831, status = succeeded6549worker1 # [ 143.726723] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6550worker1 # [ 144.748133] nix-daemon[843]: reaped child process 1845, status = succeeded6551worker1 # [ 144.891396] nix-daemon[843]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)6552worker1 # [ 144.902524] nix-daemon[843]: reaped child process 1863, status = succeeded6553lb # [ 144.920425] niks3-server[1078]: 2026/09/20 09:01:39 INFO Received uploads request method=POST path=/api/pending_closures6554worker1 # [ 144.927911] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.105Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6555worker1 # [ 144.929481] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.107Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6556lb # [ 144.952461] niks3-server[1078]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6557lb # [ 144.965627] niks3-server[1078]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6558lb # [ 144.978576] niks3-server[1078]: 2026/09/20 09:01:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6559worker1 # [ 144.982702] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.160Z level=INFO msg="Uploading 1 narinfos"6560lb # [ 144.983844] niks3-server[1078]: 2026/09/20 09:01:39 INFO Signed narinfos id=61 count=16561lb # [ 144.987557] niks3-server[1078]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6562lb # [ 144.997573] niks3-server[1078]: 2026/09/20 09:01:39 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6563lb # [ 145.003064] niks3-server[1078]: 2026/09/20 09:01:39 INFO Completed upload id=616564lb # [ 145.004722] niks3-server[1078]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6565worker1 # [ 145.003530] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.181Z level=INFO msg="Upload complete. (269ms)"6566worker2 # [ 145.034819] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:40Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16567worker1 # [ 145.010546] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16568worker1 # [ 145.023350] nix-daemon[843]: reaped child process 1843, status = succeeded6569worker1 # [ 145.053192] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526570worker1 # [ 145.065729] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:393526571worker1 # [ 145.078314] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.256Z level=INFO msg="All 2 paths already cached"6572worker1 # [ 145.086472] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:393526573worker1 # [ 145.095356] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6574worker1 # [ 145.264603] nix-daemon[843]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6575worker1 # [ 145.277186] nix-daemon[843]: reaped child process 1870, status = succeeded6576worker1 # [ 145.437763] nix-daemon[843]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)6577worker1 # [ 145.449749] nix-daemon[843]: reaped child process 1875, status = succeeded6578lb # [ 145.466022] niks3-server[1078]: 2026/09/20 09:01:40 INFO Received uploads request method=POST path=/api/pending_closures6579worker1 # [ 145.470915] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.648Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6580worker1 # [ 145.472426] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.650Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6581lb # [ 145.484277] niks3-server[1078]: 2026/09/20 09:01:40 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6582lb # [ 145.487132] niks3-server[1078]: 2026/09/20 09:01:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6583lb # [ 145.489738] niks3-server[1078]: 2026/09/20 09:01:40 INFO Signed narinfos id=62 count=16584worker1 # [ 145.488969] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.667Z level=INFO msg="Uploading 1 narinfos"6585lb # [ 145.491261] niks3-server[1078]: 2026/09/20 09:01:40 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6586lb # [ 145.496720] niks3-server[1078]: 2026/09/20 09:01:40 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6587lb # [ 145.499076] niks3-server[1078]: 2026/09/20 09:01:40 INFO Completed upload id=626588worker1 # [ 145.498197] nix-grpc-daemon[1582]: time=2026-09-20T09:01:40.676Z level=INFO msg="Upload complete. (390ms)"6589worker1 # [ 145.500179] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=0 paths=1 nar_bytes_in=7526590lb # [ 145.501638] niks3-server[1078]: 2026/09/20 09:01:40 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6591worker1 # [ 145.503098] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:393526592worker1 # [ 145.507803] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6593worker1 # [ 145.512419] nix-daemon[843]: reaped child process 1865, status = succeeded6594worker1 # [ 145.517431] nix-daemon[843]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6595worker1 # [ 146.544150] nix-daemon[843]: reaped child process 1879, status = succeeded6596worker1 # [ 146.692679] nix-daemon[843]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6597worker1 # [ 146.705048] nix-daemon[843]: reaped child process 1897, status = succeeded6598lb # [ 146.721685] niks3-server[1078]: 2026/09/20 09:01:41 INFO Received uploads request method=POST path=/api/pending_closures6599worker1 # [ 146.726096] nix-grpc-daemon[1582]: time=2026-09-20T09:01:41.903Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6600worker1 # [ 146.727712] nix-grpc-daemon[1582]: time=2026-09-20T09:01:41.905Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6601lb # [ 146.746149] niks3-server[1078]: 2026/09/20 09:01:41 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6602lb # [ 146.749055] niks3-server[1078]: 2026/09/20 09:01:41 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6603lb # [ 146.751943] niks3-server[1078]: 2026/09/20 09:01:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6604lb # [ 146.753723] niks3-server[1078]: 2026/09/20 09:01:41 INFO Signed narinfos id=63 count=16605worker1 # [ 146.753027] nix-grpc-daemon[1582]: time=2026-09-20T09:01:41.930Z level=INFO msg="Uploading 1 narinfos"6606lb # [ 146.759401] niks3-server[1078]: 2026/09/20 09:01:41 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6607lb # [ 146.762185] niks3-server[1078]: 2026/09/20 09:01:41 INFO Completed upload id=636608worker1 # [ 146.762683] nix-grpc-daemon[1582]: time=2026-09-20T09:01:41.940Z level=INFO msg="Upload complete. (236ms)"6609lb # [ 146.764252] niks3-server[1078]: 2026/09/20 09:01:41 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6610lb # [ 146.766770] niks3-server[1078]: 2026/09/20 09:01:41 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6611worker1 # [ 146.766132] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39352 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16612worker1 # [ 146.771987] nix-daemon[843]: reaped child process 1877, status = succeeded6613client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.40 seconds)6614worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6615worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6616client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16617lb # [ 147.096984] envoy[969]: conn peer=[2001:db8:1::1]:50734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27042 tx=10656 ms=171316618worker2 # [ 147.137148] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:363946619worker2 # [ 147.143726] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946620worker2 # [ 147.160170] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:42Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06621client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.27 seconds)6622(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 17.73 seconds)6623subtest: low disk drains a worker and builds go to the other6624worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6625worker1 # [ 148.145282] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:43Z level=info event=unhealthy reason=min_free6626worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.03 seconds)6627worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6628worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.04 seconds)6629client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26630worker1 # [ 148.440248] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:393526631client # don't know how to build these paths:6632client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6633worker2 # [ 148.475392] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946634worker2 # [ 148.492806] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:43Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06635worker2 # [ 148.497691] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:43Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16636worker2 # [ 148.536907] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946637worker2 # [ 148.549100] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946638client # copying 1 paths to 'lb:50051'...6639client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6640worker2 # [ 148.560896] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363946641worker2 # [ 148.569685] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6642worker2 # [ 148.762315] nix-daemon[845]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)6643worker2 # [ 148.774154] nix-daemon[845]: reaped child process 1825, status = succeeded6644worker2 # [ 148.942320] nix-daemon[845]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6645worker2 # [ 148.954840] nix-daemon[845]: reaped child process 1830, status = succeeded6646lb # [ 148.943189] niks3-server[1078]: 2026/09/20 09:01:43 INFO Received uploads request method=POST path=/api/pending_closures6647worker2 # [ 148.976495] nix-grpc-daemon[1618]: time=2026-09-20T09:01:44.046Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6648worker2 # [ 148.977874] nix-grpc-daemon[1618]: time=2026-09-20T09:01:44.046Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6649lb # [ 148.972443] niks3-server[1078]: 2026/09/20 09:01:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6650lb # [ 148.979221] niks3-server[1078]: 2026/09/20 09:01:43 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6651worker2 # [ 149.010586] nix-grpc-daemon[1618]: time=2026-09-20T09:01:44.080Z level=INFO msg="Uploading 1 narinfos"6652lb # [ 148.986847] niks3-server[1078]: 2026/09/20 09:01:43 INFO Signed narinfos id=64 count=16653lb # [ 148.991559] niks3-server[1078]: 2026/09/20 09:01:43 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6654lb # [ 149.001906] niks3-server[1078]: 2026/09/20 09:01:43 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6655worker2 # [ 149.033287] nix-grpc-daemon[1618]: time=2026-09-20T09:01:44.103Z level=INFO msg="Upload complete. (449ms)"6656lb # [ 149.008270] niks3-server[1078]: 2026/09/20 09:01:43 INFO Completed upload id=646657worker2 # [ 149.035485] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=0 paths=1 nar_bytes_in=5126658worker2 # [ 149.038549] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946659lb # [ 149.013472] niks3-server[1078]: 2026/09/20 09:01:43 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6660worker2 # [ 149.044140] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6661worker2 # [ 149.048890] nix-daemon[845]: reaped child process 1820, status = succeeded6662client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6663client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6664worker2 # [ 149.053551] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6665client # farm-a> LOG-farm-a-drain6666worker2 # [ 150.067679] nix-daemon[845]: reaped child process 1834, status = succeeded6667worker2 # [ 150.219593] nix-daemon[845]: accepted connection from pid 1849, user nix-grpc-daemon (trusted)6668worker2 # [ 150.231729] nix-daemon[845]: reaped child process 1852, status = succeeded6669lb # [ 150.227236] niks3-server[1078]: 2026/09/20 09:01:44 INFO Received uploads request method=POST path=/api/pending_closures6670worker2 # [ 150.258463] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.328Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6671worker2 # [ 150.263667] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.328Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6672lb # [ 150.267498] niks3-server[1078]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6673lb # [ 150.272953] niks3-server[1078]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6674lb # [ 150.279277] niks3-server[1078]: 2026/09/20 09:01:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6675lb # [ 150.283951] niks3-server[1078]: 2026/09/20 09:01:44 INFO Signed narinfos id=65 count=16676worker2 # [ 150.311659] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.381Z level=INFO msg="Uploading 1 narinfos"6677lb # [ 150.293286] niks3-server[1078]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6678lb # [ 150.300822] niks3-server[1078]: 2026/09/20 09:01:44 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6679lb # [ 150.305841] niks3-server[1078]: 2026/09/20 09:01:44 INFO Completed upload id=656680worker2 # [ 150.330888] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.401Z level=INFO msg="Upload complete. (271ms)"6681lb # [ 150.310910] niks3-server[1078]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6682worker2 # [ 150.337608] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16683worker2 # [ 150.350059] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06684worker2 # [ 150.354626] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16685worker2 # [ 150.358160] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946686worker2 # [ 150.364247] nix-daemon[845]: reaped child process 1832, status = succeeded6687worker2 # [ 150.369347] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946688worker2 # [ 150.377231] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.447Z level=INFO msg="All 1 paths already cached"6689client # copying 1 paths to 'lb:50051'...6690worker2 # [ 150.382569] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363946691client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6692worker2 # [ 150.388221] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6693worker2 # [ 150.549440] nix-daemon[845]: accepted connection from pid 1858, user nix-grpc-daemon (trusted)6694worker2 # [ 150.561818] nix-daemon[845]: reaped child process 1861, status = succeeded6695worker2 # [ 150.723992] nix-daemon[845]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)6696worker2 # [ 150.735858] nix-daemon[845]: reaped child process 1866, status = succeeded6697lb # [ 150.726968] niks3-server[1078]: 2026/09/20 09:01:45 INFO Received uploads request method=POST path=/api/pending_closures6698worker2 # [ 150.757932] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.828Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6699worker2 # [ 150.759561] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.828Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6700lb # [ 150.741466] niks3-server[1078]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6701lb # [ 150.744361] niks3-server[1078]: 2026/09/20 09:01:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6702lb # [ 150.746042] niks3-server[1078]: 2026/09/20 09:01:45 INFO Signed narinfos id=66 count=16703worker2 # [ 150.772257] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.842Z level=INFO msg="Uploading 1 narinfos"6704lb # [ 150.750241] niks3-server[1078]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6705lb # [ 150.753821] niks3-server[1078]: 2026/09/20 09:01:45 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6706lb # [ 150.757309] niks3-server[1078]: 2026/09/20 09:01:45 INFO Completed upload id=666707worker2 # [ 150.783371] nix-grpc-daemon[1618]: time=2026-09-20T09:01:45.853Z level=INFO msg="Upload complete. (389ms)"6708lb # [ 150.759106] niks3-server[1078]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6709worker2 # [ 150.785609] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=0 paths=1 nar_bytes_in=6246710worker2 # [ 150.788589] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946711worker2 # [ 150.794069] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6712worker2 # [ 150.798072] nix-daemon[845]: reaped child process 1856, status = succeeded6713client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6714worker2 # [ 150.804092] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6715client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6716client # farm-b> LOG-farm-b-drain6717worker2 # [ 152.028745] nix-daemon[845]: reaped child process 1870, status = succeeded6718worker2 # [ 152.174335] nix-daemon[845]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)6719worker2 # [ 152.186821] nix-daemon[845]: reaped child process 1888, status = succeeded6720lb # [ 152.178918] niks3-server[1078]: 2026/09/20 09:01:46 INFO Received uploads request method=POST path=/api/pending_closures6721worker2 # [ 152.210028] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.280Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6722worker2 # [ 152.212053] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.282Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6723worker2 # [ 152.244183] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.314Z level=INFO msg="Uploading 1 narinfos"6724lb # [ 152.219517] niks3-server[1078]: 2026/09/20 09:01:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6725lb # [ 152.223592] niks3-server[1078]: 2026/09/20 09:01:46 INFO Signed narinfos id=67 count=16726lb # [ 152.239169] niks3-server[1078]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6727lb # [ 152.245427] niks3-server[1078]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6728lb # [ 152.255106] niks3-server[1078]: 2026/09/20 09:01:46 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6729lb # [ 152.258334] niks3-server[1078]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6730lb # [ 152.261097] niks3-server[1078]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6731lb # [ 152.263324] niks3-server[1078]: 2026/09/20 09:01:46 INFO Completed upload id=676732worker2 # [ 152.289444] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.359Z level=INFO msg="Upload complete. (278ms)"6733worker2 # [ 152.292310] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16734worker2 # [ 152.298725] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06735worker2 # [ 152.300733] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16736worker2 # [ 152.304916] nix-daemon[845]: reaped child process 1868, status = succeeded6737worker2 # [ 152.341725] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946738worker2 # [ 152.349816] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363946739worker2 # [ 152.358514] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.428Z level=INFO msg="All 2 paths already cached"6740client # copying 1 paths to 'lb:50051'...6741client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6742worker2 # [ 152.362943] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363946743worker2 # [ 152.367971] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6744worker2 # [ 152.518569] nix-daemon[845]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6745worker2 # [ 152.530513] nix-daemon[845]: reaped child process 1897, status = succeeded6746worker2 # [ 152.693712] nix-daemon[845]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6747worker2 # [ 152.705194] nix-daemon[845]: reaped child process 1902, status = succeeded6748lb # [ 152.697255] niks3-server[1078]: 2026/09/20 09:01:47 INFO Received uploads request method=POST path=/api/pending_closures6749worker2 # [ 152.729843] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.800Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6750worker2 # [ 152.731355] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.801Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6751lb # [ 152.727686] niks3-server[1078]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6752lb # [ 152.736869] niks3-server[1078]: 2026/09/20 09:01:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6753worker2 # [ 152.767188] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.837Z level=INFO msg="Uploading 1 narinfos"6754lb # [ 152.742504] niks3-server[1078]: 2026/09/20 09:01:47 INFO Signed narinfos id=68 count=16755lb # [ 152.748521] niks3-server[1078]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6756lb # [ 152.760891] niks3-server[1078]: 2026/09/20 09:01:47 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6757lb # [ 152.765406] niks3-server[1078]: 2026/09/20 09:01:47 INFO Completed upload id=686758worker2 # [ 152.790441] nix-grpc-daemon[1618]: time=2026-09-20T09:01:47.860Z level=INFO msg="Upload complete. (417ms)"6759lb # [ 152.768176] niks3-server[1078]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6760worker2 # [ 152.795131] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=0 paths=1 nar_bytes_in=7526761worker2 # [ 152.799861] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363946762worker2 # [ 152.810059] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6763worker2 # [ 152.813112] nix-daemon[845]: reaped child process 1892, status = succeeded6764client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6765worker2 # [ 152.818482] nix-daemon[845]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6766client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6767client # farm-top> LOG-farm-top-drain6768worker2 # [ 154.232281] nix-daemon[845]: reaped child process 1906, status = succeeded6769worker2 # [ 154.365070] nix-daemon[845]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)6770worker2 # [ 154.377503] nix-daemon[845]: reaped child process 1924, status = succeeded6771lb # [ 154.364404] niks3-server[1078]: 2026/09/20 09:01:49 INFO Received uploads request method=POST path=/api/pending_closures6772worker2 # [ 154.398868] nix-grpc-daemon[1618]: time=2026-09-20T09:01:49.469Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6773worker2 # [ 154.400407] nix-grpc-daemon[1618]: time=2026-09-20T09:01:49.470Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6774lb # [ 154.403961] niks3-server[1078]: 2026/09/20 09:01:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6775lb # [ 154.411434] niks3-server[1078]: 2026/09/20 09:01:49 INFO Signed narinfos id=69 count=16776worker2 # [ 154.439434] nix-grpc-daemon[1618]: time=2026-09-20T09:01:49.509Z level=INFO msg="Uploading 1 narinfos"6777lb # [ 154.422527] niks3-server[1078]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6778lb # [ 154.428172] niks3-server[1078]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6779lb # [ 154.434867] niks3-server[1078]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6780lb # [ 154.438914] niks3-server[1078]: 2026/09/20 09:01:49 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6781lb # [ 154.445368] niks3-server[1078]: 2026/09/20 09:01:49 INFO Completed upload id=696782worker2 # [ 154.470418] nix-grpc-daemon[1618]: time=2026-09-20T09:01:49.540Z level=INFO msg="Upload complete. (244ms)"6783lb # [ 154.447022] niks3-server[1078]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6784worker2 # [ 154.477408] nix-grpc-daemon[1546]: ts=2026-09-20T09:01:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36394 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16785worker2 # [ 154.489749] nix-daemon[845]: reaped child process 1904, status = succeeded6786client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.26 seconds)6787client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6788client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.23 seconds)6789worker1: must succeed: rm /nix/.rw-store/fill6790worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.14 seconds)6791worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6792worker1 # [ 155.148996] nix-grpc-daemon[1526]: ts=2026-09-20T09:01:50Z level=info event=healthy reason=min_free6793worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)6794(finished: subtest: low disk drains a worker and builds go to the other, in 8.86 seconds)6795(finished: run the VM test script, in 156.92 seconds)6796test script finished in 157.15s6797cleanup6798kill QemuMachine (pid 50)6799client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6800kill QemuMachine (pid 49)6801lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6802kill QemuMachine (pid 52)6803worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6804kill QemuMachine (pid 51)6805worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6806(finished: cleanup, in 1.15 seconds)6807additionally exposed symbols:6808 client, lb, worker1, worker2,6809 vlan1,6810 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh