vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #193
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.Orh1SGj5MK', fmt=raw size=107374182414worker2: QEMU running (pid 52)15worker2 # mke2fs 1.47.4 (6-Mar-2025)16worker1 # Disk image does not exist, creating the virtualisation disk image...17worker1: QEMU running (pid 51)18lb # Disk image does not exist, creating the virtualisation disk image...19lb: QEMU running (pid 50)20worker1 # Formatting '/build/vm-state-worker1/tmp.pzXFecSypj', fmt=raw size=107374182421lb # Formatting '/build/vm-state-lb/tmp.QSNGN2uo1U', fmt=raw size=107374182422worker2 # Discarding device blocks: 0/262144 done23worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes24worker1 # mke2fs 1.47.4 (6-Mar-2025)25client: QEMU running (pid 49)26worker2 # Filesystem UUID: 034e31ae-3077-4bf6-880e-69a18160b76a27worker2 # Superblock backups stored on blocks:28worker2 # 32768, 98304, 163840, 22937629client # Disk image does not exist, creating the virtualisation disk image...30worker1 # Discarding device blocks: 0/262144 done31lb # mke2fs 1.47.4 (6-Mar-2025)32worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes33lb # Discarding device blocks: 0/262144 done34lb # Creating filesystem with 262144 4k blocks and 65536 inodes35client # Formatting '/build/vm-state-client/tmp.r70aXig55G', fmt=raw size=107374182436worker1 # Filesystem UUID: 7460d196-4661-4cd7-8d5b-2aae57dad26337lb # Filesystem UUID: da382df9-2ff9-4cc7-9c81-67daf5bba3da38lb # Superblock backups stored on blocks:39worker1 # Superblock backups stored on blocks:40worker1 # 32768, 98304, 163840, 22937641worker1 # 42lb # 32768, 98304, 163840, 22937643client # mke2fs 1.47.4 (6-Mar-2025)44worker2 # 45lb # 46client # Discarding device blocks: 0/262144 done47worker2 # Allocating group tables: 0/8 done48lb # Allocating group tables: 0/8 done49client # Creating filesystem with 262144 4k blocks and 65536 inodes50worker2 # Writing inode tables: 0/8 done51lb # Writing inode tables: 0/8 done52client # Filesystem UUID: cadae910-52e3-4b4c-938e-1b1cd59baa4753worker2 # Creating journal (8192 blocks): done54lb # Creating journal (8192 blocks): done55client # Superblock backups stored on blocks:56worker2 # Writing superblocks and filesystem accounting information: 0/8 done57lb # Writing superblocks and filesystem accounting information: 0/8 done58client # 32768, 98304, 163840, 22937659worker2 # 60lb # 61client # 62worker2 # Virtualisation disk image created.63lb # Virtualisation disk image created.64client # Allocating group tables: 0/8 done65(finished: start all VMs, in 0.31 seconds)66worker1 # Allocating group tables: 0/8 done67client: waiting for unit network-addresses-eth1.service68worker1 # Writing inode tables: 0/8 done69client: waiting for the VM to finish booting70worker1 # Creating journal (8192 blocks): done71client # Writing inode tables: 0/8 done72worker1 # Writing superblocks and filesystem accounting information: 0/8 done73client # Creating journal (8192 blocks): done74worker1 # 75client # Writing superblocks and filesystem accounting information: 0/8 done76worker1 # Virtualisation disk image created.77client # 78client # Virtualisation disk image created.79lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83lb # 84lb # 85lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87lb # 88lb # 89lb # 90lb # 91worker1 # 92worker1 # 93client # 94client # 95lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0096worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0097client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0098worker2 # 99worker2 # 100worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...101worker1 # 102worker1 # 103lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...104lb # 105worker1 # 106lb # 107worker1 # 108client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...109client # 110client # 111client # 112client # 113worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00114worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00115client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117worker1 # 118worker1 # 119worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...120worker2 # 121worker2 # 122worker2 # 123worker2 # 124worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00125client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126client # 127client # 128worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker2 # 130worker2 # 131lb # Booting from ROM...132client # Booting from ROM...133worker1 # Booting from ROM...134worker2 # Booting from ROM...135lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0137lb # [ 0.000000] BIOS-provided physical RAM map:138lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026147lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved148lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved149lb # [ 0.000000] NX (Execute Disable) protection: active150lb # [ 0.000000] APIC: Static calls initialized151lb # [ 0.000000] SMBIOS 2.8 present.152client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test/init regInfo=/nix/store/ga13j1l0d415h3bpr3ka2ms3njmadv8i-closure-info/registration console=ttyS0,115200n8 console=tty0153lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014154client # [ 0.000000] BIOS-provided physical RAM map:155lb # [ 0.000000] DMI: Memory slots populated: 1/1156lb # [ 0.000000] Hypervisor detected: KVM157client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable158lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000159client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved160lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00161client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved162lb # [ 0.000000] kvm-clock: using sched offset of 465976951 cycles163worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026164client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable165lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns166client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved167lb # [ 0.000005] tsc: Detected 2400.012 MHz processor168client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved169lb # [ 0.000820] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000170client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved171lb # [ 0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs172client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved173lb # [ 0.000849] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT174worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cvm264rzy1nx14cgszavwlrs6nmw045n-nixos-system-worker1-test/init regInfo=/nix/store/f9xrwjicz9bz3qrnz2aff9rca7lxyw59-closure-info/registration console=ttyS0,115200n8 console=tty0175lb # [ 0.002748] found SMP MP-table at [mem 0x000f5450-0x000f545f]176client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved177worker1 # [ 0.000000] BIOS-provided physical RAM map:178lb # [ 0.002763] Using GB pages for direct mapping179client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved180worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable181lb # [ 0.002864] RAMDISK: [mem 0x5e367000-0x5ffcffff]182client # [ 0.000000] NX (Execute Disable) protection: active183worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026184lb # [ 0.002886] ACPI: Early table checksum verification disabled185worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved186client # [ 0.000000] APIC: Static calls initialized187client # [ 0.000000] SMBIOS 2.8 present.188lb # [ 0.002888] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )189worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved190lb # [ 0.002892] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)191worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable192client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014193client # [ 0.000000] DMI: Memory slots populated: 1/1194worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved195lb # [ 0.002896] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)196client # [ 0.000000] Hypervisor detected: KVM197worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/57ijlgb5pbrg6v3ibmx76xk5q4mbi3ms-nixos-system-worker2-test/init regInfo=/nix/store/3jpj8nbxwbgk3r7k801iicbpvwlbqc9f-closure-info/registration console=ttyS0,115200n8 console=tty0198worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved199client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000200lb # [ 0.002903] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)201worker2 # [ 0.000000] BIOS-provided physical RAM map:202client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00203worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved204lb # [ 0.002905] ACPI: FACS 0x000000005FFE0000 000040205worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable206client # [ 0.000000] kvm-clock: using sched offset of 474354258 cycles207worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved208lb # [ 0.002907] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)209worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved210worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved211client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns212worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved213lb # [ 0.002908] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)214client # [ 0.000004] tsc: Detected 2400.012 MHz processor215worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved216worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable217client # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000218lb # [ 0.002910] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)219worker1 # [ 0.000000] NX (Execute Disable) protection: active220worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved221worker1 # [ 0.000000] APIC: Static calls initialized222client # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs223lb # [ 0.002911] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)224worker1 # [ 0.000000] SMBIOS 2.8 present.225worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved226client # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT227lb # [ 0.002913] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]228worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved229worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014230client # [ 0.002779] found SMP MP-table at [mem 0x000f5450-0x000f545f]231lb # [ 0.002914] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]232worker1 # [ 0.000000] DMI: Memory slots populated: 1/1233client # [ 0.002789] Using GB pages for direct mapping234worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved235worker1 # [ 0.000000] Hypervisor detected: KVM236lb # [ 0.002914] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]237client # [ 0.002951] RAMDISK: [mem 0x5e366000-0x5ffcffff]238worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved239worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000240client # [ 0.002958] ACPI: Early table checksum verification disabled241lb # [ 0.002915] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]242worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved243worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00244client # [ 0.002961] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )245worker2 # [ 0.000000] NX (Execute Disable) protection: active246lb # [ 0.002915] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]247worker1 # [ 0.000000] kvm-clock: using sched offset of 480371629 cycles248worker2 # [ 0.000000] APIC: Static calls initialized249worker2 # [ 0.000000] SMBIOS 2.8 present.250client # [ 0.002965] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)251lb # [ 0.002916] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]252worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns253lb # [ 0.002916] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]254client # [ 0.002969] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)255worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor256worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014257lb # [ 0.003142] No NUMA configuration found258worker2 # [ 0.000000] DMI: Memory slots populated: 1/1259worker1 # [ 0.000822] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000260client # [ 0.002977] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)261lb # [ 0.003143] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]262worker2 # [ 0.000000] Hypervisor detected: KVM263client # [ 0.002979] ACPI: FACS 0x000000005FFE0000 000040264worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000265lb # [ 0.003145] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]266worker1 # [ 0.000854] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs267lb # [ 0.005333] Zone ranges:268worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00269client # [ 0.002980] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)270worker1 # [ 0.000856] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT271lb # [ 0.005337] DMA [mem 0x0000000000001000-0x0000000000ffffff]272worker2 # [ 0.000000] kvm-clock: using sched offset of 471680971 cycles273worker1 # [ 0.002777] found SMP MP-table at [mem 0x000f5450-0x000f545f]274lb # [ 0.005341] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]275client # [ 0.002982] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)276worker1 # [ 0.002788] Using GB pages for direct mapping277lb # [ 0.005343] Normal empty278lb # [ 0.005343] Device empty279worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns280worker1 # [ 0.002894] RAMDISK: [mem 0x5e367000-0x5ffcffff]281client # [ 0.002984] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)282lb # [ 0.005344] Movable zone start for each node283worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor284worker1 # [ 0.002903] ACPI: Early table checksum verification disabled285lb # [ 0.005344] Early memory node ranges286worker2 # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000287client # [ 0.002985] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)288worker1 # [ 0.002905] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )289lb # [ 0.005345] node 0: [mem 0x0000000000001000-0x000000000009efff]290worker2 # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs291client # [ 0.002986] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]292lb # [ 0.005346] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]293worker1 # [ 0.002910] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)294worker2 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT295client # [ 0.002987] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]296lb # [ 0.005347] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]297worker2 # [ 0.002759] found SMP MP-table at [mem 0x000f5450-0x000f545f]298worker1 # [ 0.002914] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)299client # [ 0.002988] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]300lb # [ 0.005364] On node 0, zone DMA: 1 pages in unavailable ranges301worker2 # [ 0.002771] Using GB pages for direct mapping302worker2 # [ 0.002858] RAMDISK: [mem 0x5e367000-0x5ffcffff]303client # [ 0.002988] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]304lb # [ 0.005627] On node 0, zone DMA: 97 pages in unavailable ranges305worker1 # [ 0.002921] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)306worker1 # [ 0.002923] ACPI: FACS 0x000000005FFE0000 000040307worker2 # [ 0.002867] ACPI: Early table checksum verification disabled308lb # [ 0.030444] On node 0, zone DMA32: 40 pages in unavailable ranges309client # [ 0.002989] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]310lb # [ 0.030946] ACPI: PM-Timer IO Port: 0x608311worker2 # [ 0.002869] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )312worker1 # [ 0.002925] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)313client # [ 0.002989] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]314lb # [ 0.030957] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])315worker2 # [ 0.002874] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)316client # [ 0.002990] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]317lb # [ 0.030983] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23318worker1 # [ 0.002926] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)319client # [ 0.003215] No NUMA configuration found320worker2 # [ 0.002878] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)321lb # [ 0.030986] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)322worker1 # [ 0.002928] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)323client # [ 0.003216] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]324lb # [ 0.030987] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)325worker2 # [ 0.002885] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)326client # [ 0.003218] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]327worker1 # [ 0.002929] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)328client # [ 0.005300] Zone ranges:329worker2 # [ 0.002887] ACPI: FACS 0x000000005FFE0000 000040330lb # [ 0.030988] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)331worker1 # [ 0.002931] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]332client # [ 0.005300] DMA [mem 0x0000000000001000-0x0000000000ffffff]333lb # [ 0.030989] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)334worker2 # [ 0.002888] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)335client # [ 0.005302] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]336worker1 # [ 0.002932] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]337lb # [ 0.030990] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)338client # [ 0.005303] Normal empty339worker2 # [ 0.002890] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)340client # [ 0.005304] Device empty341lb # [ 0.030992] ACPI: Using ACPI (MADT) for SMP configuration information342worker1 # [ 0.002932] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]343client # [ 0.005304] Movable zone start for each node344lb # [ 0.030993] ACPI: HPET id: 0x8086a201 base: 0xfed00000345worker2 # [ 0.002892] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)346client # [ 0.005305] Early memory node ranges347lb # [ 0.030996] TSC deadline timer available348worker1 # [ 0.002933] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]349client # [ 0.005305] node 0: [mem 0x0000000000001000-0x000000000009efff]350lb # [ 0.031000] CPU topo: Max. logical packages: 1351worker1 # [ 0.002933] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]352worker2 # [ 0.002893] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)353lb # [ 0.031001] CPU topo: Max. logical dies: 1354client # [ 0.005307] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]355worker2 # [ 0.002894] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]356lb # [ 0.031002] CPU topo: Max. dies per package: 1357worker1 # [ 0.002934] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]358client # [ 0.005308] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]359lb # [ 0.031005] CPU topo: Max. threads per core: 1360worker2 # [ 0.002896] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]361worker1 # [ 0.002934] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]362lb # [ 0.031006] CPU topo: Num. cores per package: 1363client # [ 0.005325] On node 0, zone DMA: 1 pages in unavailable ranges364worker1 # [ 0.003194] No NUMA configuration found365worker2 # [ 0.002896] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]366lb # [ 0.031006] CPU topo: Num. threads per package: 1367client # [ 0.005572] On node 0, zone DMA: 97 pages in unavailable ranges368worker1 # [ 0.003195] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]369worker2 # [ 0.002897] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]370lb # [ 0.031006] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs371client # [ 0.030547] On node 0, zone DMA32: 40 pages in unavailable ranges372worker1 # [ 0.003197] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]373client # [ 0.031048] ACPI: PM-Timer IO Port: 0x608374lb # [ 0.031023] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()375worker1 # [ 0.005370] Zone ranges:376worker2 # [ 0.002897] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]377client # [ 0.031059] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])378worker2 # [ 0.002898] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]379worker1 # [ 0.005371] DMA [mem 0x0000000000001000-0x0000000000ffffff]380lb # [ 0.031054] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]381client # [ 0.031084] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23382worker1 # [ 0.005373] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]383worker2 # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]384lb # [ 0.031056] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]385worker1 # [ 0.005374] Normal empty386worker2 # [ 0.003135] No NUMA configuration found387client # [ 0.031087] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)388worker1 # [ 0.005375] Device empty389lb # [ 0.031057] [mem 0x60000000-0xafffffff] available for PCI devices390worker2 # [ 0.003136] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]391worker1 # [ 0.005375] Movable zone start for each node392lb # [ 0.031059] Booting paravirtualized kernel on KVM393client # [ 0.031088] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)394worker1 # [ 0.005376] Early memory node ranges395worker2 # [ 0.003139] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]396client # [ 0.031090] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)397worker2 # [ 0.005571] Zone ranges:398lb # [ 0.031061] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns399worker1 # [ 0.005376] node 0: [mem 0x0000000000001000-0x000000000009efff]400worker2 # [ 0.005572] DMA [mem 0x0000000000001000-0x0000000000ffffff]401client # [ 0.031091] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)402worker1 # [ 0.005377] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]403lb # [ 0.035512] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1404worker2 # [ 0.005573] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]405client # [ 0.031091] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)406worker2 # [ 0.005574] Normal empty407worker1 # [ 0.005378] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]408lb # [ 0.037531] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152409worker2 # [ 0.005575] Device empty410client # [ 0.031094] ACPI: Using ACPI (MADT) for SMP configuration information411worker1 # [ 0.005397] On node 0, zone DMA: 1 pages in unavailable ranges412worker2 # [ 0.005575] Movable zone start for each node413lb # [ 0.037569] kvm-guest: PV spinlocks disabled, single CPU414client # [ 0.031095] ACPI: HPET id: 0x8086a201 base: 0xfed00000415worker2 # [ 0.005576] Early memory node ranges416worker1 # [ 0.005656] On node 0, zone DMA: 97 pages in unavailable ranges417client # [ 0.031099] TSC deadline timer available418worker2 # [ 0.005577] node 0: [mem 0x0000000000001000-0x000000000009efff]419client # [ 0.031103] CPU topo: Max. logical packages: 1420worker1 # [ 0.031370] On node 0, zone DMA32: 40 pages in unavailable ranges421worker2 # [ 0.005578] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]422worker1 # [ 0.031912] ACPI: PM-Timer IO Port: 0x608423client # [ 0.031104] CPU topo: Max. logical dies: 1424client # [ 0.031104] CPU topo: Max. dies per package: 1425worker1 # [ 0.031923] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])426worker2 # [ 0.005579] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]427client # [ 0.031108] CPU topo: Max. threads per core: 1428worker2 # [ 0.005600] On node 0, zone DMA: 1 pages in unavailable ranges429worker1 # [ 0.031950] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23430lb # [ 0.037571] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0431client # [ 0.031108] CPU topo: Num. cores per package: 1432worker2 # [ 0.005888] On node 0, zone DMA: 97 pages in unavailable ranges433worker1 # [ 0.031952] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)434client # [ 0.031109] CPU topo: Num. threads per package: 1435worker2 # [ 0.033105] On node 0, zone DMA32: 40 pages in unavailable ranges436client # [ 0.031109] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs437worker1 # [ 0.031954] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)438lb # [ 0.037658] Unknown kernel command line parameters "regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration", will be passed to user space.439worker2 # [ 0.033582] ACPI: PM-Timer IO Port: 0x608440lb # [ 0.037671] random: crng init done441client # [ 0.031127] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()442worker1 # [ 0.031955] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)443worker2 # [ 0.033593] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])444lb # [ 0.037671] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes445worker1 # [ 0.031956] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)446worker2 # [ 0.033623] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23447client # [ 0.031157] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]448lb # [ 0.039653] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)449worker2 # [ 0.033625] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)450worker1 # [ 0.031957] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)451client # [ 0.031159] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]452worker2 # [ 0.033627] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)453worker1 # [ 0.031959] ACPI: Using ACPI (MADT) for SMP configuration information454client # [ 0.031160] [mem 0x60000000-0xafffffff] available for PCI devices455lb # [ 0.040670] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)456lb # [ 0.040700] Fallback order for Node 0: 0457client # [ 0.031162] Booting paravirtualized kernel on KVM458worker1 # [ 0.031960] ACPI: HPET id: 0x8086a201 base: 0xfed00000459worker2 # [ 0.033628] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)460worker1 # [ 0.031963] TSC deadline timer available461lb # [ 0.040702] Built 1 zonelists, mobility grouping on. Total pages: 393078462worker2 # [ 0.033629] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)463lb # [ 0.040703] Policy zone: DMA32464worker1 # [ 0.031967] CPU topo: Max. logical packages: 1465client # [ 0.031165] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns466worker1 # [ 0.031968] CPU topo: Max. logical dies: 1467worker2 # [ 0.033630] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)468lb # [ 0.043166] mem auto-init: stack:all(zero), heap alloc:on, heap free:off469client # [ 0.035590] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1470worker1 # [ 0.031969] CPU topo: Max. dies per package: 1471worker2 # [ 0.033632] ACPI: Using ACPI (MADT) for SMP configuration information472lb # [ 0.046064] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1473worker1 # [ 0.031972] CPU topo: Max. threads per core: 1474client # [ 0.037677] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152475worker2 # [ 0.033633] ACPI: HPET id: 0x8086a201 base: 0xfed00000476lb # [ 0.049192] allocated 3145728 bytes of page_ext477worker1 # [ 0.031973] CPU topo: Num. cores per package: 1478worker2 # [ 0.033637] TSC deadline timer available479lb # [ 0.058970] ftrace: allocating 48731 entries in 192 pages480client # [ 0.037714] kvm-guest: PV spinlocks disabled, single CPU481worker1 # [ 0.031973] CPU topo: Num. threads per package: 1482worker2 # [ 0.033642] CPU topo: Max. logical packages: 1483lb # [ 0.058972] ftrace: allocated 192 pages with 2 groups484worker2 # [ 0.033642] CPU topo: Max. logical dies: 1485lb # [ 0.059789] Dynamic Preempt: lazy486worker1 # [ 0.031973] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs487worker2 # [ 0.033643] CPU topo: Max. dies per package: 1488lb # [ 0.059911] rcu: Preemptible hierarchical RCU implementation.489worker1 # [ 0.031991] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()490worker2 # [ 0.033646] CPU topo: Max. threads per core: 1491lb # [ 0.059912] rcu: RCU event tracing is enabled.492worker2 # [ 0.033647] CPU topo: Num. cores per package: 1493worker1 # [ 0.032020] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]494lb # [ 0.059913] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.495worker2 # [ 0.033647] CPU topo: Num. threads per package: 1496lb # [ 0.059914] Trampoline variant of Tasks RCU enabled.497client # [ 0.037716] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test/init regInfo=/nix/store/ga13j1l0d415h3bpr3ka2ms3njmadv8i-closure-info/registration console=ttyS0,115200n8 console=tty0498worker1 # [ 0.032022] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]499worker2 # [ 0.033648] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs500lb # [ 0.059915] Rude variant of Tasks RCU enabled.501worker1 # [ 0.032023] [mem 0x60000000-0xafffffff] available for PCI devices502worker2 # [ 0.033667] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()503lb # [ 0.059915] Tracing variant of Tasks RCU enabled.504worker1 # [ 0.032025] Booting paravirtualized kernel on KVM505worker2 # [ 0.033700] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]506client # [ 0.037816] Unknown kernel command line parameters "regInfo=/nix/store/ga13j1l0d415h3bpr3ka2ms3njmadv8i-closure-info/registration", will be passed to user space.507lb # [ 0.059916] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.508client # [ 0.037829] random: crng init done509lb # [ 0.059916] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1510worker2 # [ 0.033702] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]511worker1 # [ 0.032027] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns512client # [ 0.037830] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes513worker2 # [ 0.033703] [mem 0x60000000-0xafffffff] available for PCI devices514lb # [ 0.059930] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.515worker1 # [ 0.036523] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1516worker2 # [ 0.033704] Booting paravirtualized kernel on KVM517client # [ 0.039834] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)518worker1 # [ 0.038617] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152519lb # [ 0.059932] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.520client # [ 0.040974] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)521worker1 # [ 0.038658] kvm-guest: PV spinlocks disabled, single CPU522worker2 # [ 0.033707] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns523client # [ 0.041005] Fallback order for Node 0: 0524lb # [ 0.059933] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.525worker2 # [ 0.038155] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1526client # [ 0.041007] Built 1 zonelists, mobility grouping on. Total pages: 393078527lb # [ 0.064326] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16528client # [ 0.041008] Policy zone: DMA32529worker2 # [ 0.040345] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152530lb # [ 0.064581] rcu: srcu_init: Setting srcu_struct sizes based on contention.531client # [ 0.043359] mem auto-init: stack:all(zero), heap alloc:on, heap free:off532worker2 # [ 0.040390] kvm-guest: PV spinlocks disabled, single CPU533lb # [ 0.064587] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns534client # [ 0.046359] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1535client # [ 0.049478] allocated 3145728 bytes of page_ext536worker1 # [ 0.038659] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cvm264rzy1nx14cgszavwlrs6nmw045n-nixos-system-worker1-test/init regInfo=/nix/store/f9xrwjicz9bz3qrnz2aff9rca7lxyw59-closure-info/registration console=ttyS0,115200n8 console=tty0537client # [ 0.059304] ftrace: allocating 48731 entries in 192 pages538lb # [ 0.064689] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)539lb # [ 0.068202] Console: colour VGA+ 80x25540client # [ 0.059305] ftrace: allocated 192 pages with 2 groups541client # [ 0.060100] Dynamic Preempt: lazy542lb # [ 0.068205] printk: legacy console [tty0] enabled543worker1 # [ 0.038749] Unknown kernel command line parameters "regInfo=/nix/store/f9xrwjicz9bz3qrnz2aff9rca7lxyw59-closure-info/registration", will be passed to user space.544lb # [ 0.097799] printk: legacy console [ttyS0] enabled545client # [ 0.060223] rcu: Preemptible hierarchical RCU implementation.546worker2 # [ 0.040391] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/57ijlgb5pbrg6v3ibmx76xk5q4mbi3ms-nixos-system-worker2-test/init regInfo=/nix/store/3jpj8nbxwbgk3r7k801iicbpvwlbqc9f-closure-info/registration console=ttyS0,115200n8 console=tty0547worker1 # [ 0.038762] random: crng init done548client # [ 0.060224] rcu: RCU event tracing is enabled.549lb # [ 0.196751] ACPI: Core revision 20250807550worker1 # [ 0.038763] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes551client # [ 0.060225] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.552worker2 # [ 0.040486] Unknown kernel command line parameters "regInfo=/nix/store/3jpj8nbxwbgk3r7k801iicbpvwlbqc9f-closure-info/registration", will be passed to user space.553worker1 # [ 0.040835] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)554client # [ 0.060226] Trampoline variant of Tasks RCU enabled.555worker2 # [ 0.040499] random: crng init done556lb # [ 0.197640] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns557client # [ 0.060227] Rude variant of Tasks RCU enabled.558worker1 # [ 0.041999] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)559worker2 # [ 0.040500] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes560client # [ 0.060227] Tracing variant of Tasks RCU enabled.561lb # [ 0.199204] APIC: Switch to symmetric I/O mode setup562worker1 # [ 0.042030] Fallback order for Node 0: 0563lb # [ 0.200124] x2apic enabled564worker2 # [ 0.042656] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)565client # [ 0.060228] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.566worker1 # [ 0.042032] Built 1 zonelists, mobility grouping on. Total pages: 393078567worker1 # [ 0.042033] Policy zone: DMA32568client # [ 0.060229] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1569worker2 # [ 0.043876] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)570lb # [ 0.200837] APIC: Switched APIC routing to: physical x2apic571worker1 # [ 0.044497] mem auto-init: stack:all(zero), heap alloc:on, heap free:off572worker2 # [ 0.043907] Fallback order for Node 0: 0573client # [ 0.060237] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.574worker1 # [ 0.047542] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1575worker2 # [ 0.043910] Built 1 zonelists, mobility grouping on. Total pages: 393078576worker2 # [ 0.043911] Policy zone: DMA32577worker1 # [ 0.050673] allocated 3145728 bytes of page_ext578lb # [ 0.202623] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1579client # [ 0.060239] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.580worker1 # [ 0.060409] ftrace: allocating 48731 entries in 192 pages581worker2 # [ 0.046372] mem auto-init: stack:all(zero), heap alloc:on, heap free:off582worker1 # [ 0.060411] ftrace: allocated 192 pages with 2 groups583client # [ 0.060240] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.584worker2 # [ 0.049582] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1585worker1 # [ 0.061242] Dynamic Preempt: lazy586lb # [ 0.203587] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns587worker2 # [ 0.052841] allocated 3145728 bytes of page_ext588client # [ 0.064713] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16589worker1 # [ 0.061348] rcu: Preemptible hierarchical RCU implementation.590worker2 # [ 0.062690] ftrace: allocating 48731 entries in 192 pages591client # [ 0.064995] rcu: srcu_init: Setting srcu_struct sizes based on contention.592worker1 # [ 0.061349] rcu: RCU event tracing is enabled.593lb # [ 0.205190] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)594worker2 # [ 0.062692] ftrace: allocated 192 pages with 2 groups595worker2 # [ 0.063533] Dynamic Preempt: lazy596worker1 # [ 0.061349] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.597client # [ 0.065001] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns598lb # [ 0.207272] x86/cpu: User Mode Instruction Prevention (UMIP) activated599worker2 # [ 0.063662] rcu: Preemptible hierarchical RCU implementation.600worker1 # [ 0.061351] Trampoline variant of Tasks RCU enabled.601worker2 # [ 0.063663] rcu: RCU event tracing is enabled.602worker1 # [ 0.061351] Rude variant of Tasks RCU enabled.603lb # [ 0.208316] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127604client # [ 0.065107] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)605worker2 # [ 0.063663] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.606worker1 # [ 0.061351] Tracing variant of Tasks RCU enabled.607client # [ 0.068664] Console: colour VGA+ 80x25608lb # [ 0.209188] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0609worker2 # [ 0.063665] Trampoline variant of Tasks RCU enabled.610client # [ 0.068667] printk: legacy console [tty0] enabled611worker1 # [ 0.061352] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.612worker2 # [ 0.063666] Rude variant of Tasks RCU enabled.613client # [ 0.099822] printk: legacy console [ttyS0] enabled614worker2 # [ 0.063666] Tracing variant of Tasks RCU enabled.615worker1 # [ 0.061353] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1616client # [ 0.200360] ACPI: Core revision 20250807617lb # [ 0.210190] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto618worker2 # [ 0.063667] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.619worker1 # [ 0.061370] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.620worker2 # [ 0.063667] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1621lb # [ 0.211187] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl622client # [ 0.201253] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns623worker1 # [ 0.061371] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.624worker2 # [ 0.063719] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.625lb # [ 0.212187] Transient Scheduler Attacks: Vulnerable: No microcode626client # [ 0.202824] APIC: Switch to symmetric I/O mode setup627worker1 # [ 0.061372] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.628client # [ 0.203824] x2apic enabled629lb # [ 0.213187] Spectre V2 : Mitigation: Enhanced / Automatic IBRS630worker2 # [ 0.063721] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.631worker1 # [ 0.065915] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16632lb # [ 0.214187] Speculative Return Stack Overflow: Mitigation: Safe RET633client # [ 0.204574] APIC: Switched APIC routing to: physical x2apic634worker2 # [ 0.063722] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.635worker1 # [ 0.066188] rcu: srcu_init: Setting srcu_struct sizes based on contention.636worker2 # [ 0.068224] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16637worker1 # [ 0.066194] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns638worker2 # [ 0.068673] rcu: srcu_init: Setting srcu_struct sizes based on contention.639client # [ 0.206514] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1640worker1 # [ 0.066302] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)641worker2 # [ 0.068679] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns642worker1 # [ 0.070289] Console: colour VGA+ 80x25643client # [ 0.207516] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns644worker1 # [ 0.070293] printk: legacy console [tty0] enabled645lb # [ 0.215187] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization646worker2 # [ 0.068782] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)647worker1 # [ 0.102072] printk: legacy console [ttyS0] enabled648worker2 # [ 0.072317] Console: colour VGA+ 80x25649lb # [ 0.217195] Spectre V2 : Enabling IBPB for BPF650client # [ 0.209209] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)651worker2 # [ 0.072320] printk: legacy console [tty0] enabled652worker1 # [ 0.204451] ACPI: Core revision 20250807653worker2 # [ 0.101979] printk: legacy console [ttyS0] enabled654lb # [ 0.218188] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier655client # [ 0.210299] x86/cpu: User Mode Instruction Prevention (UMIP) activated656worker2 # [ 0.199695] ACPI: Core revision 20250807657lb # [ 0.219187] active return thunk: srso_alias_return_thunk658worker1 # [ 0.205400] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns659client # [ 0.212285] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127660worker1 # [ 0.207030] APIC: Switch to symmetric I/O mode setup661lb # [ 0.220208] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'662worker2 # [ 0.200577] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns663client # [ 0.213206] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0664worker1 # [ 0.208040] x2apic enabled665lb # [ 0.221187] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'666worker2 # [ 0.202132] APIC: Switch to symmetric I/O mode setup667worker2 # [ 0.203141] x2apic enabled668worker1 # [ 0.208803] APIC: Switched APIC routing to: physical x2apic669lb # [ 0.222187] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'670client # [ 0.214210] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto671worker2 # [ 0.203918] APIC: Switched APIC routing to: physical x2apic672lb # [ 0.223187] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'673client # [ 0.215207] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl674worker1 # [ 0.210711] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1675lb # [ 0.224187] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'676client # [ 0.217207] Transient Scheduler Attacks: Vulnerable: No microcode677worker2 # [ 0.205839] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1678lb # [ 0.225187] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'679worker1 # [ 0.211741] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns680client # [ 0.218206] Spectre V2 : Mitigation: Enhanced / Automatic IBRS681lb # [ 0.226187] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'682client # [ 0.219207] Speculative Return Stack Overflow: Mitigation: Safe RET683worker2 # [ 0.206843] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns684worker1 # [ 0.213426] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)685lb # [ 0.227187] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256686worker2 # [ 0.208486] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)687worker1 # [ 0.214519] x86/cpu: User Mode Instruction Prevention (UMIP) activated688lb # [ 0.228953] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64689worker2 # [ 0.209569] x86/cpu: User Mode Instruction Prevention (UMIP) activated690worker1 # [ 0.216537] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127691lb # [ 0.229925] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512692worker2 # [ 0.211389] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127693worker1 # [ 0.217423] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0694lb # [ 0.230911] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024695client # [ 0.220206] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization696worker2 # [ 0.212161] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0697lb # [ 0.231186] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8698client # [ 0.222215] Spectre V2 : Enabling IBPB for BPF699worker1 # [ 0.218426] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto700lb # [ 0.232186] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.701worker2 # [ 0.213245] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto702client # [ 0.223207] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier703worker1 # [ 0.219423] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl704client # [ 0.224207] active return thunk: srso_alias_return_thunk705worker2 # [ 0.214484] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl706worker1 # [ 0.221424] Transient Scheduler Attacks: Vulnerable: No microcode707client # [ 0.225230] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'708worker2 # [ 0.215484] Transient Scheduler Attacks: Vulnerable: No microcode709worker1 # [ 0.222423] Spectre V2 : Mitigation: Enhanced / Automatic IBRS710client # [ 0.226207] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'711worker2 # [ 0.216483] Spectre V2 : Mitigation: Enhanced / Automatic IBRS712worker1 # [ 0.223423] Speculative Return Stack Overflow: Mitigation: Safe RET713client # [ 0.227206] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'714worker2 # [ 0.217483] Speculative Return Stack Overflow: Mitigation: Safe RET715client # [ 0.228991] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'716client # [ 0.230032] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'717client # [ 0.231208] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'718worker1 # [ 0.224423] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization719worker2 # [ 0.218484] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization720worker1 # [ 0.226431] Spectre V2 : Enabling IBPB for BPF721client # [ 0.232208] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'722worker2 # [ 0.220491] Spectre V2 : Enabling IBPB for BPF723worker1 # [ 0.227424] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier724client # [ 0.233209] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256725worker2 # [ 0.221252] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier726worker1 # [ 0.228424] active return thunk: srso_alias_return_thunk727worker2 # [ 0.222484] active return thunk: srso_alias_return_thunk728client # [ 0.235025] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64729worker1 # [ 0.230106] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'730worker2 # [ 0.223505] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'731client # [ 0.236209] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512732worker1 # [ 0.231423] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'733worker2 # [ 0.224483] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'734client # [ 0.237208] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024735worker1 # [ 0.232424] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'736worker2 # [ 0.225483] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'737client # [ 0.238208] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8738worker1 # [ 0.233424] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'739worker2 # [ 0.226483] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'740worker1 # [ 0.234424] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'741worker2 # [ 0.227483] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'742client # [ 0.239208] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.743worker1 # [ 0.235423] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'744worker2 # [ 0.228483] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'745worker1 # [ 0.236424] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'746worker2 # [ 0.229484] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'747worker1 # [ 0.237424] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256748worker2 # [ 0.230484] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256749worker1 # [ 0.239153] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64750worker2 # [ 0.231483] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64751worker1 # [ 0.240163] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512752worker2 # [ 0.232483] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512753worker1 # [ 0.241156] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024754worker2 # [ 0.233483] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024755worker1 # [ 0.242183] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8756worker2 # [ 0.234483] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8757worker1 # [ 0.243155] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.758worker2 # [ 0.235483] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759lb # [ 0.266867] Freeing SMP alternatives memory: 44K760lb # [ 0.267191] pid_max: default: 32768 minimum: 301761lb # [ 0.268269] LSM: initializing lsm=capability,landlock,yama,bpf,ima762lb # [ 0.269348] landlock: Up and running.763lb # [ 0.270188] Yama: becoming mindful.764lb # [ 0.271400] LSM support for eBPF active765lb # [ 0.272311] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766lb # [ 0.273236] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767lb # [ 0.275279] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768lb # [ 0.277058] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769lb # [ 0.278066] ... version: 2770lb # [ 0.278778] ... bit width: 48771lb # [ 0.279190] ... generic counters: 6772lb # [ 0.279956] ... generic bitmap: 000000000000003f773lb # [ 0.280190] ... fixed-purpose counters: 0774lb # [ 0.280917] ... fixed-purpose bitmap: 0000000000000000775client # [ 0.276032] Freeing SMP alternatives memory: 44K776lb # [ 0.281189] ... value mask: 0000ffffffffffff777client # [ 0.276762] pid_max: default: 32768 minimum: 301778lb # [ 0.282179] ... max period: 00007fffffffffff779client # [ 0.277292] LSM: initializing lsm=capability,landlock,yama,bpf,ima780lb # [ 0.282928] ... global_ctrl mask: 000000000000003f781client # [ 0.278291] landlock: Up and running.782lb # [ 0.283299] signal: max sigframe size: 3376783client # [ 0.279207] Yama: becoming mindful.784lb # [ 0.284135] rcu: Hierarchical SRCU implementation.785client # [ 0.280389] LSM support for eBPF active786lb # [ 0.284818] rcu: Max phase no-delay instances is 400.787client # [ 0.281117] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)788client # [ 0.282241] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)789worker1 # [ 0.278089] Freeing SMP alternatives memory: 44K790worker1 # [ 0.278427] pid_max: default: 32768 minimum: 301791worker2 # [ 0.271064] Freeing SMP alternatives memory: 44K792worker2 # [ 0.271486] pid_max: default: 32768 minimum: 301793client # [ 0.284761] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)794worker1 # [ 0.279509] LSM: initializing lsm=capability,landlock,yama,bpf,ima795lb # [ 0.289870] smp: Bringing up secondary CPUs ...796worker2 # [ 0.272578] LSM: initializing lsm=capability,landlock,yama,bpf,ima797worker1 # [ 0.280525] landlock: Up and running.798client # [ 0.285747] Performance Events: Fam17h+ core perfctr, AMD PMU driver.799lb # [ 0.290206] smp: Brought up 1 node, 1 CPU800worker2 # [ 0.273595] landlock: Up and running.801worker1 # [ 0.281889] Yama: becoming mindful.802client # [ 0.286212] ... version: 2803worker2 # [ 0.274183] Yama: becoming mindful.804lb # [ 0.290917] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)805worker1 # [ 0.282642] LSM support for eBPF active806client # [ 0.286947] ... bit width: 48807worker2 # [ 0.275109] LSM support for eBPF active808client # [ 0.287209] ... generic counters: 6809worker1 # [ 0.283538] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)810worker2 # [ 0.275600] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)811client # [ 0.287921] ... generic bitmap: 000000000000003f812lb # [ 0.291373] Memory: 1454592K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)813client # [ 0.288214] ... fixed-purpose counters: 0814worker1 # [ 0.284461] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)815lb # [ 0.292452] devtmpfs: initialized816worker2 # [ 0.276526] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)817client # [ 0.288919] ... fixed-purpose bitmap: 0000000000000000818lb # [ 0.293276] x86/mm: Memory block size: 128MB819client # [ 0.289209] ... value mask: 0000ffffffffffff820worker1 # [ 0.287383] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)821worker2 # [ 0.279630] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)822client # [ 0.290160] ... max period: 00007fffffffffff823lb # [ 0.295069] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)824client # [ 0.291008] ... global_ctrl mask: 000000000000003f825worker1 # [ 0.287946] Performance Events: Fam17h+ core perfctr, AMD PMU driver.826worker2 # [ 0.281039] Performance Events: Fam17h+ core perfctr, AMD PMU driver.827client # [ 0.292020] signal: max sigframe size: 3376828lb # [ 0.296100] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).829worker1 # [ 0.288429] ... version: 2830worker2 # [ 0.281494] ... version: 2831client # [ 0.292847] rcu: Hierarchical SRCU implementation.832worker2 # [ 0.282178] ... bit width: 48833worker1 # [ 0.289209] ... bit width: 48834lb # [ 0.297280] pinctrl core: initialized pinctrl subsystem835client # [ 0.293213] rcu: Max phase no-delay instances is 400.836worker2 # [ 0.282486] ... generic counters: 6837worker1 # [ 0.289426] ... generic counters: 6838lb # [ 0.298471] PM: RTC time: 21:21:20, date: 2026-09-19839worker2 # [ 0.283215] ... generic bitmap: 000000000000003f840worker1 # [ 0.290197] ... generic bitmap: 000000000000003f841worker2 # [ 0.283486] ... fixed-purpose counters: 0842worker1 # [ 0.290438] ... fixed-purpose counters: 0843worker2 # [ 0.284221] ... fixed-purpose bitmap: 0000000000000000844worker1 # [ 0.291189] ... fixed-purpose bitmap: 0000000000000000845worker2 # [ 0.284486] ... value mask: 0000ffffffffffff846worker1 # [ 0.291427] ... value mask: 0000ffffffffffff847worker2 # [ 0.285392] ... max period: 00007fffffffffff848lb # [ 0.302023] NET: Registered PF_NETLINK/PF_ROUTE protocol family849worker1 # [ 0.292382] ... max period: 00007fffffffffff850client # [ 0.298519] smp: Bringing up secondary CPUs ...851worker2 # [ 0.286155] ... global_ctrl mask: 000000000000003f852worker1 # [ 0.293164] ... global_ctrl mask: 000000000000003f853client # [ 0.299223] smp: Brought up 1 node, 1 CPU854worker2 # [ 0.286610] signal: max sigframe size: 3376855lb # [ 0.303613] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations856worker1 # [ 0.293571] signal: max sigframe size: 3376857client # [ 0.299936] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)858worker2 # [ 0.287476] rcu: Hierarchical SRCU implementation.859worker1 # [ 0.294386] rcu: Hierarchical SRCU implementation.860lb # [ 0.304211] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations861worker2 # [ 0.288089] rcu: Max phase no-delay instances is 400.862worker1 # [ 0.295045] rcu: Max phase no-delay instances is 400.863lb # [ 0.305491] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations864client # [ 0.300387] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)865lb # [ 0.306201] audit: initializing netlink subsys (disabled)866client # [ 0.301445] devtmpfs: initialized867client # [ 0.302250] x86/mm: Memory block size: 128MB868lb # [ 0.307435] thermal_sys: Registered thermal governor 'fair_share'869lb # [ 0.307437] thermal_sys: Registered thermal governor 'bang_bang'870worker2 # [ 0.292985] smp: Bringing up secondary CPUs ...871client # [ 0.304043] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)872worker1 # [ 0.299989] smp: Bringing up secondary CPUs ...873lb # [ 0.308193] audit: type=2000 audit(1789852881.553:1): state=initialized audit_enabled=0 res=1874worker2 # [ 0.293501] smp: Brought up 1 node, 1 CPU875worker1 # [ 0.300446] smp: Brought up 1 node, 1 CPU876lb # [ 0.310191] thermal_sys: Registered thermal governor 'step_wise'877client # [ 0.305169] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).878worker2 # [ 0.294181] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)879worker1 # [ 0.301152] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)880lb # [ 0.310192] thermal_sys: Registered thermal governor 'user_space'881client # [ 0.306284] pinctrl core: initialized pinctrl subsystem882lb # [ 0.311141] thermal_sys: Registered thermal governor 'power_allocator'883client # [ 0.307446] PM: RTC time: 21:21:20, date: 2026-09-19884worker2 # [ 0.294655] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)885lb # [ 0.311968] cpuidle: using governor menu886worker1 # [ 0.301602] Memory: 1454616K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)887worker2 # [ 0.295749] devtmpfs: initialized888worker1 # [ 0.302643] devtmpfs: initialized889lb # [ 0.313751] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5890worker2 # [ 0.296584] x86/mm: Memory block size: 128MB891worker1 # [ 0.303509] x86/mm: Memory block size: 128MB892lb # [ 0.314422] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]893client # [ 0.310855] NET: Registered PF_NETLINK/PF_ROUTE protocol family894worker2 # [ 0.298359] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)895lb # [ 0.315192] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry896worker1 # [ 0.305352] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)897client # [ 0.311697] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations898lb # [ 0.316208] PCI: Using configuration type 1 for base access899worker2 # [ 0.299424] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).900worker1 # [ 0.306373] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).901client # [ 0.312228] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations902worker2 # [ 0.300565] pinctrl core: initialized pinctrl subsystem903lb # [ 0.317288] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.904worker1 # [ 0.307521] pinctrl core: initialized pinctrl subsystem905worker2 # [ 0.301731] PM: RTC time: 21:21:20, date: 2026-09-19906client # [ 0.313478] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations907worker1 # [ 0.308728] PM: RTC time: 21:21:20, date: 2026-09-19908client # [ 0.314220] audit: initializing netlink subsys (disabled)909client # [ 0.315503] thermal_sys: Registered thermal governor 'fair_share'910client # [ 0.315505] thermal_sys: Registered thermal governor 'bang_bang'911worker2 # [ 0.305178] NET: Registered PF_NETLINK/PF_ROUTE protocol family912lb # [ 0.322437] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages913client # [ 0.316210] thermal_sys: Registered thermal governor 'step_wise'914worker1 # [ 0.312130] NET: Registered PF_NETLINK/PF_ROUTE protocol family915worker2 # [ 0.305981] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations916lb # [ 0.323191] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page917client # [ 0.317183] thermal_sys: Registered thermal governor 'user_space'918worker1 # [ 0.312922] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations919lb # [ 0.324181] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages920worker2 # [ 0.306505] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations921client # [ 0.317943] audit: type=2000 audit(1789852881.568:1): state=initialized audit_enabled=0 res=1922worker1 # [ 0.313446] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations923worker2 # [ 0.307769] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations924client # [ 0.319212] thermal_sys: Registered thermal governor 'power_allocator'925client # [ 0.319226] cpuidle: using governor menu926worker2 # [ 0.308495] audit: initializing netlink subsys (disabled)927worker1 # [ 0.314707] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations928worker1 # [ 0.315438] audit: initializing netlink subsys (disabled)929worker2 # [ 0.309632] thermal_sys: Registered thermal governor 'fair_share'930client # [ 0.321478] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5931worker2 # [ 0.309634] thermal_sys: Registered thermal governor 'bang_bang'932worker1 # [ 0.316641] thermal_sys: Registered thermal governor 'fair_share'933client # [ 0.322445] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]934worker2 # [ 0.310487] thermal_sys: Registered thermal governor 'step_wise'935worker1 # [ 0.316643] thermal_sys: Registered thermal governor 'bang_bang'936worker2 # [ 0.311466] thermal_sys: Registered thermal governor 'user_space'937client # [ 0.323212] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry938lb # [ 0.331190] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page939worker1 # [ 0.317428] thermal_sys: Registered thermal governor 'step_wise'940client # [ 0.324222] PCI: Using configuration type 1 for base access941worker2 # [ 0.312238] audit: type=2000 audit(1789852881.578:1): state=initialized audit_enabled=0 res=1942worker1 # [ 0.318430] audit: type=2000 audit(1789852881.572:1): state=initialized audit_enabled=0 res=1943worker2 # [ 0.313491] thermal_sys: Registered thermal governor 'power_allocator'944client # [ 0.325368] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.945worker2 # [ 0.313518] cpuidle: using governor menu946worker1 # [ 0.320428] thermal_sys: Registered thermal governor 'user_space'947worker1 # [ 0.320430] thermal_sys: Registered thermal governor 'power_allocator'948worker2 # [ 0.315694] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5949worker1 # [ 0.321448] cpuidle: using governor menu950worker2 # [ 0.316722] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]951worker1 # [ 0.323674] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5952worker2 # [ 0.317489] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry953client # [ 0.330450] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages954worker2 # [ 0.318497] PCI: Using configuration type 1 for base access955worker1 # [ 0.324683] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]956lb # [ 0.339589] ACPI: Added _OSI(Module Device)957client # [ 0.331210] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page958lb # [ 0.340191] ACPI: Added _OSI(Processor Device)959worker1 # [ 0.325430] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry960worker2 # [ 0.319615] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.961lb # [ 0.340889] ACPI: Added _OSI(Processor Aggregator Device)962worker1 # [ 0.326438] PCI: Using configuration type 1 for base access963worker1 # [ 0.327601] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.964client # [ 0.336211] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages965client # [ 0.337209] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page966worker2 # [ 0.324744] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages967worker2 # [ 0.325487] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page968worker1 # [ 0.334683] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages969lb # [ 0.349777] ACPI: 1 ACPI AML tables successfully acquired and loaded970worker1 # [ 0.335428] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page971worker2 # [ 0.330487] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages972worker2 # [ 0.331486] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page973lb # [ 0.353582] ACPI: Interpreter enabled974lb # [ 0.354204] ACPI: PM: (supports S0 S3 S4 S5)975lb # [ 0.354889] ACPI: Using IOAPIC for interrupt routing976client # [ 0.347591] ACPI: Added _OSI(Module Device)977worker1 # [ 0.340427] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages978client # [ 0.348211] ACPI: Added _OSI(Processor Device)979lb # [ 0.355224] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug980worker1 # [ 0.341427] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page981client # [ 0.348990] ACPI: Added _OSI(Processor Aggregator Device)982lb # [ 0.356191] PCI: Using E820 reservations for host bridge windows983lb # [ 0.359356] ACPI: Enabled 2 GPEs in block 00 to 3F984worker2 # [ 0.341864] ACPI: Added _OSI(Module Device)985worker2 # [ 0.342488] ACPI: Added _OSI(Processor Device)986worker2 # [ 0.343223] ACPI: Added _OSI(Processor Aggregator Device)987worker1 # [ 0.350042] ACPI: Added _OSI(Module Device)988worker1 # [ 0.350428] ACPI: Added _OSI(Processor Device)989client # [ 0.358751] ACPI: 1 ACPI AML tables successfully acquired and loaded990worker1 # [ 0.351213] ACPI: Added _OSI(Processor Aggregator Device)991lb # [ 0.368296] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])992client # [ 0.362628] ACPI: Interpreter enabled993lb # [ 0.369361] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]994client # [ 0.363225] ACPI: PM: (supports S0 S3 S4 S5)995client # [ 0.363943] ACPI: Using IOAPIC for interrupt routing996lb # [ 0.370273] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]997worker2 # [ 0.352122] ACPI: 1 ACPI AML tables successfully acquired and loaded998lb # [ 0.371315] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]999lb # [ 0.372574] PCI host bridge to bus 0000:001000client # [ 0.366286] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1001lb # [ 0.373194] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1002worker1 # [ 0.360764] ACPI: 1 ACPI AML tables successfully acquired and loaded1003client # [ 0.367210] PCI: Using E820 reservations for host bridge windows1004lb # [ 0.374190] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1005worker2 # [ 0.355917] ACPI: Interpreter enabled1006lb # [ 0.375189] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1007worker2 # [ 0.356501] ACPI: PM: (supports S0 S3 S4 S5)1008worker2 # [ 0.357260] ACPI: Using IOAPIC for interrupt routing1009lb # [ 0.376190] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1010client # [ 0.370351] ACPI: Enabled 2 GPEs in block 00 to 3F1011worker1 # [ 0.364850] ACPI: Interpreter enabled1012lb # [ 0.377194] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1013worker2 # [ 0.357542] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1014worker1 # [ 0.365441] ACPI: PM: (supports S0 S3 S4 S5)1015worker2 # [ 0.358487] PCI: Using E820 reservations for host bridge windows1016worker1 # [ 0.366161] ACPI: Using IOAPIC for interrupt routing1017lb # [ 0.378215] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1018lb # [ 0.379192] pci_bus 0000:00: root bus resource [bus 00-ff]1019worker1 # [ 0.366485] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1020lb # [ 0.380221] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1021worker1 # [ 0.367426] PCI: Using E820 reservations for host bridge windows1022worker2 # [ 0.361562] ACPI: Enabled 2 GPEs in block 00 to 3F1023lb # [ 0.381634] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1024client # [ 0.377371] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1025worker1 # [ 0.370582] ACPI: Enabled 2 GPEs in block 00 to 3F1026client # [ 0.378216] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1027client # [ 0.379322] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1028client # [ 0.380334] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1029client # [ 0.381575] PCI host bridge to bus 0000:001030lb # [ 0.384271] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1031client # [ 0.382216] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1032worker2 # [ 0.370315] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1033lb # [ 0.385203] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1034client # [ 0.383210] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1035lb # [ 0.386189] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1036worker2 # [ 0.371262] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1037client # [ 0.384210] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1038worker1 # [ 0.379316] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1039lb # [ 0.387410] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1040client # [ 0.385210] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1041worker2 # [ 0.373304] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1042worker1 # [ 0.380368] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1043client # [ 0.386209] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1044worker2 # [ 0.374479] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1045lb # [ 0.388969] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1046worker2 # [ 0.375839] PCI host bridge to bus 0000:001047client # [ 0.387210] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1048worker1 # [ 0.381806] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1049client # [ 0.388216] pci_bus 0000:00: root bus resource [bus 00-ff]1050worker2 # [ 0.376492] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1051worker1 # [ 0.382547] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1052worker2 # [ 0.377486] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1053client # [ 0.389228] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1054worker1 # [ 0.383773] PCI host bridge to bus 0000:001055lb # [ 0.392198] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1056worker2 # [ 0.378487] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1057worker1 # [ 0.384431] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1058lb # [ 0.393043] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1059client # [ 0.390717] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1060worker2 # [ 0.379487] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1061worker1 # [ 0.385426] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1062lb # [ 0.393923] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1063worker2 # [ 0.380486] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1064worker1 # [ 0.386426] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1065lb # [ 0.394197] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1066worker1 # [ 0.387426] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1067worker2 # [ 0.381486] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1068lb # [ 0.395735] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1069worker2 # [ 0.382487] pci_bus 0000:00: root bus resource [bus 00-ff]1070worker1 # [ 0.388426] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1071worker2 # [ 0.383464] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1072worker1 # [ 0.389426] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1073worker1 # [ 0.390427] pci_bus 0000:00: root bus resource [bus 00-ff]1074worker2 # [ 0.384917] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1075client # [ 0.393296] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1076worker1 # [ 0.391474] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1077lb # [ 0.398322] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1078client # [ 0.394223] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1079lb # [ 0.399822] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1080client # [ 0.395234] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1081worker1 # [ 0.392907] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1082lb # [ 0.400212] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1083client # [ 0.396451] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1084lb # [ 0.401765] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1085client # [ 0.397986] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1086worker2 # [ 0.387673] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1087lb # [ 0.404178] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1088worker2 # [ 0.388540] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1089lb # [ 0.404838] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1090client # [ 0.401243] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1091worker1 # [ 0.395495] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1092worker2 # [ 0.389508] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1093lb # [ 0.405214] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1094client # [ 0.402152] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1095worker1 # [ 0.396439] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1096client # [ 0.403006] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1097worker2 # [ 0.390803] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1098worker1 # [ 0.397452] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1099client # [ 0.404119] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1100lb # [ 0.407568] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1101worker2 # [ 0.392214] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1102worker1 # [ 0.399045] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1103client # [ 0.405664] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1104lb # [ 0.409222] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1105worker1 # [ 0.400195] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1106lb # [ 0.410145] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1107worker2 # [ 0.394522] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1108client # [ 0.407243] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1109worker2 # [ 0.395395] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1110lb # [ 0.410958] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1111client # [ 0.408105] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1112worker2 # [ 0.396203] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1113worker1 # [ 0.403443] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1114client # [ 0.408988] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1115worker2 # [ 0.396493] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1116lb # [ 0.412600] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117worker1 # [ 0.404323] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1118worker1 # [ 0.405225] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1119worker2 # [ 0.398019] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1120client # [ 0.410725] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1121worker1 # [ 0.406311] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1122lb # [ 0.415483] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1123worker2 # [ 0.399505] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1124lb # [ 0.416869] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1125worker1 # [ 0.407812] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1126worker2 # [ 0.400384] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1127lb # [ 0.417212] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1128client # [ 0.413246] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1129worker2 # [ 0.401256] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1130client # [ 0.414215] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1131lb # [ 0.418804] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1132client # [ 0.415214] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1133worker1 # [ 0.410443] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1134worker2 # [ 0.402988] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1135worker1 # [ 0.411315] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1136lb # [ 0.420198] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1137client # [ 0.416857] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1138worker1 # [ 0.412242] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1139lb # [ 0.421010] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1140worker2 # [ 0.405495] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1141lb # [ 0.421910] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1142client # [ 0.418243] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1143worker1 # [ 0.413894] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1144worker2 # [ 0.406493] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1145client # [ 0.419123] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1146worker2 # [ 0.407457] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1147client # [ 0.420133] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1148lb # [ 0.422785] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1149worker2 # [ 0.408874] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150lb # [ 0.425197] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1151worker1 # [ 0.416436] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1152client # [ 0.422228] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1153lb # [ 0.426019] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1154worker1 # [ 0.418091] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1155worker2 # [ 0.410494] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1156lb # [ 0.426909] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1157worker2 # [ 0.411375] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1158worker1 # [ 0.418450] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1159client # [ 0.424218] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1160lb # [ 0.427195] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1161worker2 # [ 0.412230] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1162client # [ 0.425145] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1163worker1 # [ 0.420029] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1164lb # [ 0.428710] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1165client # [ 0.426029] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1166worker2 # [ 0.413030] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1167client # [ 0.427629] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1168worker1 # [ 0.422267] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1169worker2 # [ 0.414494] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1170worker1 # [ 0.423122] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1171lb # [ 0.430202] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1172worker2 # [ 0.415358] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1173worker1 # [ 0.423458] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1174lb # [ 0.431212] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1175worker2 # [ 0.416246] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1176client # [ 0.430468] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1177lb # [ 0.432744] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1178worker2 # [ 0.417084] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1179client # [ 0.431869] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1180worker1 # [ 0.425785] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1181client # [ 0.432232] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1182lb # [ 0.434225] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1183lb # [ 0.435043] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1184worker2 # [ 0.418520] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1185client # [ 0.433871] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1186worker1 # [ 0.428310] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1187lb # [ 0.435891] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1188worker2 # [ 0.419430] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1189worker1 # [ 0.429112] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1190worker2 # [ 0.420508] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1191lb # [ 0.436747] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1192client # [ 0.435240] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1193worker1 # [ 0.429448] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1194client # [ 0.436118] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1195worker2 # [ 0.422133] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1196client # [ 0.437041] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1197worker1 # [ 0.431095] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1198lb # [ 0.439217] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1199worker2 # [ 0.423519] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1200client # [ 0.438114] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1201lb # [ 0.440109] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1202worker2 # [ 0.424339] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1203lb # [ 0.440943] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1204worker2 # [ 0.425186] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1205client # [ 0.439785] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1206worker1 # [ 0.435373] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1207worker2 # [ 0.425492] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1208lb # [ 0.441747] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1209worker1 # [ 0.436099] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1210client # [ 0.441115] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1211worker1 # [ 0.436453] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1212client # [ 0.441959] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1213lb # [ 0.442810] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1214worker2 # [ 0.427041] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1215lb # [ 0.443394] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1216worker1 # [ 0.438041] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1217worker2 # [ 0.428337] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1218client # [ 0.443637] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1219worker2 # [ 0.429192] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1220lb # [ 0.444846] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1221client # [ 0.445242] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1222worker1 # [ 0.439445] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1223worker2 # [ 0.430062] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1224worker1 # [ 0.440379] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1225client # [ 0.446111] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1226client # [ 0.447231] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1227worker2 # [ 0.431532] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1228worker1 # [ 0.441241] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1229worker2 # [ 0.432394] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1230worker1 # [ 0.442433] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1231worker2 # [ 0.433234] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1232client # [ 0.448808] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1233worker1 # [ 0.444025] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1234client # [ 0.450237] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1235worker2 # [ 0.434264] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1236client # [ 0.451117] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1237worker1 # [ 0.445473] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1238worker2 # [ 0.436523] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1239client # [ 0.452010] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1240worker1 # [ 0.446450] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1241worker2 # [ 0.437378] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1242worker2 # [ 0.438232] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1243client # [ 0.453661] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1244worker1 # [ 0.448010] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1245lb # [ 0.446025] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1246worker2 # [ 0.439039] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1247client # [ 0.455458] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1248worker2 # [ 0.440023] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1249lb # [ 0.448749] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1250client # [ 0.456425] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1251worker1 # [ 0.450469] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1252worker2 # [ 0.440687] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1253worker1 # [ 0.451374] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1254lb # [ 0.449445] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1255client # [ 0.457767] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1256worker1 # [ 0.452213] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1257worker2 # [ 0.442148] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1258lb # [ 0.451161] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1259worker1 # [ 0.454019] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1260lb # [ 0.452180] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1261lb # [ 0.453474] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1262worker1 # [ 0.455454] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1263lb # [ 0.454444] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1264worker1 # [ 0.456415] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1265worker1 # [ 0.457235] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1266lb # [ 0.457066] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1267lb # [ 0.457876] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1268worker1 # [ 0.459018] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1269lb # [ 0.458518] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1270worker1 # [ 0.460278] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1271client # [ 0.458420] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1272lb # [ 0.460037] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1273worker2 # [ 0.442700] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1274worker1 # [ 0.461406] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1275client # [ 0.460793] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1276worker2 # [ 0.445106] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1277worker1 # [ 0.463159] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1278client # [ 0.461457] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1279worker2 # [ 0.445772] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1280lb # [ 0.463720] ACPI: PCI: Interrupt link LNKA configured for IRQ 101281client # [ 0.462758] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1282worker2 # [ 0.447045] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1283lb # [ 0.464296] ACPI: PCI: Interrupt link LNKB configured for IRQ 101284client # [ 0.463511] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1285worker2 # [ 0.447752] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1286lb # [ 0.465292] ACPI: PCI: Interrupt link LNKC configured for IRQ 111287lb # [ 0.466287] ACPI: PCI: Interrupt link LNKD configured for IRQ 111288client # [ 0.464516] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1289worker2 # [ 0.448808] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1290lb # [ 0.467287] ACPI: PCI: Interrupt link LNKE configured for IRQ 101291worker2 # [ 0.449737] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1292client # [ 0.465470] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1293lb # [ 0.468301] ACPI: PCI: Interrupt link LNKF configured for IRQ 101294lb # [ 0.469302] ACPI: PCI: Interrupt link LNKG configured for IRQ 111295worker2 # [ 0.451339] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1296client # [ 0.467227] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1297lb # [ 0.470288] ACPI: PCI: Interrupt link LNKH configured for IRQ 111298worker2 # [ 0.452138] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1299client # [ 0.468126] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1300lb # [ 0.471222] ACPI: PCI: Interrupt link GSIA configured for IRQ 161301lb # [ 0.472155] ACPI: PCI: Interrupt link GSIB configured for IRQ 171302worker2 # [ 0.452815] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1303lb # [ 0.472918] ACPI: PCI: Interrupt link GSIC configured for IRQ 181304client # [ 0.469820] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1305worker2 # [ 0.454050] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1306lb # [ 0.473204] ACPI: PCI: Interrupt link GSID configured for IRQ 191307worker1 # [ 0.463624] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1308client # [ 0.470800] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1309lb # [ 0.474202] ACPI: PCI: Interrupt link GSIE configured for IRQ 201310lb # [ 0.475146] ACPI: PCI: Interrupt link GSIF configured for IRQ 211311lb # [ 0.475911] ACPI: PCI: Interrupt link GSIG configured for IRQ 221312worker2 # [ 0.457615] ACPI: PCI: Interrupt link LNKA configured for IRQ 101313lb # [ 0.476205] ACPI: PCI: Interrupt link GSIH configured for IRQ 231314client # [ 0.474165] ACPI: PCI: Interrupt link LNKA configured for IRQ 101315worker1 # [ 0.467311] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1316worker2 # [ 0.458600] ACPI: PCI: Interrupt link LNKB configured for IRQ 101317client # [ 0.475069] ACPI: PCI: Interrupt link LNKB configured for IRQ 101318lb # [ 0.478158] iommu: Default domain type: Translated1319worker2 # [ 0.459584] ACPI: PCI: Interrupt link LNKC configured for IRQ 111320worker1 # [ 0.468392] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1321lb # [ 0.478758] iommu: DMA domain TLB invalidation policy: lazy mode1322client # [ 0.476081] ACPI: PCI: Interrupt link LNKC configured for IRQ 111323worker2 # [ 0.460580] ACPI: PCI: Interrupt link LNKD configured for IRQ 111324lb # [ 0.479448] ACPI: bus type USB registered1325client # [ 0.477047] ACPI: PCI: Interrupt link LNKD configured for IRQ 111326worker2 # [ 0.461589] ACPI: PCI: Interrupt link LNKE configured for IRQ 101327worker1 # [ 0.470433] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1328lb # [ 0.480163] usbcore: registered new interface driver usbfs1329worker2 # [ 0.462580] ACPI: PCI: Interrupt link LNKF configured for IRQ 101330client # [ 0.478260] ACPI: PCI: Interrupt link LNKE configured for IRQ 101331lb # [ 0.480852] usbcore: registered new interface driver hub1332worker2 # [ 0.463590] ACPI: PCI: Interrupt link LNKG configured for IRQ 111333client # [ 0.479332] ACPI: PCI: Interrupt link LNKF configured for IRQ 101334worker1 # [ 0.471643] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1335lb # [ 0.481226] usbcore: registered new device driver usb1336worker2 # [ 0.464580] ACPI: PCI: Interrupt link LNKH configured for IRQ 111337client # [ 0.480315] ACPI: PCI: Interrupt link LNKG configured for IRQ 111338lb # [ 0.482972] NetLabel: Initializing1339worker1 # [ 0.472756] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1340worker2 # [ 0.465524] ACPI: PCI: Interrupt link GSIA configured for IRQ 161341client # [ 0.481312] ACPI: PCI: Interrupt link LNKH configured for IRQ 111342lb # [ 0.483196] NetLabel: domain hash size = 1281343worker2 # [ 0.466501] ACPI: PCI: Interrupt link GSIB configured for IRQ 171344client # [ 0.482248] ACPI: PCI: Interrupt link GSIA configured for IRQ 161345lb # [ 0.483935] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1346worker1 # [ 0.473716] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1347worker2 # [ 0.467460] ACPI: PCI: Interrupt link GSIC configured for IRQ 181348lb # [ 0.484229] NetLabel: unlabeled traffic allowed by default1349client # [ 0.483224] ACPI: PCI: Interrupt link GSIB configured for IRQ 171350worker2 # [ 0.468169] ACPI: PCI: Interrupt link GSID configured for IRQ 191351lb # [ 0.485101] PCI: Using ACPI for IRQ routing1352client # [ 0.484199] ACPI: PCI: Interrupt link GSIC configured for IRQ 181353worker2 # [ 0.468500] ACPI: PCI: Interrupt link GSIE configured for IRQ 201354client # [ 0.484948] ACPI: PCI: Interrupt link GSID configured for IRQ 191355worker1 # [ 0.475485] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1356worker2 # [ 0.469457] ACPI: PCI: Interrupt link GSIF configured for IRQ 211357worker1 # [ 0.476410] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1358client # [ 0.485222] ACPI: PCI: Interrupt link GSIE configured for IRQ 201359worker2 # [ 0.470215] ACPI: PCI: Interrupt link GSIG configured for IRQ 221360client # [ 0.486225] ACPI: PCI: Interrupt link GSIF configured for IRQ 211361worker2 # [ 0.470503] ACPI: PCI: Interrupt link GSIH configured for IRQ 231362worker1 # [ 0.477568] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1363client # [ 0.487222] ACPI: PCI: Interrupt link GSIG configured for IRQ 221364worker2 # [ 0.472475] iommu: Default domain type: Translated1365client # [ 0.488221] ACPI: PCI: Interrupt link GSIH configured for IRQ 231366worker1 # [ 0.479457] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1367worker2 # [ 0.473094] iommu: DMA domain TLB invalidation policy: lazy mode1368worker2 # [ 0.473745] ACPI: bus type USB registered1369client # [ 0.490419] iommu: Default domain type: Translated1370worker2 # [ 0.474519] usbcore: registered new interface driver usbfs1371client # [ 0.491223] iommu: DMA domain TLB invalidation policy: lazy mode1372worker2 # [ 0.475420] usbcore: registered new interface driver hub1373client # [ 0.492634] ACPI: bus type USB registered1374worker2 # [ 0.476144] usbcore: registered new device driver usb1375client # [ 0.493271] usbcore: registered new interface driver usbfs1376worker1 # [ 0.484230] ACPI: PCI: Interrupt link LNKA configured for IRQ 101377worker2 # [ 0.477376] NetLabel: Initializing1378client # [ 0.494221] usbcore: registered new interface driver hub1379worker2 # [ 0.477887] NetLabel: domain hash size = 1281380worker1 # [ 0.485366] ACPI: PCI: Interrupt link LNKB configured for IRQ 101381client # [ 0.495124] usbcore: registered new device driver usb1382worker2 # [ 0.478486] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1383worker1 # [ 0.486350] ACPI: PCI: Interrupt link LNKC configured for IRQ 111384worker2 # [ 0.479414] NetLabel: unlabeled traffic allowed by default1385client # [ 0.496844] NetLabel: Initializing1386worker2 # [ 0.480147] PCI: Using ACPI for IRQ routing1387worker1 # [ 0.487389] ACPI: PCI: Interrupt link LNKD configured for IRQ 111388client # [ 0.497211] NetLabel: domain hash size = 1281389worker1 # [ 0.488323] ACPI: PCI: Interrupt link LNKE configured for IRQ 101390client # [ 0.498006] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1391worker1 # [ 0.489357] ACPI: PCI: Interrupt link LNKF configured for IRQ 101392client # [ 0.499024] NetLabel: unlabeled traffic allowed by default1393client # [ 0.499967] PCI: Using ACPI for IRQ routing1394worker1 # [ 0.490367] ACPI: PCI: Interrupt link LNKG configured for IRQ 111395worker1 # [ 0.491353] ACPI: PCI: Interrupt link LNKH configured for IRQ 111396worker1 # [ 0.492472] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397worker1 # [ 0.493439] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398worker1 # [ 0.494443] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399worker1 # [ 0.495441] ACPI: PCI: Interrupt link GSID configured for IRQ 191400worker1 # [ 0.496509] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401worker1 # [ 0.497525] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402worker1 # [ 0.498442] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403worker1 # [ 0.499438] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404worker1 # [ 0.501577] iommu: Default domain type: Translated1405worker1 # [ 0.502433] iommu: DMA domain TLB invalidation policy: lazy mode1406worker1 # [ 0.503695] ACPI: bus type USB registered1407worker1 # [ 0.504496] usbcore: registered new interface driver usbfs1408worker1 # [ 0.505441] usbcore: registered new interface driver hub1409worker1 # [ 0.506415] usbcore: registered new device driver usb1410worker1 # [ 0.508076] NetLabel: Initializing1411worker1 # [ 0.508427] NetLabel: domain hash size = 1281412worker1 # [ 0.509428] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker1 # [ 0.510479] NetLabel: unlabeled traffic allowed by default1414worker1 # [ 0.511439] PCI: Using ACPI for IRQ routing1415lb # [ 0.528907] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416lb # [ 0.529186] pci 0000:00:01.0: vgaarb: bridge control possible1417lb # [ 0.529186] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418lb # [ 0.529195] vgaarb: loaded1419lb # [ 0.529925] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420lb # [ 0.530191] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421lb # [ 0.534271] clocksource: Switched to clocksource kvm-clock1422lb # [ 0.537699] VFS: Disk quotas dquot_6.6.01423lb # [ 0.538616] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424lb # [ 0.539992] pnp: PnP ACPI init1425worker2 # [ 0.524685] pci 0000:00:01.0: vgaarb: setting as boot VGA device1426lb # [ 0.540793] ACPI: IRQ 4 override to edge(!), high(!)1427worker2 # [ 0.525482] pci 0000:00:01.0: vgaarb: bridge control possible1428lb # [ 0.541784] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1429worker2 # [ 0.525482] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1430lb # [ 0.543305] pnp: PnP ACPI: found 6 devices1431worker2 # [ 0.525491] vgaarb: loaded1432worker2 # [ 0.526232] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01433worker2 # [ 0.526488] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434client # [ 0.549147] pci 0000:00:01.0: vgaarb: setting as boot VGA device1435client # [ 0.549205] pci 0000:00:01.0: vgaarb: bridge control possible1436worker2 # [ 0.529573] clocksource: Switched to clocksource kvm-clock1437client # [ 0.549205] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1438client # [ 0.549215] vgaarb: loaded1439lb # [ 0.550873] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1440client # [ 0.549999] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01441lb # [ 0.552351] clocksource: Switched to clocksource acpi_pm1442worker2 # [ 0.533066] VFS: Disk quotas dquot_6.6.01443client # [ 0.550822] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1444lb # [ 0.553301] NET: Registered PF_INET protocol family1445worker2 # [ 0.533775] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1446worker2 # [ 0.535135] pnp: PnP ACPI init1447lb # [ 0.554432] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1448worker2 # [ 0.535912] ACPI: IRQ 4 override to edge(!), high(!)1449worker2 # [ 0.536896] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1450worker2 # [ 0.538430] pnp: PnP ACPI: found 6 devices1451client # [ 0.555309] clocksource: Switched to clocksource kvm-clock1452client # [ 0.557097] VFS: Disk quotas dquot_6.6.01453client # [ 0.559873] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454client # [ 0.561416] pnp: PnP ACPI init1455client # [ 0.562262] ACPI: IRQ 4 override to edge(!), high(!)1456worker2 # [ 0.545978] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1457client # [ 0.563372] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1458worker2 # [ 0.547415] clocksource: Switched to clocksource acpi_pm1459client # [ 0.565032] pnp: PnP ACPI: found 6 devices1460worker2 # [ 0.548370] NET: Registered PF_INET protocol family1461worker2 # [ 0.549498] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1462lb # [ 0.570764] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1463worker1 # [ 0.561199] pci 0000:00:01.0: vgaarb: setting as boot VGA device1464lb # [ 0.572328] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1465worker1 # [ 0.561422] pci 0000:00:01.0: vgaarb: bridge control possible1466lb # [ 0.573660] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1467worker1 # [ 0.561422] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1468worker1 # [ 0.561430] vgaarb: loaded1469lb # [ 0.575023] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1470worker1 # [ 0.562196] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01471client # [ 0.572749] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1472lb # [ 0.576292] TCP: Hash tables configured (established 16384 bind 16384)1473worker1 # [ 0.562428] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1474client # [ 0.574301] clocksource: Switched to clocksource acpi_pm1475lb # [ 0.577399] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1476client # [ 0.575327] NET: Registered PF_INET protocol family1477lb # [ 0.578716] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1478client # [ 0.576590] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1479lb # [ 0.579871] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1480lb # [ 0.581116] NET: Registered PF_UNIX/PF_LOCAL protocol family1481lb # [ 0.582156] NET: Registered PF_XDP protocol family1482worker1 # [ 0.567523] clocksource: Switched to clocksource kvm-clock1483lb # [ 0.583027] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1484lb # [ 0.584077] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1485lb # [ 0.585129] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1486worker1 # [ 0.571214] VFS: Disk quotas dquot_6.6.01487worker2 # [ 0.565964] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1488lb # [ 0.586264] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1489worker1 # [ 0.571914] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1490worker2 # [ 0.567451] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1491lb # [ 0.587348] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1492worker1 # [ 0.573331] pnp: PnP ACPI init1493lb # [ 0.588464] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1494worker1 # [ 0.574113] ACPI: IRQ 4 override to edge(!), high(!)1495worker2 # [ 0.568723] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1496worker2 # [ 0.570095] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1497lb # [ 0.590251] ACPI: \_SB_.GSIA: Enabled at IRQ 161498worker1 # [ 0.575129] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1499worker2 # [ 0.571307] TCP: Hash tables configured (established 16384 bind 16384)1500worker1 # [ 0.576729] pnp: PnP ACPI: found 6 devices1501worker2 # [ 0.572484] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1502lb # [ 0.592637] ACPI: \_SB_.GSIB: Enabled at IRQ 171503worker2 # [ 0.573775] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1504lb # [ 0.594552] ACPI: \_SB_.GSIC: Enabled at IRQ 181505worker2 # [ 0.574961] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1506worker2 # [ 0.576260] NET: Registered PF_UNIX/PF_LOCAL protocol family1507lb # [ 0.596578] ACPI: \_SB_.GSID: Enabled at IRQ 191508worker2 # [ 0.577239] NET: Registered PF_XDP protocol family1509client # [ 0.593493] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1510worker2 # [ 0.578036] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1511lb # [ 0.598490] PCI: CLS 0 bytes, default 641512client # [ 0.595000] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1513worker2 # [ 0.579067] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1514worker1 # [ 0.584368] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1515client # [ 0.596424] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1516worker2 # [ 0.580054] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1517lb # [ 0.599383] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1518worker1 # [ 0.585869] clocksource: Switched to clocksource acpi_pm1519worker2 # [ 0.581083] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1520client # [ 0.597769] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1521lb # [ 0.601157] Trying to unpack rootfs image as initramfs...1522worker1 # [ 0.586857] NET: Registered PF_INET protocol family1523worker2 # [ 0.582140] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1524client # [ 0.599041] TCP: Hash tables configured (established 16384 bind 16384)1525worker2 # [ 0.583218] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1526worker1 # [ 0.588046] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1527client # [ 0.600344] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1528worker2 # [ 0.584928] ACPI: \_SB_.GSIA: Enabled at IRQ 161529client # [ 0.601649] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1530client # [ 0.602761] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1531worker2 # [ 0.587140] ACPI: \_SB_.GSIB: Enabled at IRQ 171532client # [ 0.604032] NET: Registered PF_UNIX/PF_LOCAL protocol family1533client # [ 0.604994] NET: Registered PF_XDP protocol family1534worker2 # [ 0.589038] ACPI: \_SB_.GSIC: Enabled at IRQ 181535client # [ 0.605877] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1536client # [ 0.606931] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1537worker2 # [ 0.590991] ACPI: \_SB_.GSID: Enabled at IRQ 191538client # [ 0.608047] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1539worker2 # [ 0.592668] PCI: CLS 0 bytes, default 641540client # [ 0.609200] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1541client # [ 0.610360] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1542worker2 # [ 0.593595] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1543client # [ 0.611488] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1544worker2 # [ 0.595331] Trying to unpack rootfs image as initramfs...1545client # [ 0.613289] ACPI: \_SB_.GSIA: Enabled at IRQ 161546client # [ 0.616043] ACPI: \_SB_.GSIB: Enabled at IRQ 171547worker1 # [ 0.604798] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1548client # [ 0.618019] ACPI: \_SB_.GSIC: Enabled at IRQ 181549worker1 # [ 0.606369] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1550client # [ 0.620114] ACPI: \_SB_.GSID: Enabled at IRQ 191551worker1 # [ 0.607767] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1552worker1 # [ 0.609197] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1553client # [ 0.621813] PCI: CLS 0 bytes, default 641554worker1 # [ 0.610552] TCP: Hash tables configured (established 16384 bind 16384)1555client # [ 0.622763] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1556worker1 # [ 0.611747] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1557client # [ 0.624653] Trying to unpack rootfs image as initramfs...1558worker1 # [ 0.613138] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559worker1 # [ 0.614340] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560worker1 # [ 0.615692] NET: Registered PF_UNIX/PF_LOCAL protocol family1561worker1 # [ 0.616801] NET: Registered PF_XDP protocol family1562worker1 # [ 0.617742] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563worker1 # [ 0.618855] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564worker1 # [ 0.619929] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565worker1 # [ 0.621119] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566worker1 # [ 0.622315] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567worker1 # [ 0.623515] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568worker1 # [ 0.625333] ACPI: \_SB_.GSIA: Enabled at IRQ 161569worker1 # [ 0.627893] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker1 # [ 0.629819] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker1 # [ 0.631788] ACPI: \_SB_.GSID: Enabled at IRQ 191572lb # [ 0.648082] Initialise system trusted keyrings1573worker1 # [ 0.633504] PCI: CLS 0 bytes, default 641574worker1 # [ 0.634400] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575worker1 # [ 0.636278] Trying to unpack rootfs image as initramfs...1576lb # [ 0.651674] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker2 # [ 0.640059] Initialise system trusted keyrings1578worker2 # [ 0.642880] workingset: timestamp_bits=40 max_order=19 bucket_order=01579client # [ 0.671659] Initialise system trusted keyrings1580lb # [ 0.675816] Key type asymmetric registered1581lb # [ 0.676581] Asymmetric key parser 'x509' registered1582lb # [ 0.677538] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1583client # [ 0.675280] workingset: timestamp_bits=40 max_order=19 bucket_order=01584lb # [ 0.680835] io scheduler mq-deadline registered1585lb # [ 0.683654] io scheduler kyber registered1586worker2 # [ 0.664989] Key type asymmetric registered1587worker2 # [ 0.665790] Asymmetric key parser 'x509' registered1588worker2 # [ 0.666720] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1589lb # [ 0.687868] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1590lb # [ 0.689481] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1591worker2 # [ 0.671953] io scheduler mq-deadline registered1592worker2 # [ 0.672767] io scheduler kyber registered1593lb # [ 0.693709] Linux agpgart interface v0.1031594worker2 # [ 0.675458] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1595worker1 # [ 0.681337] Initialise system trusted keyrings1596worker2 # [ 0.676781] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1597lb # [ 0.696716] ACPI: bus type drm_connector registered1598worker1 # [ 0.684297] workingset: timestamp_bits=40 max_order=19 bucket_order=01599client # [ 0.696626] Key type asymmetric registered1600lb # [ 0.700770] usbcore: registered new interface driver usbserial_generic1601client # [ 0.699257] Asymmetric key parser 'x509' registered1602worker2 # [ 0.682657] Linux agpgart interface v0.1031603lb # [ 0.701975] usbserial: USB Serial support registered for generic1604worker2 # [ 0.683431] ACPI: bus type drm_connector registered1605client # [ 0.700099] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1606lb # [ 0.703105] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1607lb # [ 0.703105] Please enable it if your BIOS has the CPPC option.1608client # [ 0.703396] io scheduler mq-deadline registered1609worker2 # [ 0.686281] usbcore: registered new interface driver usbserial_generic1610lb # [ 0.705571] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1611client # [ 0.704116] io scheduler kyber registered1612worker2 # [ 0.687343] usbserial: USB Serial support registered for generic1613client # [ 0.706881] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1614lb # [ 0.709761] drop_monitor: Initializing network drop monitor service1615lb # [ 0.711008] NET: Registered PF_INET6 protocol family1616worker2 # [ 0.690836] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1617client # [ 0.708180] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1618worker2 # [ 0.690836] Please enable it if your BIOS has the CPPC option.1619worker2 # [ 0.693009] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1620lb # [ 0.716133] Segment Routing with IPv61621client # [ 0.713633] Linux agpgart interface v0.1031622worker2 # [ 0.696978] drop_monitor: Initializing network drop monitor service1623client # [ 0.714468] ACPI: bus type drm_connector registered1624worker2 # [ 0.698167] NET: Registered PF_INET6 protocol family1625lb # [ 0.718645] In-situ OAM (IOAM) with IPv61626lb # [ 0.719824] IPI shorthand broadcast: enabled1627client # [ 0.717679] usbcore: registered new interface driver usbserial_generic1628worker2 # [ 0.701345] Segment Routing with IPv61629client # [ 0.718814] usbserial: USB Serial support registered for generic1630worker1 # [ 0.707342] Key type asymmetric registered1631worker1 # [ 0.708108] Asymmetric key parser 'x509' registered1632worker2 # [ 0.703860] In-situ OAM (IOAM) with IPv61633worker1 # [ 0.709036] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1634worker2 # [ 0.704957] IPI shorthand broadcast: enabled1635client # [ 0.722246] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1636client # [ 0.722246] Please enable it if your BIOS has the CPPC option.1637worker1 # [ 0.712386] io scheduler mq-deadline registered1638worker1 # [ 0.713196] io scheduler kyber registered1639client # [ 0.724581] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1640lb # [ 0.729033] sched_clock: Marking stable (592018757, 136599467)->(806598256, -77980032)1641client # [ 0.728368] drop_monitor: Initializing network drop monitor service1642worker1 # [ 0.717403] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1643client # [ 0.729630] NET: Registered PF_INET6 protocol family1644worker2 # [ 0.713248] sched_clock: Marking stable (578013840, 134803271)->(788715156, -75898045)1645worker1 # [ 0.718768] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1646client # [ 0.732667] Segment Routing with IPv61647lb # [ 0.735945] registered taskstats version 11648lb # [ 0.737147] Loading compiled-in X.509 certificates1649worker2 # [ 0.718065] registered taskstats version 11650client # [ 0.735266] In-situ OAM (IOAM) with IPv61651worker1 # [ 0.724049] Linux agpgart interface v0.1031652worker2 # [ 0.719053] Loading compiled-in X.509 certificates1653client # [ 0.736359] IPI shorthand broadcast: enabled1654worker1 # [ 0.724855] ACPI: bus type drm_connector registered1655worker1 # [ 0.729679] usbcore: registered new interface driver usbserial_generic1656worker1 # [ 0.730826] usbserial: USB Serial support registered for generic1657client # [ 0.744628] sched_clock: Marking stable (605013816, 139205099)->(814882735, -70663820)1658worker1 # [ 0.734258] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1659worker1 # [ 0.734258] Please enable it if your BIOS has the CPPC option.1660worker1 # [ 0.736613] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1661client # [ 0.750435] registered taskstats version 11662client # [ 0.751397] Loading compiled-in X.509 certificates1663worker1 # [ 0.739393] drop_monitor: Initializing network drop monitor service1664worker1 # [ 0.740673] NET: Registered PF_INET6 protocol family1665worker2 # [ 0.737839] Demotion targets for Node 0: null1666worker2 # [ 0.738761] Key type .fscrypt registered1667worker2 # [ 0.739527] Key type fscrypt-provisioning registered1668worker1 # [ 0.745348] Segment Routing with IPv61669worker2 # [ 0.740524] ima: No TPM chip found, activating TPM-bypass!1670worker1 # [ 0.746022] In-situ OAM (IOAM) with IPv61671lb # [ 0.760730] Demotion targets for Node 0: null1672lb # [ 0.761801] Key type .fscrypt registered1673worker1 # [ 0.747129] IPI shorthand broadcast: enabled1674lb # [ 0.762557] Key type fscrypt-provisioning registered1675worker2 # [ 0.743843] ima: Allocated hash algorithm: sha11676worker2 # [ 0.744690] ima: No architecture policies found1677lb # [ 0.765746] ima: No TPM chip found, activating TPM-bypass!1678lb # [ 0.766728] ima: Allocated hash algorithm: sha11679lb # [ 0.767569] ima: No architecture policies found1680worker2 # [ 0.748841] PM: Magic number: 10:498:3991681worker2 # [ 0.750497] RAS: Correctable Errors collector initialized.1682worker1 # [ 0.755425] sched_clock: Marking stable (613013374, 142228314)->(832209779, -76968091)1683client # [ 0.768008] Demotion targets for Node 0: null1684lb # [ 0.772642] PM: Magic number: 10:498:3991685client # [ 0.771295] Key type .fscrypt registered1686client # [ 0.772004] Key type fscrypt-provisioning registered1687worker1 # [ 0.760488] registered taskstats version 11688client # [ 0.773001] ima: No TPM chip found, activating TPM-bypass!1689worker1 # [ 0.761541] Loading compiled-in X.509 certificates1690lb # [ 0.776627] RAS: Correctable Errors collector initialized.1691client # [ 0.775240] ima: Allocated hash algorithm: sha11692client # [ 0.776071] ima: No architecture policies found1693worker2 # [ 0.759564] clk: Disabling unused clocks1694worker2 # [ 0.761835] PM: genpd: Disabling unused power domains1695client # [ 0.780245] PM: Magic number: 10:498:3991696client # [ 0.781893] RAS: Correctable Errors collector initialized.1697lb # [ 0.786447] clk: Disabling unused clocks1698lb # [ 0.788643] PM: genpd: Disabling unused power domains1699client # [ 0.791035] clk: Disabling unused clocks1700worker1 # [ 0.779259] Demotion targets for Node 0: null1701worker1 # [ 0.783378] Key type .fscrypt registered1702client # [ 0.795238] PM: genpd: Disabling unused power domains1703worker1 # [ 0.784157] Key type fscrypt-provisioning registered1704worker1 # [ 0.785221] ima: No TPM chip found, activating TPM-bypass!1705worker1 # [ 0.788296] ima: Allocated hash algorithm: sha11706worker1 # [ 0.789169] ima: No architecture policies found1707worker1 # [ 0.792717] PM: Magic number: 10:498:3991708worker1 # [ 0.796538] RAS: Correctable Errors collector initialized.1709worker1 # [ 0.805332] clk: Disabling unused clocks1710worker1 # [ 0.806090] PM: genpd: Disabling unused power domains1711lb # [ 0.949652] Freeing initrd memory: 29092K1712lb # [ 0.952687] Freeing unused decrypted memory: 2028K1713lb # [ 0.955251] Freeing unused kernel image (initmem) memory: 3644K1714lb # [ 0.956294] Write protecting the kernel read-only data: 32768k1715lb # [ 0.958128] Freeing unused kernel image (text/rodata gap) memory: 1208K1716lb # [ 0.959641] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker2 # [ 0.941996] Freeing initrd memory: 29092K1718worker2 # [ 0.945410] Freeing unused decrypted memory: 2028K1719client # [ 0.964803] Freeing initrd memory: 29096K1720worker2 # [ 0.948204] Freeing unused kernel image (initmem) memory: 3644K1721worker2 # [ 0.949268] Write protecting the kernel read-only data: 32768k1722client # [ 0.968022] Freeing unused decrypted memory: 2028K1723worker2 # [ 0.951157] Freeing unused kernel image (text/rodata gap) memory: 1208K1724worker2 # [ 0.952664] Freeing unused kernel image (rodata/data gap) memory: 752K1725client # [ 0.970670] Freeing unused kernel image (initmem) memory: 3644K1726client # [ 0.971793] Write protecting the kernel read-only data: 32768k1727client # [ 0.973727] Freeing unused kernel image (text/rodata gap) memory: 1208K1728client # [ 0.975331] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker1 # [ 0.984944] Freeing initrd memory: 29092K1730worker1 # [ 0.988125] Freeing unused decrypted memory: 2028K1731worker1 # [ 0.990773] Freeing unused kernel image (initmem) memory: 3644K1732worker1 # [ 0.991877] Write protecting the kernel read-only data: 32768k1733worker1 # [ 0.993798] Freeing unused kernel image (text/rodata gap) memory: 1208K1734worker1 # [ 0.995356] Freeing unused kernel image (rodata/data gap) memory: 752K1735lb # [ 1.010777] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736lb # [ 1.011964] Run /init as init process1737lb # [ 1.021864] systemd[1]: Inserted module 'autofs4'1738worker2 # [ 1.004527] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739worker2 # [ 1.005611] Run /init as init process1740client # [ 1.027574] x86/mm: Checked W+X mappings: passed, no W+X pages found.1741client # [ 1.028657] Run /init as init process1742worker2 # [ 1.016438] systemd[1]: Inserted module 'autofs4'1743lb # [ 1.038038] fuse: init (API version 7.45)1744client # [ 1.038790] systemd[1]: Inserted module 'autofs4'1745lb # [ 1.043844] ACPI: \_SB_.GSIG: Enabled at IRQ 221746lb # [ 1.046413] ACPI: \_SB_.GSIH: Enabled at IRQ 231747lb # [ 1.049488] ACPI: \_SB_.GSIE: Enabled at IRQ 201748lb # [ 1.051914] ACPI: \_SB_.GSIF: Enabled at IRQ 211749worker2 # [ 1.033378] fuse: init (API version 7.45)1750client # [ 1.055332] fuse: init (API version 7.45)1751worker2 # [ 1.039403] ACPI: \_SB_.GSIG: Enabled at IRQ 221752worker2 # [ 1.041971] ACPI: \_SB_.GSIH: Enabled at IRQ 231753worker1 # [ 1.046782] x86/mm: Checked W+X mappings: passed, no W+X pages found.1754worker1 # [ 1.047930] Run /init as init process1755client # [ 1.061268] ACPI: \_SB_.GSIG: Enabled at IRQ 221756worker2 # [ 1.045330] ACPI: \_SB_.GSIE: Enabled at IRQ 201757client # [ 1.063739] ACPI: \_SB_.GSIH: Enabled at IRQ 231758worker2 # [ 1.048152] ACPI: \_SB_.GSIF: Enabled at IRQ 211759client # [ 1.067564] ACPI: \_SB_.GSIE: Enabled at IRQ 201760worker1 # [ 1.058111] systemd[1]: Inserted module 'autofs4'1761client # [ 1.070410] ACPI: \_SB_.GSIF: Enabled at IRQ 211762lb # [ 1.079759] systemd[1]: Successfully made /usr/ read-only.1763worker1 # [ 1.074875] fuse: init (API version 7.45)1764worker1 # [ 1.080826] ACPI: \_SB_.GSIG: Enabled at IRQ 221765worker1 # [ 1.083629] ACPI: \_SB_.GSIH: Enabled at IRQ 231766worker2 # [ 1.078840] systemd[1]: Successfully made /usr/ read-only.1767worker1 # [ 1.087069] ACPI: \_SB_.GSIE: Enabled at IRQ 201768client # [ 1.099041] systemd[1]: Successfully made /usr/ read-only.1769worker1 # [ 1.089647] ACPI: \_SB_.GSIF: Enabled at IRQ 211770worker1 # [ 1.115986] systemd[1]: Successfully made /usr/ read-only.1771lb # [ 1.416264] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772lb # [ 1.428232] systemd[1]: Detected virtualization kvm.1773lb # [ 1.430389] systemd[1]: Detected architecture x86-64.1774lb # [ 1.432527] systemd[1]: Running in initrd.1775lb # [ 1.435061] systemd[1]: Initializing machine ID from random generator.1776lb # [ 1.437910] systemd[1]: Hostname set to <lb>.1777worker2 # [ 1.415544] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker2 # [ 1.427378] systemd[1]: Detected virtualization kvm.1779client # [ 1.435697] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1780worker2 # [ 1.429601] systemd[1]: Detected architecture x86-64.1781client # [ 1.447867] systemd[1]: Detected virtualization kvm.1782worker2 # [ 1.431763] systemd[1]: Running in initrd.1783client # [ 1.450036] systemd[1]: Detected architecture x86-64.1784worker2 # [ 1.434369] systemd[1]: Initializing machine ID from random generator.1785client # [ 1.452262] systemd[1]: Running in initrd.1786worker2 # [ 1.437236] systemd[1]: Hostname set to <worker2>.1787client # [ 1.454786] systemd[1]: Initializing machine ID from random generator.1788client # [ 1.457711] systemd[1]: Hostname set to <client>.1789worker1 # [ 1.452572] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker1 # [ 1.465181] systemd[1]: Detected virtualization kvm.1791worker1 # [ 1.467416] systemd[1]: Detected architecture x86-64.1792worker1 # [ 1.469599] systemd[1]: Running in initrd.1793worker1 # [ 1.472082] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.475025] systemd[1]: Hostname set to <worker1>.1795lb # [ 1.657996] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796client # [ 1.663276] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker2 # [ 1.659946] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798client # [ 1.703234] systemd[1]: Queued start job for default target Initrd Default Target.1799client # [ 1.707768] systemd[1]: Created slice Slice /system/modprobe.1800client # [ 1.709084] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801lb # [ 1.712292] systemd[1]: Queued start job for default target Initrd Default Target.1802worker1 # [ 1.696875] systemd[1]: bpf-restrict-fs: LSM BPF program attached1803client # [ 1.710583] systemd[1]: Expecting device /dev/disk/by-label/nixos...1804client # [ 1.711740] systemd[1]: Reached target Path Units.1805client # [ 1.712645] systemd[1]: Reached target Slice Units.1806lb # [ 1.715919] systemd[1]: Created slice Slice /system/modprobe.1807client # [ 1.713544] systemd[1]: Reached target Swaps.1808client # [ 1.714334] systemd[1]: Reached target Timer Units.1809lb # [ 1.717088] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1810client # [ 1.715422] systemd[1]: Listening on D-Bus System Message Bus Socket.1811lb # [ 1.718468] systemd[1]: Expecting device /dev/disk/by-label/nixos...1812lb # [ 1.719557] systemd[1]: Reached target Path Units.1813client # [ 1.716657] systemd[1]: Listening on Journal Socket (/dev/log).1814lb # [ 1.720456] systemd[1]: Reached target Slice Units.1815client # [ 1.717852] systemd[1]: Listening on Journal Sockets.1816lb # [ 1.721322] systemd[1]: Reached target Swaps.1817client # [ 1.718856] systemd[1]: Listening on udev Control Socket.1818lb # [ 1.722120] systemd[1]: Reached target Timer Units.1819client # [ 1.719963] systemd[1]: Listening on udev Kernel Socket.1820lb # [ 1.723058] systemd[1]: Listening on D-Bus System Message Bus Socket.1821client # [ 1.720929] systemd[1]: Reached target Socket Units.1822lb # [ 1.724268] systemd[1]: Listening on Journal Socket (/dev/log).1823lb # [ 1.725362] systemd[1]: Listening on Journal Sockets.1824client # [ 1.723099] systemd[1]: Starting Create List of Static Device Nodes...1825lb # [ 1.726371] systemd[1]: Listening on udev Control Socket.1826lb # [ 1.727388] systemd[1]: Listening on udev Kernel Socket.1827lb # [ 1.728333] systemd[1]: Reached target Socket Units.1828client # [ 1.727286] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1829lb # [ 1.730119] systemd[1]: Starting Create List of Static Device Nodes...1830lb # [ 1.734683] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1831worker2 # [ 1.714873] systemd[1]: Queued start job for default target Initrd Default Target.1832worker2 # [ 1.718167] systemd[1]: Created slice Slice /system/modprobe.1833client # [ 1.736307] systemd[1]: Starting Load Kernel Module configfs...1834worker2 # [ 1.719337] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1835worker2 # [ 1.720744] systemd[1]: Expecting device /dev/disk/by-label/nixos...1836worker2 # [ 1.721904] systemd[1]: Reached target Path Units.1837worker2 # [ 1.722821] systemd[1]: Reached target Slice Units.1838lb # [ 1.742799] systemd[1]: Starting Load Kernel Module configfs...1839worker2 # [ 1.723686] systemd[1]: Reached target Swaps.1840worker2 # [ 1.724518] systemd[1]: Reached target Timer Units.1841worker2 # [ 1.725551] systemd[1]: Listening on D-Bus System Message Bus Socket.1842worker2 # [ 1.726829] systemd[1]: Listening on Journal Socket (/dev/log).1843worker2 # [ 1.728010] systemd[1]: Listening on Journal Sockets.1844worker2 # [ 1.729018] systemd[1]: Listening on udev Control Socket.1845worker2 # [ 1.730089] systemd[1]: Listening on udev Kernel Socket.1846worker2 # [ 1.731111] systemd[1]: Reached target Socket Units.1847worker2 # [ 1.732883] systemd[1]: Starting Create List of Static Device Nodes...1848client # [ 1.752712] systemd[1]: Starting Journal Service...1849worker2 # [ 1.736665] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1850lb # [ 1.757022] systemd[1]: Starting Journal Service...1851worker2 # [ 1.743451] systemd[1]: Starting Load Kernel Module configfs...1852lb # [ 1.764801] systemd[1]: Starting Load Kernel Modules...1853worker1 # [ 1.752936] systemd[1]: Queued start job for default target Initrd Default Target.1854client # [ 1.768333] systemd[1]: Starting Load Kernel Modules...1855worker1 # [ 1.757567] systemd[1]: Created slice Slice /system/modprobe.1856worker1 # [ 1.758735] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1857worker1 # [ 1.760110] systemd[1]: Expecting device /dev/disk/by-label/nixos...1858worker1 # [ 1.761185] systemd[1]: Reached target Path Units.1859worker1 # [ 1.762024] systemd[1]: Reached target Slice Units.1860worker1 # [ 1.762884] systemd[1]: Reached target Swaps.1861worker1 # [ 1.763659] systemd[1]: Reached target Timer Units.1862worker2 # [ 1.759010] systemd[1]: Starting Journal Service...1863worker1 # [ 1.764636] systemd[1]: Listening on D-Bus System Message Bus Socket.1864worker1 # [ 1.765883] systemd[1]: Listening on Journal Socket (/dev/log).1865worker1 # [ 1.767046] systemd[1]: Listening on Journal Sockets.1866worker1 # [ 1.768057] systemd[1]: Listening on udev Control Socket.1867worker1 # [ 1.769087] systemd[1]: Listening on udev Kernel Socket.1868worker1 # [ 1.770178] systemd[1]: Reached target Socket Units.1869lb # [ 1.773718] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1870worker1 # [ 1.772248] systemd[1]: Starting Create List of Static Device Nodes...1871worker2 # [ 1.771082] systemd[1]: Starting Load Kernel Modules...1872worker1 # [ 1.776083] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1873lb # [ 1.791563] netfs: FS-Cache loaded1874client # [ 1.776402] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1875lb # [ 1.796355] 9pnet: Installing 9P2000 support1876client # [ 1.794227] netfs: FS-Cache loaded1877worker1 # [ 1.784309] systemd[1]: Starting Load Kernel Module configfs...1878client # [ 1.799767] 9pnet: Installing 9P2000 support1879lb # [ 1.806428] systemd[1]: Starting Coldplug All udev Devices...1880worker2 # [ 1.775913] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1881worker1 # [ 1.799318] systemd[1]: Starting Journal Service...1882worker2 # [ 1.794945] netfs: FS-Cache loaded1883client # [ 1.815003] systemd[1]: Starting Coldplug All udev Devices...1884worker2 # [ 1.803288] 9pnet: Installing 9P2000 support1885lb # [ 1.824929] systemd[1]: Finished Create List of Static Device Nodes.1886worker1 # [ 1.810429] systemd[1]: Starting Load Kernel Modules...1887lb # [ 1.830262] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1888client # [ 1.829325] systemd[1]: Finished Create List of Static Device Nodes.1889worker2 # [ 1.817913] systemd[1]: Starting Coldplug All udev Devices...1890lb # [ 1.838061] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1891client # [ 1.836871] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1892worker2 # [ 1.823160] systemd-journald[67]: Collecting audit messages is disabled.1893lb # [ 1.843433] systemd-journald[67]: Collecting audit messages is disabled.1894client # [ 1.840897] systemd-journald[67]: Collecting audit messages is disabled.1895worker1 # [ 1.816349] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1896lb # [ 1.845085] systemd[1]: modprobe@configfs.service: Deactivated successfully.1897client # [ 1.844636] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1898worker1 # [ 1.835496] netfs: FS-Cache loaded1899lb # [ 1.850987] systemd[1]: Finished Load Kernel Module configfs.1900worker2 # [ 1.831381] systemd[1]: Finished Create List of Static Device Nodes.1901client # [ 1.851411] systemd[1]: modprobe@configfs.service: Deactivated successfully.1902worker1 # [ 1.840388] 9pnet: Installing 9P2000 support1903lb # [ 1.856111] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1904worker2 # [ 1.837466] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1905lb # [ 1.858859] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1906client # [ 1.859666] systemd[1]: Finished Load Kernel Module configfs.1907worker2 # [ 1.845900] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1908worker1 # [ 1.851437] systemd[1]: Starting Coldplug All udev Devices...1909client # [ 1.862377] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1910lb # [ 1.866776] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1911lb # [ 1.868454] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1912client # [ 1.866650] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1913worker2 # [ 1.852258] systemd[1]: modprobe@configfs.service: Deactivated successfully.1914client # [ 1.870279] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1915worker2 # [ 1.857876] systemd[1]: Finished Load Kernel Module configfs.1916worker1 # [ 1.866342] systemd[1]: Finished Create List of Static Device Nodes.1917client # [ 1.878529] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1918worker2 # [ 1.863267] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1919worker2 # [ 1.866089] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1920worker1 # [ 1.871810] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1921worker1 # [ 1.880630] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1922worker2 # [ 1.875850] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1923worker2 # [ 1.877529] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1924worker1 # [ 1.883129] systemd-journald[67]: Collecting audit messages is disabled.1925lb # [ 1.899137] systemd[1]: Finished Load Kernel Modules.1926worker1 # [ 1.886674] systemd[1]: modprobe@configfs.service: Deactivated successfully.1927client # [ 1.900280] systemd[1]: Finished Load Kernel Modules.1928lb # [ 1.904804] systemd[1]: Starting Apply Kernel Variables...1929worker1 # [ 1.892292] systemd[1]: Finished Load Kernel Module configfs.1930client # [ 1.909442] systemd[1]: Starting Apply Kernel Variables...1931worker1 # [ 1.898001] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1932worker1 # [ 1.900610] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1933lb # [ 1.918735] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1934worker1 # [ 1.910314] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1935client # [ 1.923351] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1936worker2 # [ 1.907071] systemd[1]: Finished Load Kernel Modules.1937lb # [ 1.927829] systemd[1]: Starting Create Static Device Nodes in /dev...1938worker1 # [ 1.913374] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1939worker2 # [ 1.915025] systemd[1]: Starting Apply Kernel Variables...1940client # [ 1.934837] systemd[1]: Starting Create Static Device Nodes in /dev...1941lb # [ 1.940289] systemd[1]: Finished Apply Kernel Variables.1942worker2 # [ 1.926954] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1943client # [ 1.947329] systemd[1]: Finished Apply Kernel Variables.1944worker2 # [ 1.935386] systemd[1]: Starting Create Static Device Nodes in /dev...1945worker1 # [ 1.942807] systemd[1]: Finished Load Kernel Modules.1946client # [ 1.820327] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.960675] systemd[1]: Started Journal Service.1947lb # [ 1.963720] systemd[1]: Finished Create Static Device Nodes in /dev.1948client # 1949worker1 # [ 1.950145] systemd[1]: Starting Apply Kernel Variables...1950client # [ 1.823335] systemd-modules-load[68]: Inserted module 'virtio_balloon'1951lb # [ 1.966863] systemd[1]: Started Journal Service.1952worker2 # [ 1.812092] systemd-modules-load[68]: Inserted module 'dm_mod'1953lb # [ 1.828835] systemd-modules-load[68]: Inserted module 'dm_mod'1954worker2 # [ 1.813395] systemd-modules-load[68]: Inserted module 'virtio_balloon'1955client # [ 1.826027] systemd-modules-load[68]: Inserted module 'virtio_gpu'1956lb # [ 1.832045] systemd-modules-load[68]: Inserted module 'virtio_balloon'1957worker2 # [ 1.814448] systemd-modules-load[68]: Inserted module 'virtio_gpu'1958lb # [ 1.833085] systemd-modules-load[68]: Inserted module 'virtio_gpu'1959worker2 # [ 1.952175] systemd[1]: Started Journal Service.1960worker1 # [ 1.961385] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1961worker2 # [ 1.824139] systemd[1]: Finished Apply Kernel Variables.1962lb # [ 1.843109] systemd[1]: Reached target Preparation for Local File Systems.1963client # [ 1.838958] systemd[1]: Finished Create Static Device Nodes in /dev.1964lb # [ 1.846069] systemd[1]: Reached target Local File Systems.1965client # [ 1.842071] systemd[1]: Reached target Preparation for Local File Systems.1966client # [ 1.843148] systemd[1]: Reached target Local File Systems.1967lb # [ 1.850858] systemd[1]: Starting Create System Files and Directories...1968worker1 # [ 1.972477] systemd[1]: Starting Create Static Device Nodes in /dev...1969client # [ 1.846154] systemd[1]: Starting Create System Files and Directories...1970lb # [ 1.852238] systemd[1]: Starting Rule-based Manager for Device Events and Files...1971client # [ 1.850478] systemd[1]: Starting Rule-based Manager for Device Events and Files...1972worker2 # [ 1.841074] systemd[1]: Finished Create Static Device Nodes in /dev.1973worker2 # [ 1.844072] systemd[1]: Reached target Preparation for Local File Systems.1974worker2 # [ 1.845032] systemd[1]: Reached target Local File Systems.1975worker2 # [ 1.845995] systemd[1]: Starting Create System Files and Directories...1976worker2 # [ 1.850987] systemd[1]: Starting Rule-based Manager for Device Events and Files...1977worker1 # [ 1.993809] systemd[1]: Finished Apply Kernel Variables.1978lb # [ 1.880173] systemd[1]: Finished Create System Files and Directories.1979worker1 # [ 2.006377] systemd[1]: Started Journal Service.1980client # [ 1.879172] systemd[1]: Finished Create System Files and Directories.1981worker1 # [ 1.865352] systemd-modules-load[68]: Inserted module 'dm_mod'1982worker1 # [ 1.867304] systemd-modules-load[68]: Inserted module 'virtio_balloon'1983worker1 # [ 1.869295] systemd-modules-load[68]: Inserted module 'virtio_gpu'1984worker1 # [ 1.873930] systemd[1]: Finished Create Static Device Nodes in /dev.1985worker2 # [ 1.876643] systemd[1]: Finished Create System Files and Directories.1986worker1 # [ 1.880771] systemd[1]: Reached target Preparation for Local File Systems.1987worker1 # [ 1.882143] systemd[1]: Reached target Local File Systems.1988lb # [ 1.902629] systemd-udevd[83]: Using default interface naming scheme 'v261'.1989worker1 # [ 1.884987] systemd[1]: Starting Create System Files and Directories...1990client # [ 1.904917] systemd-udevd[83]: Using default interface naming scheme 'v261'.1991worker1 # [ 1.891072] systemd[1]: Starting Rule-based Manager for Device Events and Files...1992worker2 # [ 1.902382] systemd-udevd[83]: Using default interface naming scheme 'v261'.1993lb # [ 1.928063] systemd[1]: Started Rule-based Manager for Device Events and Files.1994client # [ 1.929565] systemd[1]: Started Rule-based Manager for Device Events and Files.1995worker1 # [ 1.918558] systemd[1]: Finished Create System Files and Directories.1996worker2 # [ 1.925908] systemd[1]: Started Rule-based Manager for Device Events and Files.1997worker1 # [ 1.940743] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998lb # [ 1.971784] systemd[1]: Finished Coldplug All udev Devices.1999lb # [ 1.972683] systemd[1]: Reached target System Initialization.2000lb # [ 1.973490] systemd[1]: Reached target Basic System.
loading 1,503 hidden lines…
3504lb # [ 9.276410] [drm] Found bochs VGA, ID 0xb0c5.3505client: (finished: waiting for the VM to finish booting, in 9.79 seconds)3506lb # [ 9.276415] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.3507lb # [ 9.285632] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic3508lb # [ 9.317786] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input63509lb # [ 9.319892] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input53510lb # [ 9.344602] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 03511worker2 # [ 9.330135] kvm_amd: TSC scaling supported3512worker2 # [ 9.330597] kvm_amd: Nested Virtualization enabled3513worker2 # [ 9.333204] kvm_amd: Nested Paging enabled3514worker2 # [ 9.333738] kvm_amd: LBR virtualization supported3515worker2 # [ 9.334455] kvm_amd: Virtual VMLOAD VMSAVE supported3516worker2 # [ 9.335169] kvm_amd: Virtual GIF supported3517worker2 # [ 9.335639] kvm_amd: Virtual NMI enabled3518lb # [ 9.250963] systemd[1]: Starting Virtual Console Setup...3519client # [ 9.245406] dbus-broker-launch[442]: Looking up NSS user entry for 'systemd-timesync'...3520worker2 # [ 9.379629] EDAC MC: Ver: 3.0.03521client # [ 9.265811] dbus-broker-launch[442]: NSS returned no entry for 'systemd-timesync'3522client # [ 9.268649] dbus-broker-launch[442]: Invalid user-name in /nix/store/i187syzbavbkjz7z897lklr60jwf2ymx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3523lb # [ 9.292861] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3524client # [ 9.288270] systemd[1]: Stopped target Host and Network Name Lookups.3525lb # [ 9.294159] systemd[1]: Stopped Virtual Console Setup.3526client # [ 9.290129] systemd[1]: Stopping Host and Network Name Lookups...3527client # [ 9.291938] systemd[1]: Stopped target User and Group Name Lookups.3528lb # [ 9.300878] systemd[1]: Starting Virtual Console Setup...3529client # [ 9.294108] systemd[1]: Stopping User and Group Name Lookups...3530client # [ 9.298994] systemd-logind[462]: New seat seat0.3531client # [ 9.300844] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3532client # [ 9.304536] systemd[1]: nscd.service: Deactivated successfully.3533worker1 # [ 9.290658] systemd[1]: Finished register-nix-paths.service.3534client # [ 9.305484] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3535client # [ 9.309766] systemd-logind[462]: Watching system buttons on /dev/input/event2 (Power Button)3536client # [ 9.312934] systemd-logind[462]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3537client # [ 9.314102] systemd-logind[462]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3538client # [ 9.320982] systemd[1]: Started User Login Management.3539worker2 # [ 9.308992] systemd[1]: Finished register-nix-paths.service.3540client # [ 9.326328] systemd[1]: Started D-Bus System Message Bus.3541lb # [ 9.331891] systemd[1]: Finished register-nix-paths.service.3542client # [ 9.353486] systemd[1]: Starting linger-users.service...3543client # [ 9.366790] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3544lb # [ 9.497342] Console: switching to colour frame buffer device 160x503545client # [ 9.376938] dbus-broker-launch[442]: Ready3546worker1 # [ 9.362660] systemd-vconsole-setup[523]: Configuration of first virtual console was skipped, ignoring remaining ones.3547lb # [ 9.512355] ppdev: user-space parallel port driver3548worker1 # [ 9.366755] systemd[1]: Finished Virtual Console Setup.3549worker1 # [ 9.367707] systemd[1]: Reached target System Initialization.3550lb # [ 9.524957] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device3551worker1 # [ 9.369173] systemd[1]: Started Discard unused filesystem blocks once a week.3552worker1 # [ 9.371220] systemd[1]: Started Daily Cleanup of Temporary Directories.3553worker1 # [ 9.372224] systemd[1]: Reached target Timer Units.3554worker1 # [ 9.372940] systemd[1]: Listening on D-Bus System Message Bus Socket.3555worker1 # [ 9.373896] systemd[1]: Listening on Nix Daemon Socket.3556worker1 # [ 9.377448] systemd[1]: Listening on Nix worker-protocol over gRPC.3557lb # [ 9.535230] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3558worker1 # [ 9.379680] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3559worker1 # [ 9.380861] systemd[1]: Reached target Socket Units.3560worker1 # [ 9.381723] systemd[1]: Reached target Basic System.3561worker1 # [ 9.383764] systemd[1]: Started backdoor.service.3562worker1 # [ 9.388579] systemd[1]: Starting Import lastlog data into lastlog2 database...3563worker1 # [ 9.392069] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3564lb # [ 9.555325] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3565worker1 # [ 9.399966] systemd[1]: Starting Post-Boot Actions...3566worker1 # [ 9.405932] systemd[1]: Started Reset console on configuration changes.3567worker1 # [ 9.409305] systemd[1]: Starting resolvconf update...3568client # [ 9.428467] systemd[1]: linger-users.service: Deactivated successfully.3569client # [ 9.429601] systemd[1]: Finished linger-users.service.3570worker1 # [ 9.415792] systemd[1]: Starting D-Bus System Message Bus...3571client # [ 9.435908] nsncd[522]: Sep 19 21:21:30.069 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3572client # [ 9.438694] systemd[1]: Finished resolvconf update.3573lb # [ 9.444371] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3574client # [ 9.440932] systemd[1]: Started Name Service Cache Daemon (nsncd).3575lb # [ 9.446927] systemd[1]: Stopped Virtual Console Setup.3576client # [ 9.442827] systemd[1]: Reached target Host and Network Name Lookups.3577client # [ 9.445249] systemd[1]: Reached target User and Group Name Lookups.3578client # [ 9.448338] systemd[1]: Starting DHCP Client...3579lb # [ 9.457841] systemd[1]: Starting Virtual Console Setup...3580worker1 # [ 9.488411] systemd[1]: Finished Post-Boot Actions.3581lb # [ 9.673959] kvm_amd: TSC scaling supported3582lb # [ 9.674403] kvm_amd: Nested Virtualization enabled3583lb # [ 9.675171] kvm_amd: Nested Paging enabled3584worker2 # [ 9.519957] systemd-vconsole-setup[519]: Configuration of first virtual console was skipped, ignoring remaining ones.3585worker1 # connecting to host...3586lb # [ 9.675875] kvm_amd: LBR virtualization supported3587lb # [ 9.676391] kvm_amd: Virtual VMLOAD VMSAVE supported3588lb # [ 9.677092] kvm_amd: Virtual GIF supported3589lb # [ 9.677540] kvm_amd: Virtual NMI enabled3590worker2 # [ 9.522906] systemd[1]: Finished Virtual Console Setup.3591worker2 # [ 9.525325] systemd[1]: Reached target System Initialization.3592worker2 # [ 9.527068] systemd[1]: Started Discard unused filesystem blocks once a week.3593worker2 # [ 9.529229] systemd[1]: Started Daily Cleanup of Temporary Directories.3594worker1 # [ 9.527131] systemd[1]: Started Name Service Cache Daemon (nsncd).3595worker2 # [ 9.530266] systemd[1]: Reached target Timer Units.3596worker1 # [ 9.528071] systemd[1]: Reached target Host and Network Name Lookups.3597worker2 # [ 9.530994] systemd[1]: Listening on D-Bus System Message Bus Socket.3598worker1 # [ 9.528945] systemd[1]: Reached target User and Group Name Lookups.3599worker2 # [ 9.532070] systemd[1]: Listening on Nix Daemon Socket.3600worker2 # [ 9.535503] systemd[1]: Listening on Nix worker-protocol over gRPC.3601worker2 # [ 9.536610] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3602worker2 # [ 9.538905] systemd[1]: Reached target Socket Units.3603worker1 # [ 9.535464] nsncd[531]: Sep 19 21:21:30.559 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3604worker2 # [ 9.539826] systemd[1]: Reached target Basic System.3605worker1 # [ 9.539576] systemd[1]: Starting User Login Management...3606worker2 # [ 9.542985] systemd[1]: Started backdoor.service.3607worker1 # [ 9.541277] systemd[1]: Finished Import lastlog data into lastlog2 database.3608worker2 # [ 9.545828] systemd[1]: Starting Import lastlog data into lastlog2 database...3609client # [ 9.561811] dhcpcd[556]: dhcpcd-10.3.2 starting3610worker2 # [ 9.550087] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3611worker2 # [ 9.554160] systemd[1]: Starting Post-Boot Actions...3612client # [ 9.571798] dhcpcd[564]: dev: loaded udev3613worker2 # [ 9.560470] systemd[1]: Started Reset console on configuration changes.3614lb # [ 9.717948] EDAC MC: Ver: 3.0.03615worker2 # [ 9.568942] systemd[1]: Starting resolvconf update...3616worker2 # [ 9.576796] systemd[1]: Starting D-Bus System Message Bus...3617client # [ 9.731229] 8021q: 802.1Q VLAN Support v1.83618worker1 # [ 9.591365] dbus-broker-launch[535]: Looking up NSS user entry for 'systemd-timesync'...3619client # [ 9.619657] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3620worker1 # [ 9.606168] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync'3621worker1 # [ 9.608159] dbus-broker-launch[535]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3622worker1 # [ 9.632306] systemd[1]: Stopped target Host and Network Name Lookups.3623worker1 # [ 9.634219] systemd[1]: Stopping Host and Network Name Lookups...3624worker1 # [ 9.635942] systemd[1]: Stopped target User and Group Name Lookups.3625worker1 # [ 9.638436] systemd[1]: Stopping User and Group Name Lookups...3626worker1 # [ 9.640442] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3627worker1 # [ 9.642369] systemd[1]: nscd.service: Deactivated successfully.3628worker1 # [ 9.644529] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3629worker2 # [ 9.650375] systemd[1]: Finished Post-Boot Actions.3630worker1 # [ 9.656995] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3631worker1 # [ 9.658724] systemd[1]: Started D-Bus System Message Bus.3632worker1 # [ 9.666258] systemd-logind[557]: New seat seat0.3633worker1 # [ 9.673733] systemd-logind[557]: Watching system buttons on /dev/input/event2 (Power Button)3634worker1 # [ 9.675413] systemd-logind[557]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3635client # [ 9.831065] cfg80211: Loading compiled-in X.509 certificates for regulatory database3636worker1 # [ 9.679375] systemd-logind[557]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3637worker1 # [ 9.681810] systemd[1]: Started User Login Management.3638worker2 # connecting to host...3639worker1 # [ 9.685922] systemd[1]: Starting linger-users.service...3640worker2 # [ 9.691952] systemd[1]: Started Name Service Cache Daemon (nsncd).3641worker2 # [ 9.693221] systemd[1]: Reached target Host and Network Name Lookups.3642worker2 # [ 9.694139] systemd[1]: Reached target User and Group Name Lookups.3643worker2 # [ 9.699803] nsncd[527]: Sep 19 21:21:30.568 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3644worker2 # [ 9.703862] systemd[1]: Starting User Login Management...3645client # [ 9.719873] systemd[1]: Finished nftables firewall.3646client # [ 9.721732] systemd[1]: Reached target Preparation for Network.3647client # [ 9.864006] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3648worker2 # [ 9.712653] systemd[1]: Finished Import lastlog data into lastlog2 database.3649client # [ 9.864929] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3650client # [ 9.727670] systemd[1]: Starting Address configuration of eth1...3651client # [ 9.869559] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23652client # [ 9.870548] cfg80211: failed to load regulatory.db3653client # [ 9.734834] systemd[1]: Starting Extra networking commands....3654worker1 # [ 9.722748] dbus-broker-launch[535]: Ready3655worker1 # [ 9.745238] systemd[1]: Started Name Service Cache Daemon (nsncd).3656worker1 # [ 9.747811] systemd[1]: Reached target Host and Network Name Lookups.3657worker1 # [ 9.749813] nsncd[602]: Sep 19 21:21:30.782 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3658worker1 # [ 9.751990] systemd[1]: Reached target User and Group Name Lookups.3659worker2 # [ 9.758551] dbus-broker-launch[531]: Looking up NSS user entry for 'systemd-timesync'...3660worker1 # [ 9.758183] systemd[1]: linger-users.service: Deactivated successfully.3661worker1 # [ 9.759723] systemd[1]: Finished linger-users.service.3662worker2 # [ 9.774640] dbus-broker-launch[531]: NSS returned no entry for 'systemd-timesync'3663worker2 # [ 9.775740] dbus-broker-launch[531]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3664worker1 # [ 9.775114] systemd[1]: Finished resolvconf update.3665worker1 # [ 9.775813] systemd[1]: Reached target Preparation for Network.3666worker1 # [ 9.780484] systemd[1]: Starting DHCP Client...3667worker1 # [ 9.783046] systemd[1]: Starting Address configuration of eth1...3668worker1 # [ 9.787306] systemd[1]: Starting Extra networking commands....3669client # [ 9.944094] 8021q: adding VLAN 0 to HW filter on device eth03670client # [ 9.806560] dhcpcd[564]: eth0: waiting for carrier3671client # [ 9.809252] dhcpcd[564]: eth0: carrier acquired3672worker2 # [ 9.800676] systemd[1]: Stopped target Host and Network Name Lookups.3673client # [ 9.953083] 8021q: adding VLAN 0 to HW filter on device eth13674worker2 # [ 9.802563] systemd[1]: Stopping Host and Network Name Lookups...3675worker2 # [ 9.804164] systemd[1]: Stopped target User and Group Name Lookups.3676worker2 # [ 9.806162] systemd[1]: Stopping User and Group Name Lookups...3677worker2 # [ 9.806965] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3678client # [ 9.822099] dhcpcd[564]: DUID 00:01:00:01:32:41:b9:5a:52:54:00:12:34:563679worker2 # [ 9.810935] systemd[1]: nscd.service: Deactivated successfully.3680client # [ 9.823819] dhcpcd[564]: eth0: IAID 00:12:34:563681client # [ 9.824818] dhcpcd[564]: eth0: adding address fe80::5054:ff:fe12:34563682worker2 # [ 9.812832] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3683worker2 # [ 9.822194] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3684client # [ 9.834556] network-addresses-eth1-start[579]: adding address 192.168.1.1/24... done3685worker2 # [ 9.824292] systemd[1]: Started D-Bus System Message Bus.3686worker2 # [ 9.833279] systemd-logind[552]: New seat seat0.3687client # [ 9.846569] network-addresses-eth1-start[579]: adding address 2001:db8:1::1/64... done3688worker2 # [ 9.840981] systemd-logind[552]: Watching system buttons on /dev/input/event2 (Power Button)3689worker2 # [ 9.845154] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3690worker2 # [ 9.847350] systemd-logind[552]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3691client # [ 9.862841] systemd[1]: Finished Address configuration of eth1.3692worker2 # [ 9.850742] systemd[1]: Started User Login Management.3693worker2 # [ 9.851993] systemd[1]: Starting linger-users.service...3694client # [ 9.887911] systemd[1]: Finished Extra networking commands..3695client # [ 9.890179] systemd[1]: Reached target Network.3696client # [ 9.893088] systemd[1]: Starting Permit User Sessions...3697worker2 # [ 9.883829] dbus-broker-launch[531]: Ready3698lb # [ 9.905356] systemd-vconsole-setup[533]: Configuration of first virtual console was skipped, ignoring remaining ones.3699worker1 # [ 9.887655] network-addresses-eth1-start[631]: adding address 192.168.1.3/24... done3700lb # [ 9.909308] systemd[1]: Finished Virtual Console Setup.3701lb # [ 9.910501] systemd[1]: Reached target System Initialization.3702lb # [ 9.911947] systemd[1]: Started Discard unused filesystem blocks once a week.3703lb # [ 9.913207] systemd[1]: Started niks3 garbage collection timer.3704lb # [ 9.914541] systemd[1]: Started Daily Cleanup of Temporary Directories.3705lb # [ 9.915513] systemd[1]: Reached target Timer Units.3706lb # [ 9.917170] systemd[1]: Listening on D-Bus System Message Bus Socket.3707lb # [ 9.920652] systemd[1]: Listening on niks3 server socket.3708lb # [ 9.921684] systemd[1]: Listening on Nix Daemon Socket.3709lb # [ 9.923137] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3710lb # [ 9.924256] systemd[1]: Reached target Socket Units.3711lb # [ 9.924960] systemd[1]: Reached target Basic System.3712client # [ 9.919964] systemd[1]: Finished Permit User Sessions.3713worker2 # [ 9.907651] systemd[1]: Started Name Service Cache Daemon (nsncd).3714worker1 # [ 9.905215] network-addresses-eth1-start[631]: adding address 2001:db8:1::3/64... done3715worker2 # [ 9.908625] systemd[1]: Reached target Host and Network Name Lookups.3716lb # [ 9.928904] systemd[1]: Started backdoor.service.3717worker2 # [ 9.910361] nsncd[597]: Sep 19 21:21:30.788 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3718client # [ 9.924250] systemd[1]: Started Getty on tty1.3719client # [ 9.925329] systemd[1]: Reached target Login Prompts.3720worker2 # [ 9.913082] systemd[1]: Reached target User and Group Name Lookups.3721lb # [ 9.931086] systemd[1]: Starting Import lastlog data into lastlog2 database...3722lb # [ 9.934932] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3723worker2 # [ 9.920495] systemd[1]: linger-users.service: Deactivated successfully.3724worker2 # [ 9.922300] systemd[1]: Finished linger-users.service.3725lb # [ 9.941372] systemd[1]: Starting Post-Boot Actions...3726lb # [ 9.947313] systemd[1]: Started Reset console on configuration changes.3727worker1 # [ 9.927324] systemd[1]: Finished Address configuration of eth1.3728worker2 # [ 9.933902] systemd[1]: Finished resolvconf update.3729worker2 # [ 9.935298] systemd[1]: Reached target Preparation for Network.3730lb # [ 9.957528] systemd[1]: Starting resolvconf update...3731worker2 # [ 9.940475] systemd[1]: Starting DHCP Client...3732worker2 # [ 9.943228] systemd[1]: Starting Address configuration of eth1...3733worker2 # [ 9.947200] systemd[1]: Starting Extra networking commands....3734lb # [ 9.974717] systemd[1]: Started rustfs.service.3735worker1 # [ 9.954888] dhcpcd[639]: dhcpcd-10.3.2 starting3736worker1 # [ 9.965644] dhcpcd[694]: dev: loaded udev3737worker1 # [ 9.971515] systemd[1]: Finished Extra networking commands..3738worker1 # [ 9.973511] systemd[1]: Reached target Network.3739lb # [ 9.996189] systemd[1]: Starting rustfs-bucket.service...3740worker1 # [ 9.977238] systemd[1]: Starting Permit User Sessions...3741worker1 # [ 10.138524] 8021q: 802.1Q VLAN Support v1.83742worker1 # [ 10.138966] 8021q: adding VLAN 0 to HW filter on device eth13743lb # [ 10.028988] systemd[1]: Finished Post-Boot Actions.3744worker1 # [ 10.011211] systemd[1]: Finished Permit User Sessions.3745worker1 # [ 10.015345] systemd[1]: Started Getty on tty1.3746worker1 # [ 10.016552] systemd[1]: Reached target Login Prompts.3747lb # connecting to host...3748worker1 # [ 10.033069] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3749lb # [ 10.052693] nsncd[540]: Sep 19 21:21:30.565 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3750lb # [ 10.060109] systemd[1]: Started Name Service Cache Daemon (nsncd).3751lb # [ 10.068234] systemd[1]: Reached target Host and Network Name Lookups.3752lb # [ 10.070836] systemd[1]: Reached target User and Group Name Lookups.3753worker2 # [ 10.054173] network-addresses-eth1-start[627]: adding address 192.168.1.4/24... done3754lb # [ 10.079669] systemd[1]: Starting D-Bus System Message Bus...3755worker2 # [ 10.069829] network-addresses-eth1-start[627]: adding address 2001:db8:1::4/64... done3756lb # [ 10.108474] systemd[1]: Starting User Login Management...3757worker1 # [ 10.231900] cfg80211: Loading compiled-in X.509 certificates for regulatory database3758worker2 # [ 10.095121] systemd[1]: Finished Address configuration of eth1.3759lb # [ 10.119244] systemd[1]: Finished Import lastlog data into lastlog2 database.3760worker1 # [ 10.259874] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3761worker2 # [ 10.120414] dhcpcd[635]: dhcpcd-10.3.2 starting3762worker1 # [ 10.260742] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3763worker1 # [ 10.263723] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23764worker1 # [ 10.264591] cfg80211: failed to load regulatory.db3765worker2 # [ 10.130923] dhcpcd[689]: dev: loaded udev3766worker2 # [ 10.137910] systemd[1]: Finished Extra networking commands..3767worker2 # [ 10.140266] systemd[1]: Reached target Network.3768worker2 # [ 10.143684] systemd[1]: Starting Permit User Sessions...3769worker2 # [ 10.296245] 8021q: 802.1Q VLAN Support v1.83770worker2 # [ 10.296685] 8021q: adding VLAN 0 to HW filter on device eth13771worker1 # [ 10.315320] 8021q: adding VLAN 0 to HW filter on device eth03772worker1 # [ 10.174297] dhcpcd[694]: eth0: waiting for carrier3773worker2 # [ 10.176831] systemd[1]: Finished Permit User Sessions.3774worker1 # [ 10.175279] dhcpcd[694]: eth0: carrier acquired3775worker2 # [ 10.181606] systemd[1]: Started Getty on tty1.3776worker2 # [ 10.183342] systemd[1]: Reached target Login Prompts.3777worker1 # [ 10.184899] dhcpcd[694]: DUID 00:01:00:01:32:41:b9:5b:52:54:00:12:34:563778worker1 # [ 10.186174] dhcpcd[694]: eth0: IAID 00:12:34:563779worker1 # [ 10.186898] dhcpcd[694]: eth0: adding address fe80::5054:ff:fe12:34563780worker2 # [ 10.199227] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3781lb # [ 10.246356] dbus-broker-launch[567]: Looking up NSS user entry for 'systemd-timesync'...3782lb # [ 10.253237] systemd[1]: Stopped target Host and Network Name Lookups.3783lb # [ 10.254726] systemd[1]: Stopping Host and Network Name Lookups...3784lb # [ 10.256224] systemd[1]: Stopped target User and Group Name Lookups.3785lb # [ 10.258517] systemd[1]: Stopping User and Group Name Lookups...3786lb # [ 10.260596] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3787lb # [ 10.263793] systemd[1]: nscd.service: Deactivated successfully.3788lb # [ 10.266505] dbus-broker-launch[567]: NSS returned no entry for 'systemd-timesync'3789lb # [ 10.267735] dbus-broker-launch[567]: Invalid user-name in /nix/store/0vgm8r903b3kyr8fcdjkv3g9zyy4h8rn-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3790lb # [ 10.271360] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3791worker2 # [ 10.390893] cfg80211: Loading compiled-in X.509 certificates for regulatory database3792lb # [ 10.284950] systemd-logind[571]: New seat seat0.3793lb # [ 10.296273] systemd-logind[571]: Watching system buttons on /dev/input/event2 (Power Button)3794lb # [ 10.298137] systemd-logind[571]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3795lb # [ 10.300155] systemd-logind[571]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3796lb # [ 10.303173] systemd[1]: Started User Login Management.3797worker2 # [ 10.420165] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3798worker2 # [ 10.421082] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3799worker2 # [ 10.424399] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23800worker2 # [ 10.425343] cfg80211: failed to load regulatory.db3801lb # [ 10.315204] systemd[1]: Starting linger-users.service...3802lb # [ 10.327267] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3803lb # [ 10.335548] systemd[1]: Started D-Bus System Message Bus.3804worker2 # [ 10.480045] 8021q: adding VLAN 0 to HW filter on device eth03805worker2 # [ 10.346823] dhcpcd[689]: eth0: waiting for carrier3806worker2 # [ 10.347636] dhcpcd[689]: eth0: carrier acquired3807worker2 # [ 10.358054] dhcpcd[689]: DUID 00:01:00:01:32:41:b9:5b:52:54:00:12:34:563808worker2 # [ 10.358947] dhcpcd[689]: eth0: IAID 00:12:34:563809worker2 # [ 10.359622] dhcpcd[689]: eth0: adding address fe80::5054:ff:fe12:34563810lb # [ 10.386225] dbus-broker-launch[567]: Ready3811lb # [ 10.420333] systemd[1]: Finished resolvconf update.3812lb # [ 10.427706] systemd[1]: Reached target Preparation for Network.3813lb # [ 10.434612] systemd[1]: Starting DHCP Client...3814lb # [ 10.437782] nsncd[627]: Sep 19 21:21:30.952 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3815lb # [ 10.442477] systemd[1]: Starting Address configuration of eth1...3816client: (finished: waiting for unit network-addresses-eth1.service, in 11.09 seconds)3817client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3818lb # [ 10.450250] systemd[1]: Starting Extra networking commands....3819lb # [ 10.454904] systemd[1]: Started Name Service Cache Daemon (nsncd).3820lb # [ 10.460163] systemd[1]: linger-users.service: Deactivated successfully.3821lb # [ 10.466438] systemd[1]: Finished linger-users.service.3822lb # [ 10.473553] systemd[1]: Reached target Host and Network Name Lookups.3823lb # [ 10.478405] systemd[1]: Reached target User and Group Name Lookups.3824client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3825lb: waiting for unit network-addresses-eth1.service3826lb: waiting for the VM to finish booting3827lb: Guest shell says: b'Spawning backdoor root shell...\n'3828lb: connected to guest root shell3829lb: (connecting took 0.00 seconds)3830lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3831worker2 # [ 10.507553] dhcpcd[689]: eth0: soliciting a DHCP lease3832worker2 # [ 10.660898] NET: Registered PF_PACKET protocol family3833worker2 # [ 10.530550] dhcpcd[689]: eth0: offered 10.0.2.15 from 10.0.2.23834worker2 # [ 10.533177] dhcpcd[689]: eth0: probing address 10.0.2.15/243835client # [ 10.553582] dhcpcd[564]: eth0: soliciting a DHCP lease3836client # [ 10.717556] NET: Registered PF_PACKET protocol family3837lb # [ 10.589161] network-addresses-eth1-start[650]: adding address 192.168.1.2/24... done3838client # [ 10.584099] dhcpcd[564]: eth0: offered 10.0.2.15 from 10.0.2.23839client # [ 10.588301] dhcpcd[564]: eth0: probing address 10.0.2.15/243840lb # [ 10.605115] network-addresses-eth1-start[650]: adding address 2001:db8:1::2/64... done3841lb # [ 10.635624] systemd[1]: Finished Address configuration of eth1.3842lb # [ 10.708595] systemd[1]: Finished Extra networking commands..3843lb # [ 10.711268] systemd[1]: Reached target Network.3844lb # [ 10.719573] systemd[1]: Starting PostgreSQL Server...3845lb # [ 10.720594] dhcpcd[664]: dhcpcd-10.3.2 starting3846lb # [ 10.727102] systemd[1]: Starting Permit User Sessions...3847lb # [ 10.734089] dhcpcd[724]: dev: loaded udev3848lb # [ 10.903159] 8021q: 802.1Q VLAN Support v1.83849lb # [ 10.904894] 8021q: adding VLAN 0 to HW filter on device eth13850lb # [ 10.784580] systemd[1]: Finished Permit User Sessions.3851lb # [ 10.793327] systemd[1]: Started Getty on tty1.3852lb # [ 10.796399] systemd[1]: Reached target Login Prompts.3853lb # [ 10.829104] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3854lb # [ 11.041443] cfg80211: Loading compiled-in X.509 certificates for regulatory database3855lb # [ 11.084660] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3856lb # [ 11.085367] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3857lb # [ 11.089076] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23858lb # [ 11.090027] cfg80211: failed to load regulatory.db3859lb # [ 11.170237] 8021q: adding VLAN 0 to HW filter on device eth03860lb # [ 11.035855] dhcpcd[724]: eth0: waiting for carrier3861lb # [ 11.036942] dhcpcd[724]: eth0: carrier acquired3862lb # [ 11.053867] dhcpcd[724]: DUID 00:01:00:01:32:41:b9:5b:52:54:00:12:34:563863lb # [ 11.055494] dhcpcd[724]: eth0: IAID 00:12:34:563864lb # [ 11.056498] dhcpcd[724]: eth0: adding address fe80::5054:ff:fe12:34563865lb # [ 11.065387] postgresql-pre-start[739]: The files belonging to this database system will be owned by user "postgres".3866lb # [ 11.066828] postgresql-pre-start[739]: This user must also own the server process.3867lb # [ 11.078133] postgresql-pre-start[739]: The database cluster will be initialized with locale "en_US.UTF-8".3868lb # [ 11.079381] postgresql-pre-start[739]: The default database encoding has accordingly been set to "UTF8".3869lb # [ 11.080559] postgresql-pre-start[739]: The default text search configuration will be set to "english".3870lb # [ 11.081725] postgresql-pre-start[739]: Data page checksums are enabled.3871lb # [ 11.082552] postgresql-pre-start[739]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3872lb # [ 11.084084] postgresql-pre-start[739]: creating subdirectories ... ok3873lb # [ 11.085431] postgresql-pre-start[739]: selecting dynamic shared memory implementation ... posix3874worker1 # [ 11.161531] dhcpcd[694]: eth0: soliciting a DHCP lease3875lb # [ 11.184244] postgresql-pre-start[739]: selecting default "max_connections" ... 1003876worker1 # [ 11.332097] NET: Registered PF_PACKET protocol family3877worker1 # [ 11.197101] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.23878worker1 # [ 11.200592] dhcpcd[694]: eth0: probing address 10.0.2.15/243879lb # [ 11.275101] postgresql-pre-start[739]: selecting default "shared_buffers" ... 128MB3880lb # [ 11.318629] dhcpcd[724]: eth0: soliciting a DHCP lease3881lb # [ 11.472622] NET: Registered PF_PACKET protocol family3882lb # [ 11.341537] dhcpcd[724]: eth0: offered 10.0.2.15 from 10.0.2.23883lb # [ 11.344233] dhcpcd[724]: eth0: probing address 10.0.2.15/243884client # [ 11.378679] dhcpcd[564]: eth0: soliciting an IPv6 router3885client # [ 11.381922] dhcpcd[564]: eth0: Router Advertisement from fe80::23886client # [ 11.384310] dhcpcd[564]: eth0: adding address fec0::5054:ff:fe12:3456/643887client # [ 11.386589] dhcpcd[564]: eth0: adding route to fec0::/643888client # [ 11.388723] dhcpcd[564]: eth0: adding default route via fe80::23889lb: (finished: waiting for unit network-addresses-eth1.service, in 1.17 seconds)3890lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3891lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3892worker1: waiting for unit network-addresses-eth1.service3893worker1: waiting for the VM to finish booting3894worker1: Guest shell says: b'Spawning backdoor root shell...\n'3895worker1: connected to guest root shell3896worker1: (connecting took 0.00 seconds)3897worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3898worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3899worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3900worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3901worker2: waiting for unit network-addresses-eth1.service3902worker2: waiting for the VM to finish booting3903worker2: Guest shell says: b'Spawning backdoor root shell...\n'3904worker2: connected to guest root shell3905worker2: (connecting took 0.00 seconds)3906worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3907worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3908worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3909worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3910lb: waiting for unit niks3.service3911worker2 # [ 11.857510] dhcpcd[689]: eth0: soliciting an IPv6 router3912worker2 # [ 11.858749] dhcpcd[689]: eth0: Router Advertisement from fe80::23913worker2 # [ 11.859592] dhcpcd[689]: eth0: adding address fec0::5054:ff:fe12:3456/643914worker2 # [ 11.860475] dhcpcd[689]: eth0: adding route to fec0::/643915worker2 # [ 11.861272] dhcpcd[689]: eth0: adding default route via fe80::23916worker1 # [ 12.158434] dhcpcd[694]: eth0: soliciting an IPv6 router3917worker1 # [ 12.162462] dhcpcd[694]: eth0: Router Advertisement from fe80::23918worker1 # [ 12.164743] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/643919worker1 # [ 12.167121] dhcpcd[694]: eth0: adding route to fec0::/643920worker1 # [ 12.169214] dhcpcd[694]: eth0: adding default route via fe80::23921lb # [ 12.680478] dhcpcd[724]: eth0: soliciting an IPv6 router3922lb # [ 12.682626] dhcpcd[724]: eth0: Router Advertisement from fe80::23923lb # [ 12.683672] dhcpcd[724]: eth0: adding address fec0::5054:ff:fe12:3456/643924lb # [ 12.684901] dhcpcd[724]: eth0: adding route to fec0::/643925lb # [ 12.685952] dhcpcd[724]: eth0: adding default route via fe80::23926lb # [ 13.251130] postgresql-pre-start[739]: selecting default time zone ... UTC3927lb # [ 13.255390] postgresql-pre-start[739]: creating configuration files ... ok3928lb # [ 13.490866] postgresql-pre-start[739]: running bootstrap script ... ok3929lb # [ 14.097653] postgresql-pre-start[739]: performing post-bootstrap initialization ... ok3930lb # [ 14.253716] postgresql-pre-start[739]: syncing data to disk ... ok3931lb # [ 14.254624] postgresql-pre-start[739]: initdb: warning: enabling "trust" authentication for local connections3932lb # [ 14.255786] postgresql-pre-start[739]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3933lb # [ 14.257725] postgresql-pre-start[739]: Success. You can now start the database server using:3934lb # [ 14.258890] postgresql-pre-start[739]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3935lb # [ 14.406418] postgres[816]: [816] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3936lb # [ 14.410604] postgres[816]: [816] LOG: listening on IPv6 address "::1", port 54323937lb # [ 14.411910] postgres[816]: [816] LOG: listening on IPv4 address "127.0.0.1", port 54323938lb # [ 14.415350] postgres[816]: [816] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3939lb # [ 14.429114] postgres[825]: [825] LOG: database system was shut down at 2026-09-19 21:21:34 GMT3940lb # [ 14.434093] postgres[816]: [816] LOG: database system is ready to accept connections3941lb # [ 14.439066] systemd[1]: Started PostgreSQL Server.3942lb # [ 14.447058] systemd[1]: Starting PostgreSQL Setup Scripts...3943lb # [ 14.646816] postgresql-setup-start[836]: CREATE DATABASE3944lb # [ 14.693890] postgresql-setup-start[841]: CREATE ROLE3945lb # [ 14.715948] postgresql-setup-start[843]: ALTER DATABASE3946lb # [ 14.721663] systemd[1]: Finished PostgreSQL Setup Scripts.3947lb # [ 14.723486] systemd[1]: Reached target PostgreSQL.3948worker2 # [ 15.579803] dhcpcd[689]: eth0: leased 10.0.2.15 for 86400 seconds3949worker2 # [ 15.583398] dhcpcd[689]: eth0: adding route to 10.0.2.0/243950worker2 # [ 15.585725] dhcpcd[689]: eth0: adding default route via 10.0.2.23951client # [ 15.669512] dhcpcd[564]: eth0: leased 10.0.2.15 for 86400 seconds3952client # [ 15.674284] dhcpcd[564]: eth0: adding route to 10.0.2.0/243953client # [ 15.676556] dhcpcd[564]: eth0: adding default route via 10.0.2.23954worker2 # [ 15.707983] systemd[1]: Started DHCP Client.3955worker2 # [ 15.710319] systemd[1]: Reached target Multi-User System.3956worker2 # [ 15.711266] systemd[1]: Startup finished in 874ms (kernel) + 4.049s (initrd) + 10.786s (userspace) = 15.710s.3957client # [ 15.791533] systemd[1]: Started DHCP Client.3958client # [ 15.793962] systemd[1]: Reached target Multi-User System.3959client # [ 15.795444] systemd[1]: Startup finished in 892ms (kernel) + 4.106s (initrd) + 10.795s (userspace) = 15.795s.3960worker1 # [ 16.164784] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds3961worker1 # [ 16.167816] dhcpcd[694]: eth0: adding route to 10.0.2.0/243962worker1 # [ 16.170685] dhcpcd[694]: eth0: adding default route via 10.0.2.23963lb # [ 16.212115] dhcpcd[724]: eth0: leased 10.0.2.15 for 86400 seconds3964lb # [ 16.213600] dhcpcd[724]: eth0: adding route to 10.0.2.0/243965lb # [ 16.214649] dhcpcd[724]: eth0: adding default route via 10.0.2.23966worker1 # [ 16.303725] systemd[1]: Started DHCP Client.3967worker1 # [ 16.305954] systemd[1]: Reached target Multi-User System.3968worker1 # [ 16.306759] systemd[1]: Startup finished in 909ms (kernel) + 4.023s (initrd) + 11.372s (userspace) = 16.305s.3969lb # [ 16.337961] systemd[1]: Started DHCP Client.3970lb # [ 16.340597] systemd[1]: Reached target Network is Online.3971lb # [ 16.344680] systemd[1]: Started Envoy reverse proxy.3972lb # [ 16.349181] systemd[1]: Started mock-oidc.service.3973lb # [ 16.461665] mock-oidc-server[920]: Mock OIDC Server running3974lb # [ 16.463242] mock-oidc-server[920]: OIDC Address: 192.168.1.2:80803975lb # [ 16.464479] mock-oidc-server[920]: Issue Address: 0.0.0.0:80813976lb # [ 16.465622] mock-oidc-server[920]: Issuer: http://192.168.1.2:8080/oidc3977lb # [ 16.466676] mock-oidc-server[920]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3978lb # [ 16.467949] mock-oidc-server[920]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3979lb # [ 16.469595] mock-oidc-server[920]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3980lb # [ 16.941622] envoy[919]: [2026-09-19 21:21:37.456][919][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3981lb # [ 16.943371] envoy[919]: [2026-09-19 21:21:37.457][919][info][main] [source/server/server.cc:469] statically linked extensions:3982lb # [ 16.944801] envoy[919]: [2026-09-19 21:21:37.457][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3983lb # [ 16.946676] envoy[919]: [2026-09-19 21:21:37.457][919][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3984lb # [ 16.948707] envoy[919]: [2026-09-19 21:21:37.457][919][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3985lb # [ 16.951164] envoy[919]: [2026-09-19 21:21:37.457][919][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3986lb # [ 16.953461] envoy[919]: [2026-09-19 21:21:37.457][919][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3987lb # [ 16.955342] envoy[919]: [2026-09-19 21:21:37.457][919][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3988lb # [ 16.958249] envoy[919]: [2026-09-19 21:21:37.462][919][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3989lb # [ 16.960214] envoy[919]: [2026-09-19 21:21:37.462][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23990lb # [ 16.961809] envoy[919]: [2026-09-19 21:21:37.462][919][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3991lb # [ 16.965707] envoy[919]: [2026-09-19 21:21:37.462][919][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3992lb # [ 17.000425] envoy[919]: [2026-09-19 21:21:37.462][919][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3993lb # [ 17.005148] envoy[919]: [2026-09-19 21:21:37.462][919][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3994lb # [ 17.007758] envoy[919]: [2026-09-19 21:21:37.462][919][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3995lb # [ 17.010308] envoy[919]: [2026-09-19 21:21:37.464][919][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3996lb # [ 17.012489] envoy[919]: [2026-09-19 21:21:37.466][919][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3997lb # [ 17.016159] envoy[919]: [2026-09-19 21:21:37.466][919][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3998lb # [ 17.018244] envoy[919]: [2026-09-19 21:21:37.466][919][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3999lb # [ 17.020986] envoy[919]: [2026-09-19 21:21:37.466][919][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4000lb # [ 17.022960] envoy[919]: [2026-09-19 21:21:37.466][919][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84001lb # [ 17.024786] envoy[919]: [2026-09-19 21:21:37.466][919][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4002lb # [ 17.026568] envoy[919]: [2026-09-19 21:21:37.466][919][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4003lb # [ 17.028282] envoy[919]: [2026-09-19 21:21:37.469][919][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4004lb # [ 17.034595] envoy[919]: [2026-09-19 21:21:37.469][919][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4005lb # [ 17.036693] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4006lb # [ 17.038791] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4007lb # [ 17.040549] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4008lb # [ 17.042714] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4009lb # [ 17.044290] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4010lb # [ 17.046311] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4011lb # [ 17.048122] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4012lb # [ 17.049897] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4013lb # [ 17.052904] envoy[919]: [2026-09-19 21:21:37.470][919][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4014lb # [ 17.054619] envoy[919]: [2026-09-19 21:21:37.471][919][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4015lb # [ 17.060772] envoy[919]: [2026-09-19 21:21:37.471][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4016lb # [ 17.062635] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4017lb # [ 17.066877] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4018lb # [ 17.069985] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4019lb # [ 17.072389] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4020lb # [ 17.074268] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4021lb # [ 17.076969] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4022lb # [ 17.078768] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4023lb # [ 17.084587] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4024lb # [ 17.086091] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4025lb # [ 17.087823] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4026lb # [ 17.092070] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4027lb # [ 17.094122] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4028lb # [ 17.096127] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4029lb # [ 17.099204] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4030lb # [ 17.101049] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4031lb # [ 17.104350] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4032lb # [ 17.108857] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4033lb # [ 17.110612] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4034lb # [ 17.113193] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4035lb # [ 17.114860] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4036lb # [ 17.116386] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4037lb # [ 17.118858] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4038lb # [ 17.120899] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4039lb # [ 17.126258] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4040lb # [ 17.128163] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4041lb # [ 17.130315] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4042lb # [ 17.134968] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4043lb # [ 17.136849] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4044lb # [ 17.141084] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4045lb # [ 17.142965] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4046lb # [ 17.145360] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4047lb # [ 17.148201] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24048lb # [ 17.150478] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4049lb # [ 17.154475] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4050lb # [ 17.156966] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4051lb # [ 17.158799] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4052lb # [ 17.161603] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4053lb # [ 17.163883] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4054lb # [ 17.166264] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4055lb # [ 17.168480] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4056lb # [ 17.170234] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4057lb # [ 17.171901] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4058lb # [ 17.173426] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24059lb # [ 17.175121] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4060lb # [ 17.177331] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4061lb # [ 17.178983] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4062lb # [ 17.181830] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4063lb # [ 17.183679] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4064lb # [ 17.190854] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4065lb # [ 17.192527] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4066lb # [ 17.203698] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4067lb # [ 17.207688] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4068lb # [ 17.210151] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4069lb # [ 17.213235] envoy[919]: [2026-09-19 21:21:37.473][919][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4070lb # [ 17.215614] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4071lb # [ 17.217122] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14072lb # [ 17.219221] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4073lb # [ 17.221198] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4074lb # [ 17.223116] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4075lb # [ 17.229431] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4076lb # [ 17.231999] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4077lb # [ 17.241307] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4078lb # [ 17.247050] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4079lb # [ 17.248938] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4080lb # [ 17.250608] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4081lb # [ 17.252333] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4082lb # [ 17.254756] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4083lb # [ 17.257986] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4084lb # [ 17.260187] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4085lb # [ 17.262145] envoy[919]: [2026-09-19 21:21:37.506][919][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4086lb # [ 17.264130] envoy[919]: [2026-09-19 21:21:37.626][919][info][main] [source/server/server.cc:531] HTTP header map info:4087lb # [ 17.265442] envoy[919]: [2026-09-19 21:21:37.672][919][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4088lb # [ 17.278146] envoy[919]: [2026-09-19 21:21:37.672][919][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4089lb # [ 17.279505] envoy[919]: [2026-09-19 21:21:37.672][919][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4090lb # [ 17.287267] envoy[919]: [2026-09-19 21:21:37.672][919][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4091lb # [ 17.324590] envoy[919]: [2026-09-19 21:21:37.840][919][info][main] [source/server/server.cc:968] runtime: {}4092lb # [ 17.333245] envoy[919]: [2026-09-19 21:21:37.848][919][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4093lb # [ 17.335932] envoy[919]: [2026-09-19 21:21:37.851][919][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014094lb # [ 17.338753] envoy[919]: [2026-09-19 21:21:37.854][919][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014095lb # [ 17.342338] envoy[919]: [2026-09-19 21:21:37.857][919][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4096lb # [ 17.344174] envoy[919]: [2026-09-19 21:21:37.859][919][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4097lb # [ 17.345751] envoy[919]: [2026-09-19 21:21:37.859][919][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4098lb # [ 17.414495] envoy[919]: [2026-09-19 21:21:37.930][919][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4099worker1 # [ 17.395661] systemd[1]: Starting Nix worker-protocol over gRPC...4100worker2 # [ 17.405765] systemd[1]: Starting Nix worker-protocol over gRPC...4101lb # [ 17.440337] envoy[919]: [2026-09-19 21:21:37.956][919][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4102lb # [ 17.442750] envoy[919]: [2026-09-19 21:21:37.958][919][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4103lb # [ 17.445699] envoy[919]: [2026-09-19 21:21:37.958][919][info][main] [source/server/server.cc:1077] starting main dispatch loop4104worker1 # [ 17.576491] nix-grpc-daemon[785]: ts=2026-09-19T21:21:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4105worker1 # [ 17.585736] nix-grpc-daemon[785]: ts=2026-09-19T21:21:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14106worker2 # [ 17.607321] nix-grpc-daemon[781]: ts=2026-09-19T21:21:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4107worker2 # [ 17.616476] nix-grpc-daemon[781]: ts=2026-09-19T21:21:38Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14108worker1 # [ 17.618084] nix-grpc-daemon[785]: ts=2026-09-19T21:21:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4109worker1 # [ 17.622706] systemd[1]: Started Nix worker-protocol over gRPC.4110worker2 # [ 17.657410] nix-grpc-daemon[781]: ts=2026-09-19T21:21:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4111worker2 # [ 17.662702] systemd[1]: Started Nix worker-protocol over gRPC.4112worker1 # [ 17.664313] nix-grpc-daemon[785]: ts=2026-09-19T21:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4113lb # [ 17.687594] envoy[919]: [2026-09-19 21:21:38.203][919][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4114lb # [ 17.692743] envoy[919]: [2026-09-19 21:21:38.203][919][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4115lb # [ 17.698281] envoy[919]: [2026-09-19 21:21:38.203][919][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4116lb # [ 17.703453] envoy[919]: [2026-09-19 21:21:38.208][919][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4117worker2 # [ 17.714786] nix-grpc-daemon[781]: ts=2026-09-19T21:21:38Z level=info event=scheduler_connected addr=lb:500514118worker1 # [ 17.736070] nix-grpc-daemon[785]: ts=2026-09-19T21:21:38Z level=info event=worker_hello addr=192.168.1.4:50051 system=x86_64-linux max_jobs=1 running=04119worker1 # [ 17.865385] nix-grpc-daemon[785]: ts=2026-09-19T21:21:38Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4120worker1 # [ 18.265784] nix-grpc-daemon[785]: ts=2026-09-19T21:21:39Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4121worker1 # [ 19.070472] nix-grpc-daemon[785]: ts=2026-09-19T21:21:40Z level=info event=scheduler_connected addr=lb:500514122worker1 # [ 19.074812] nix-grpc-daemon[785]: ts=2026-09-19T21:21:40Z level=info event=worker_hello addr=192.168.1.3:50051 system=x86_64-linux max_jobs=1 running=04123lb # [ 27.234060] rustfs-bucket-start[1020]: mb s3://farm4124lb # [ 27.238956] systemd[1]: Finished rustfs-bucket.service.4125lb # [ 27.245773] systemd[1]: Starting niks3 server...4126lb # [ 27.455491] postgres[1045]: [1045] ERROR: relation "goose_db_version" does not exist at character 364127lb # [ 27.456726] postgres[1045]: [1045] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4128lb # [ 27.497266] niks3-server[1039]: 2026/09/19 21:21:48 OK 20241026095416_initial_model.sql (19.59ms)4129lb # [ 27.500483] niks3-server[1039]: 2026/09/19 21:21:48 OK 20251210153512_drop_unused_gin_index.sql (3.52ms)4130lb # [ 27.505727] niks3-server[1039]: 2026/09/19 21:21:48 OK 20251218171726_add_pins.sql (3.95ms)4131lb # [ 27.510660] niks3-server[1039]: 2026/09/19 21:21:48 OK 20260628120000_add_object_size_and_stats.sql (3.76ms)4132lb # [ 27.514889] niks3-server[1039]: 2026/09/19 21:21:48 OK 20260905000000_add_claims.sql (2.83ms)4133lb # [ 27.515969] niks3-server[1039]: 2026/09/19 21:21:48 goose: successfully migrated database to version: 202609050000004134lb # [ 27.521421] niks3-server[1039]: 2026/09/19 21:21:48 OK 1_commit_pending_closure.sql (6.61ms)4135lb # [ 27.523930] niks3-server[1039]: 2026/09/19 21:21:48 OK 2_object_stats_trigger.sql (1.31ms)4136lb # [ 27.525172] niks3-server[1039]: 2026/09/19 21:21:48 goose: up to current file version: 24137lb # [ 27.530754] niks3-server[1039]: 2026/09/19 21:21:48 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4138lb # [ 27.605258] niks3-server[1039]: 2026/09/19 21:21:48 INFO Read proxy enabled — serving cache objects from S34139lb # [ 27.607164] niks3-server[1039]: 2026/09/19 21:21:48 INFO Using socket-activated listener address=0.0.0.0:57514140lb # [ 27.611696] niks3-server[1039]: 2026/09/19 21:21:48 INFO systemd watchdog enabled interval=15s4141lb # [ 27.613796] systemd[1]: Started niks3 server.4142lb # [ 27.614604] systemd[1]: Reached target Multi-User System.4143lb # [ 27.616912] niks3-server[1039]: 2026/09/19 21:21:48 INFO Starting HTTP server address=0.0.0.0:57514144lb # [ 27.618335] systemd[1]: Startup finished in 878ms (kernel) + 4.831s (initrd) + 21.906s (userspace) = 27.616s.4145lb: (finished: waiting for unit niks3.service, in 16.42 seconds)4146lb: waiting for TCP port 5751 on localhost4147lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4148lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4149lb: waiting for unit envoy.service4150lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4151lb: waiting for TCP port 50051 on localhost4152lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4153lb # [ 28.430364] envoy[919]: conn peer=[::1]:36354 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34154lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4155lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4156??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4157 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284158lb: must succeed: curl -sf localhost:9901/clusters4159lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4160lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4161lb: waiting until exactly no endpoints of sched are unhealthy4162lb: must succeed: curl -sf localhost:9901/clusters4163lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4164lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.04 seconds)4165subtest: both builders hold a WorkerSession on the scheduler4166worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4167worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4168(finished: subtest: both builders hold a WorkerSession on the scheduler, in 0.06 seconds)4169subtest: balancer auth: client cert, bearer token, nothing, unknown CN4170worker1 # [ 29.072526] nix-grpc-daemon[785]: ts=2026-09-19T21:21:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552884171worker1 # [ 29.086725] systemd[1]: Started Nix Daemon.4172worker1 # [ 29.301150] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4173worker1 # [ 29.361090] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)4174worker1 # [ 29.424562] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)4175worker1 # [ 29.531464] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 369 ms (attempt 3/5)4176worker1 # [ 29.906564] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 517 ms (attempt 4/5)4177worker1 # [ 30.435083] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4178worker1 # [ 30.472782] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552884179worker1 # [ 30.491755] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=debug event=path_info_miss path=69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test error="error: path '/nix/store/69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test' is required, but there is no substituter that can build it"4180worker1 # [ 30.501612] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552884181worker1 # [ 30.510628] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=debug event=path_info_miss path=69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test error="error: path '/nix/store/69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test' is required, but there is no substituter that can build it"4182client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4183client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4184client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4185client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4186worker1 # [ 30.892601] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=info event=oidc_jwks provider=mock keys=14187worker1 # [ 30.895810] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:552884188worker1 # [ 30.907760] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:552884189worker1 # [ 30.916499] nix-grpc-daemon[785]: ts=2026-09-19T21:21:51Z level=debug event=path_info_miss path=69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test error="error: path '/nix/store/69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test' is required, but there is no substituter that can build it"4190worker2 # [ 30.957358] nix-grpc-daemon[781]: ts=2026-09-19T21:21:51Z level=info event=oidc_jwks provider=mock keys=14191worker2 # [ 30.960505] nix-grpc-daemon[781]: ts=2026-09-19T21:21:51Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:386844192worker2 # [ 30.972517] systemd[1]: Started Nix Daemon.4193worker2 # [ 31.188109] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4194worker2 # [ 31.221222] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 1/5)4195worker2 # [ 31.316141] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 190 ms (attempt 2/5)4196worker2 # [ 31.512371] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 3/5)4197worker2 # [ 31.569656] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 774 ms (attempt 4/5)4198worker2 # [ 32.356937] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4199worker2 # [ 32.376575] nix-grpc-daemon[781]: ts=2026-09-19T21:21:53Z level=debug event=path_info_miss path=69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test error="error: path '/nix/store/69m3jxd97a84a7r43pzvbjg4mhfawz9q-nixos-system-client-test' is required, but there is no substituter that can build it"4200client: must succeed: rm -r /var/lib/nix-grpc-store4201client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4202worker1 # [ 32.631744] nix-grpc-daemon[785]: ts=2026-09-19T21:21:53Z level=info event=denied method=QueryMissing cn=- role=none4203worker1 # [ 32.838181] nix-grpc-daemon[785]: ts=2026-09-19T21:21:53Z level=info event=denied method=QueryMissing cn=stranger role=none4204(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.12 seconds)4205subtest: DAG build is scheduled across workers and lands in the cache4206client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24207worker1 # [ 33.066281] nix-grpc-daemon[785]: ts=2026-09-19T21:21:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552884208client # don't know how to build these paths:4209client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4210worker1 # [ 33.115459] nix-grpc-daemon[785]: ts=2026-09-19T21:21:54Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04211worker1 # [ 33.120224] nix-grpc-daemon[785]: ts=2026-09-19T21:21:54Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14212worker2 # [ 33.170769] nix-grpc-daemon[781]: ts=2026-09-19T21:21:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844213worker2 # [ 33.196326] nix-grpc-daemon[781]: ts=2026-09-19T21:21:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844214client # copying 1 paths to 'lb:50051'...4215worker2 # [ 33.209911] nix-grpc-daemon[781]: ts=2026-09-19T21:21:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386844216client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4217worker2 # [ 33.236181] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4218worker2 # [ 33.263223] nix-grpc-daemon[781]: ts=2026-09-19T21:21:54Z level=info event=niks3_push_started pid=8144219worker2 # [ 33.719632] nix-daemon[804]: accepted connection from pid 825, user nix-grpc-daemon (trusted)4220worker2 # [ 33.737064] nix-daemon[804]: reaped child process 829, status = succeeded4221worker2 # [ 33.882036] nix-daemon[804]: accepted connection from pid 831, user nix-grpc-daemon (trusted)4222worker2 # [ 33.895143] nix-daemon[804]: reaped child process 834, status = succeeded4223lb # [ 33.924815] niks3-server[1039]: 2026/09/19 21:21:54 INFO Received uploads request method=POST path=/api/pending_closures4224worker2 # [ 33.937981] nix-grpc-daemon[814]: time=2026-09-19T21:21:54.816Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4225worker2 # [ 33.940202] nix-grpc-daemon[814]: time=2026-09-19T21:21:54.817Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4226lb # [ 33.998097] niks3-server[1039]: 2026/09/19 21:21:54 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4227lb # [ 34.000826] niks3-server[1039]: 2026/09/19 21:21:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4228lb # [ 34.012826] niks3-server[1039]: 2026/09/19 21:21:54 INFO Signed narinfos id=1 count=14229worker2 # [ 33.995445] nix-grpc-daemon[814]: time=2026-09-19T21:21:54.875Z level=INFO msg="Uploading 1 narinfos"4230lb # [ 34.027506] niks3-server[1039]: 2026/09/19 21:21:54 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4231lb # [ 34.033456] niks3-server[1039]: 2026/09/19 21:21:54 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4232lb # [ 34.038808] niks3-server[1039]: 2026/09/19 21:21:54 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4233lb # [ 34.050909] niks3-server[1039]: 2026/09/19 21:21:54 INFO Completed upload id=14234worker2 # [ 34.033584] nix-grpc-daemon[814]: time=2026-09-19T21:21:54.913Z level=INFO msg="Upload complete. (490ms)"4235worker2 # [ 34.039795] nix-grpc-daemon[781]: ts=2026-09-19T21:21:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=0 paths=1 nar_bytes_in=5044236worker2 # [ 34.048153] nix-grpc-daemon[781]: ts=2026-09-19T21:21:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844237worker2 # [ 34.061121] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4238worker2 # [ 34.068398] nix-daemon[804]: reaped child process 812, status = succeeded4239client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4240client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4241worker2 # [ 34.078507] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4242client # farm-a> LOG-farm-a-t14243worker2 # [ 35.304830] nix-daemon[804]: reaped child process 838, status = succeeded4244worker2 # [ 35.461255] nix-daemon[804]: accepted connection from pid 853, user nix-grpc-daemon (trusted)4245worker2 # [ 35.474653] nix-daemon[804]: reaped child process 856, status = succeeded4246lb # [ 35.505791] niks3-server[1039]: 2026/09/19 21:21:56 INFO Received uploads request method=POST path=/api/pending_closures4247worker2 # [ 35.494041] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.373Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4248worker2 # [ 35.495764] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.375Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4249lb # [ 35.536398] niks3-server[1039]: 2026/09/19 21:21:56 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4250lb # [ 35.541731] niks3-server[1039]: 2026/09/19 21:21:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4251lb # [ 35.543764] niks3-server[1039]: 2026/09/19 21:21:56 INFO Signed narinfos id=2 count=14252worker2 # [ 35.527987] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.407Z level=INFO msg="Uploading 1 narinfos"4253lb # [ 35.546468] niks3-server[1039]: 2026/09/19 21:21:56 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4254lb # [ 35.550414] niks3-server[1039]: 2026/09/19 21:21:56 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4255lb # [ 35.556176] niks3-server[1039]: 2026/09/19 21:21:56 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4256lb # [ 35.562170] niks3-server[1039]: 2026/09/19 21:21:56 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4257lb # [ 35.564232] niks3-server[1039]: 2026/09/19 21:21:56 INFO Completed upload id=24258worker2 # [ 35.546570] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.426Z level=INFO msg="Upload complete. (256ms)"4259worker2 # [ 35.549816] nix-grpc-daemon[781]: ts=2026-09-19T21:21:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14260worker2 # [ 35.556579] nix-daemon[804]: reaped child process 836, status = succeeded4261worker1 # [ 35.558596] nix-grpc-daemon[785]: ts=2026-09-19T21:21:56Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04262worker1 # [ 35.560557] nix-grpc-daemon[785]: ts=2026-09-19T21:21:56Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14263worker2 # [ 35.604190] nix-grpc-daemon[781]: ts=2026-09-19T21:21:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844264worker2 # [ 35.614936] nix-grpc-daemon[781]: ts=2026-09-19T21:21:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844265worker2 # [ 35.628575] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.508Z level=INFO msg="All 1 paths already cached"4266client # copying 1 paths to 'lb:50051'...4267worker2 # [ 35.636864] nix-grpc-daemon[781]: ts=2026-09-19T21:21:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386844268client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4269worker2 # [ 35.655601] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4270worker2 # [ 35.828331] nix-daemon[804]: accepted connection from pid 861, user nix-grpc-daemon (trusted)4271worker2 # [ 35.842888] nix-daemon[804]: reaped child process 864, status = succeeded4272worker2 # [ 36.004063] nix-daemon[804]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4273worker2 # [ 36.018199] nix-daemon[804]: reaped child process 870, status = succeeded4274lb # [ 36.048883] niks3-server[1039]: 2026/09/19 21:21:56 INFO Received uploads request method=POST path=/api/pending_closures4275worker2 # [ 36.043223] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.922Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4276worker2 # [ 36.044633] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.922Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4277lb # [ 36.081790] niks3-server[1039]: 2026/09/19 21:21:56 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4278lb # [ 36.090420] niks3-server[1039]: 2026/09/19 21:21:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4279worker2 # [ 36.079327] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.958Z level=INFO msg="Uploading 1 narinfos"4280lb # [ 36.096817] niks3-server[1039]: 2026/09/19 21:21:56 INFO Signed narinfos id=3 count=14281lb # [ 36.101380] niks3-server[1039]: 2026/09/19 21:21:56 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4282lb # [ 36.115390] niks3-server[1039]: 2026/09/19 21:21:56 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4283worker2 # [ 36.103286] nix-grpc-daemon[814]: time=2026-09-19T21:21:56.982Z level=INFO msg="Upload complete. (431ms)"4284lb # [ 36.120816] niks3-server[1039]: 2026/09/19 21:21:56 INFO Completed upload id=34285worker2 # [ 36.106070] nix-grpc-daemon[781]: ts=2026-09-19T21:21:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=0 paths=1 nar_bytes_in=6244286lb # [ 36.125418] niks3-server[1039]: 2026/09/19 21:21:56 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4287worker2 # [ 36.109245] nix-grpc-daemon[781]: ts=2026-09-19T21:21:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844288worker2 # [ 36.119059] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4289worker2 # [ 36.122573] nix-daemon[804]: reaped child process 858, status = succeeded4290client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4291client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4292worker2 # [ 36.127411] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4293lb # [ 37.425680] envoy[919]: conn peer=[2001:db8:1::1]:51952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=14914294lb # [ 37.429924] envoy[919]: conn peer=[2001:db8:1::1]:51954 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2630 tx=422 ms=15244295lb # [ 37.433660] envoy[919]: conn peer=[2001:db8:1::1]:51968 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94296lb # [ 37.436911] envoy[919]: conn peer=[2001:db8:1::1]:57658 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=94297client # farm-b> LOG-farm-b-t14298worker2 # [ 37.554634] nix-daemon[804]: reaped child process 874, status = succeeded4299worker2 # [ 37.711534] nix-daemon[804]: accepted connection from pid 889, user nix-grpc-daemon (trusted)4300worker2 # [ 37.724217] nix-daemon[804]: reaped child process 892, status = succeeded4301lb # [ 37.756673] niks3-server[1039]: 2026/09/19 21:21:58 INFO Received uploads request method=POST path=/api/pending_closures4302worker2 # [ 37.747499] nix-grpc-daemon[814]: time=2026-09-19T21:21:58.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4303worker2 # [ 37.749121] nix-grpc-daemon[814]: time=2026-09-19T21:21:58.628Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4304lb # [ 37.788753] niks3-server[1039]: 2026/09/19 21:21:58 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4305lb # [ 37.798635] niks3-server[1039]: 2026/09/19 21:21:58 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4306lb # [ 37.812082] niks3-server[1039]: 2026/09/19 21:21:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4307worker2 # [ 37.800533] nix-grpc-daemon[814]: time=2026-09-19T21:21:58.680Z level=INFO msg="Uploading 1 narinfos"4308lb # [ 37.817962] niks3-server[1039]: 2026/09/19 21:21:58 INFO Signed narinfos id=4 count=14309lb # [ 37.821623] niks3-server[1039]: 2026/09/19 21:21:58 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4310lb # [ 37.833795] niks3-server[1039]: 2026/09/19 21:21:58 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4311lb # [ 37.836885] niks3-server[1039]: 2026/09/19 21:21:58 INFO Completed upload id=44312worker2 # [ 37.819486] nix-grpc-daemon[814]: time=2026-09-19T21:21:58.699Z level=INFO msg="Upload complete. (282ms)"4313lb # [ 37.838321] niks3-server[1039]: 2026/09/19 21:21:58 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4314worker2 # [ 37.824538] nix-grpc-daemon[781]: ts=2026-09-19T21:21:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14315worker1 # [ 37.825930] nix-grpc-daemon[785]: ts=2026-09-19T21:21:58Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04316worker1 # [ 37.828079] nix-grpc-daemon[785]: ts=2026-09-19T21:21:58Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14317worker2 # [ 37.836835] nix-daemon[804]: reaped child process 872, status = succeeded4318worker2 # [ 37.871834] nix-grpc-daemon[781]: ts=2026-09-19T21:21:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844319worker2 # [ 37.883354] nix-grpc-daemon[781]: ts=2026-09-19T21:21:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844320worker2 # [ 37.895323] nix-grpc-daemon[814]: time=2026-09-19T21:21:58.775Z level=INFO msg="All 2 paths already cached"4321client # copying 1 paths to 'lb:50051'...4322client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4323worker2 # [ 37.902560] nix-grpc-daemon[781]: ts=2026-09-19T21:21:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386844324worker2 # [ 37.910684] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4325worker2 # [ 38.047323] nix-daemon[804]: accepted connection from pid 896, user nix-grpc-daemon (trusted)4326worker2 # [ 38.060650] nix-daemon[804]: reaped child process 899, status = succeeded4327worker2 # [ 38.214365] nix-daemon[804]: accepted connection from pid 901, user nix-grpc-daemon (trusted)4328worker2 # [ 38.227385] nix-daemon[804]: reaped child process 904, status = succeeded4329lb # [ 38.258599] niks3-server[1039]: 2026/09/19 21:21:58 INFO Received uploads request method=POST path=/api/pending_closures4330worker2 # [ 38.248362] nix-grpc-daemon[814]: time=2026-09-19T21:21:59.128Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4331worker2 # [ 38.250267] nix-grpc-daemon[814]: time=2026-09-19T21:21:59.129Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4332lb # [ 38.284657] niks3-server[1039]: 2026/09/19 21:21:58 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4333lb # [ 38.294217] niks3-server[1039]: 2026/09/19 21:21:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4334lb # [ 38.300486] niks3-server[1039]: 2026/09/19 21:21:58 INFO Signed narinfos id=5 count=14335worker2 # [ 38.286068] nix-grpc-daemon[814]: time=2026-09-19T21:21:59.165Z level=INFO msg="Uploading 1 narinfos"4336lb # [ 38.306847] niks3-server[1039]: 2026/09/19 21:21:58 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4337lb # [ 38.318440] niks3-server[1039]: 2026/09/19 21:21:58 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4338worker2 # [ 38.307247] nix-grpc-daemon[814]: time=2026-09-19T21:21:59.186Z level=INFO msg="Upload complete. (384ms)"4339lb # [ 38.324927] niks3-server[1039]: 2026/09/19 21:21:58 INFO Completed upload id=54340lb # [ 38.327198] niks3-server[1039]: 2026/09/19 21:21:58 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4341worker2 # [ 38.309827] nix-grpc-daemon[781]: ts=2026-09-19T21:21:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=0 paths=1 nar_bytes_in=7524342worker2 # [ 38.315784] nix-grpc-daemon[781]: ts=2026-09-19T21:21:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844343worker2 # [ 38.325949] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4344worker2 # [ 38.331624] nix-daemon[804]: reaped child process 894, status = succeeded4345client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4346client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4347worker2 # [ 38.334858] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4348client # farm-top> LOG-farm-top-t14349worker2 # [ 39.154674] nix-daemon[804]: reaped child process 908, status = succeeded4350worker2 # [ 39.301635] nix-daemon[804]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4351worker2 # [ 39.314940] nix-daemon[804]: reaped child process 927, status = succeeded4352lb # [ 39.349189] niks3-server[1039]: 2026/09/19 21:21:59 INFO Received uploads request method=POST path=/api/pending_closures4353worker2 # [ 39.341326] nix-grpc-daemon[814]: time=2026-09-19T21:22:00.219Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4354worker2 # [ 39.342702] nix-grpc-daemon[814]: time=2026-09-19T21:22:00.219Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4355lb # [ 39.389471] niks3-server[1039]: 2026/09/19 21:21:59 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4356lb # [ 39.393677] niks3-server[1039]: 2026/09/19 21:21:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4357worker2 # [ 39.376256] nix-grpc-daemon[814]: time=2026-09-19T21:22:00.255Z level=INFO msg="Uploading 1 narinfos"4358lb # [ 39.395201] niks3-server[1039]: 2026/09/19 21:21:59 INFO Signed narinfos id=6 count=14359lb # [ 39.400082] niks3-server[1039]: 2026/09/19 21:21:59 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4360lb # [ 39.405431] niks3-server[1039]: 2026/09/19 21:21:59 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4361lb # [ 39.409136] niks3-server[1039]: 2026/09/19 21:21:59 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4362lb # [ 39.412869] niks3-server[1039]: 2026/09/19 21:21:59 INFO Completed upload id=64363worker2 # [ 39.395249] nix-grpc-daemon[814]: time=2026-09-19T21:22:00.274Z level=INFO msg="Upload complete. (253ms)"4364lb # [ 39.414501] niks3-server[1039]: 2026/09/19 21:21:59 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4365worker2 # [ 39.398201] nix-grpc-daemon[781]: ts=2026-09-19T21:22:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14366worker2 # [ 39.405599] nix-daemon[804]: reaped child process 906, status = succeeded4367client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.57 seconds)4368client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4369client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4370client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4371client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4372client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4373client # copying 3 paths...4374client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4375client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4376client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4377client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4378(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.11 seconds)4379subtest: repeat is answered Cached by the scheduler without building4380worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4381worker1 # finding garbage collector roots...4382worker1 # deleting specified paths...4383worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4384worker1 # deleting unused links...4385worker1 # note: hard linking is currently saving 0.0 KiB4386worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4387worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4388worker2 # finding garbage collector roots...4389worker2 # deleting specified paths...4390worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4391worker2 # deleting unused links...4392worker2 # note: hard linking is currently saving 0.0 KiB4393worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4394client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24395worker1 # [ 40.684411] nix-grpc-daemon[785]: ts=2026-09-19T21:22:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552884396client # don't know how to build these paths:4397client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4398worker1 # [ 40.702172] nix-grpc-daemon[785]: ts=2026-09-19T21:22:01Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14399worker1 # [ 40.712646] nix-grpc-daemon[785]: ts=2026-09-19T21:22:01Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14400worker1 # [ 40.722943] nix-grpc-daemon[785]: ts=2026-09-19T21:22:01Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14401client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.26 seconds)4402client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4403client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.14 seconds)4404worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}'4405worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}', in 0.06 seconds)4406(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.05 seconds)4407subtest: two clients wanting the same drv build it once4408client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4409client # [ 41.086626] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4410client # Running as unit: dedup1.service; invocation ID: f9f7777db254418c9935047c3e340c034411client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4412client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4413worker1 # [ 41.264209] nix-grpc-daemon[785]: ts=2026-09-19T21:22:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552884414client # [ 41.282283] nix[870]: don't know how to build these paths:4415client # [ 41.283957] nix[870]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4416worker1 # [ 41.273441] nix-grpc-daemon[785]: ts=2026-09-19T21:22:02Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04417worker1 # [ 41.275512] nix-grpc-daemon[785]: ts=2026-09-19T21:22:02Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14418worker1 # [ 41.278121] nix-grpc-daemon[785]: ts=2026-09-19T21:22:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552884419worker1 # [ 41.287417] nix-grpc-daemon[785]: ts=2026-09-19T21:22:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552884420client # [ 41.308524] nix[870]: copying 1 paths to 'lb:50051'...4421client # [ 41.309308] nix[870]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4422worker1 # [ 41.294074] nix-grpc-daemon[785]: ts=2026-09-19T21:22:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552884423worker1 # [ 41.300102] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4424worker1 # [ 41.310227] nix-grpc-daemon[785]: ts=2026-09-19T21:22:02Z level=info event=niks3_push_started pid=8894425worker1 # [ 41.721087] nix-daemon[844]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4426worker1 # [ 41.734820] nix-daemon[844]: reaped child process 904, status = succeeded4427worker1 # [ 41.895543] nix-daemon[844]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4428worker1 # [ 41.907860] nix-daemon[844]: reaped child process 909, status = succeeded4429lb # [ 41.946354] niks3-server[1039]: 2026/09/19 21:22:02 INFO Received uploads request method=POST path=/api/pending_closures4430worker1 # [ 41.937125] nix-grpc-daemon[889]: time=2026-09-19T21:22:02.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4431worker1 # [ 41.939459] nix-grpc-daemon[889]: time=2026-09-19T21:22:02.974Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4432lb # [ 41.983692] niks3-server[1039]: 2026/09/19 21:22:02 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4433lb # [ 41.996338] niks3-server[1039]: 2026/09/19 21:22:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4434lb # [ 42.001849] niks3-server[1039]: 2026/09/19 21:22:02 INFO Signed narinfos id=7 count=14435worker1 # [ 41.985347] nix-grpc-daemon[889]: time=2026-09-19T21:22:03.020Z level=INFO msg="Uploading 1 narinfos"4436lb # [ 42.018457] niks3-server[1039]: 2026/09/19 21:22:02 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4437lb # [ 42.068836] niks3-server[1039]: 2026/09/19 21:22:02 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4438lb # [ 42.078166] niks3-server[1039]: 2026/09/19 21:22:02 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4439lb # [ 42.085178] niks3-server[1039]: 2026/09/19 21:22:02 INFO Completed upload id=74440worker1 # [ 42.065343] nix-grpc-daemon[889]: time=2026-09-19T21:22:03.100Z level=INFO msg="Upload complete. (516ms)"4441worker1 # [ 42.070729] nix-grpc-daemon[785]: ts=2026-09-19T21:22:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=1 nar_bytes_in=4324442worker1 # [ 42.078297] nix-grpc-daemon[785]: ts=2026-09-19T21:22:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552884443worker1 # [ 42.092461] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4444worker1 # [ 42.106635] nix-daemon[844]: reaped child process 887, status = succeeded4445client # [ 42.128815] nix[870]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4446worker1 # [ 42.118090] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4447client # [ 42.165076] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4448client # Running as unit: dedup2.service; invocation ID: 24c1673f237142c3b78184eaed3ba4274449client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4450worker2 # [ 42.410044] nix-grpc-daemon[781]: ts=2026-09-19T21:22:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:386844451client # [ 42.426555] nix[886]: don't know how to build these paths:4452client # [ 42.427462] nix[886]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4453worker1 # [ 42.419376] nix-grpc-daemon[785]: ts=2026-09-19T21:22:03Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04454client # [ 42.440222] nix[886]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4455worker1 # [ 42.424836] nix-grpc-daemon[785]: ts=2026-09-19T21:22:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552884456client: must succeed: sleep 24457client: (finished: must succeed: sleep 2, in 2.05 seconds)4458worker1 # [ 45.535696] nix-daemon[844]: reaped child process 913, status = succeeded4459??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4460 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394461client: waiting for success: ! systemctl is-active dedup1 dedup24462??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4463 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394464worker1 # [ 45.675081] nix-daemon[844]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4465worker1 # [ 45.685293] nix-daemon[844]: reaped child process 948, status = succeeded4466lb # [ 45.720314] niks3-server[1039]: 2026/09/19 21:22:06 INFO Received uploads request method=POST path=/api/pending_closures4467worker1 # [ 45.708820] nix-grpc-daemon[889]: time=2026-09-19T21:22:06.743Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4468worker1 # [ 45.710886] nix-grpc-daemon[889]: time=2026-09-19T21:22:06.745Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4469lb # [ 45.769218] niks3-server[1039]: 2026/09/19 21:22:06 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4470lb # [ 45.776739] niks3-server[1039]: 2026/09/19 21:22:06 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4471lb # [ 45.784910] niks3-server[1039]: 2026/09/19 21:22:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4472lb # [ 45.790663] niks3-server[1039]: 2026/09/19 21:22:06 INFO Signed narinfos id=8 count=14473worker1 # [ 45.771041] nix-grpc-daemon[889]: time=2026-09-19T21:22:06.805Z level=INFO msg="Uploading 1 narinfos"4474lb # [ 45.799357] niks3-server[1039]: 2026/09/19 21:22:06 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4475lb # [ 45.806730] niks3-server[1039]: 2026/09/19 21:22:06 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4476lb # [ 45.813907] niks3-server[1039]: 2026/09/19 21:22:06 INFO Completed upload id=84477worker1 # [ 45.794185] nix-grpc-daemon[889]: time=2026-09-19T21:22:06.828Z level=INFO msg="Upload complete. (263ms)"4478lb # [ 45.816925] niks3-server[1039]: 2026/09/19 21:22:06 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4479worker1 # [ 45.803718] nix-grpc-daemon[785]: ts=2026-09-19T21:22:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14480worker1 # [ 45.811349] nix-grpc-daemon[785]: ts=2026-09-19T21:22:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14481worker1 # [ 45.820800] nix-daemon[844]: reaped child process 911, status = succeeded4482client # [ 45.863805] systemd[1]: dedup2.service: Deactivated successfully.4483client # [ 45.868149] systemd[1]: dedup2.service: Consumed 126ms CPU time over 3.701s wall clock time, 31.2M memory peak, 7.4K incoming IP traffic, 6.5K outgoing IP traffic.4484client # [ 45.874453] systemd[1]: dedup1.service: Deactivated successfully.4485client # [ 45.877265] systemd[1]: dedup1.service: Consumed 103ms CPU time over 4.788s wall clock time, 37.3M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4486client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4487client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4488client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4489worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4490worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4491worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4492worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4493worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4494worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4495worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4496worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4497(finished: subtest: two clients wanting the same drv build it once, in 5.92 seconds)4498subtest: build hook: nix-daemon with builders = grpc://lb4499client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4500client # [ 47.124401] systemd[1]: Started Nix Daemon.4501client # [ 47.267109] nix-daemon[927]: accepted connection from pid 924, user root (trusted)4502lb # [ 47.426513] envoy[919]: conn peer=[2001:db8:1::1]:57668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9398 tx=3819 ms=63704503worker2 # [ 47.410227] nix-grpc-daemon[781]: ts=2026-09-19T21:22:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:386844504lb # [ 47.430693] envoy[919]: conn peer=[2001:db8:1::1]:57670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=524505lb # [ 47.434806] envoy[919]: conn peer=[2001:db8:1::1]:57686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=34144506worker2 # [ 47.421902] nix-grpc-daemon[781]: ts=2026-09-19T21:22:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844507lb # [ 47.439180] envoy[919]: conn peer=[2001:db8:1::1]:57672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1352 ms=45514508worker1 # [ 47.432620] nix-grpc-daemon[785]: ts=2026-09-19T21:22:08Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04509worker1 # [ 47.434771] nix-grpc-daemon[785]: ts=2026-09-19T21:22:08Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14510worker2 # [ 47.478880] nix-grpc-daemon[781]: ts=2026-09-19T21:22:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844511worker2 # [ 47.487907] nix-grpc-daemon[781]: ts=2026-09-19T21:22:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844512worker2 # [ 47.496299] nix-grpc-daemon[781]: ts=2026-09-19T21:22:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386844513worker2 # [ 47.503054] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4514worker2 # [ 47.656674] nix-daemon[804]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4515worker2 # [ 47.670353] nix-daemon[804]: reaped child process 971, status = succeeded4516worker2 # [ 47.830621] nix-daemon[804]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4517worker2 # [ 47.844076] nix-daemon[804]: reaped child process 976, status = succeeded4518lb # [ 47.876809] niks3-server[1039]: 2026/09/19 21:22:08 INFO Received uploads request method=POST path=/api/pending_closures4519worker2 # [ 47.935455] nix-grpc-daemon[814]: time=2026-09-19T21:22:08.814Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4520worker2 # [ 47.936933] nix-grpc-daemon[814]: time=2026-09-19T21:22:08.814Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4521lb # [ 47.971375] niks3-server[1039]: 2026/09/19 21:22:08 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4522lb # [ 47.979454] niks3-server[1039]: 2026/09/19 21:22:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4523lb # [ 47.984097] niks3-server[1039]: 2026/09/19 21:22:08 INFO Signed narinfos id=9 count=14524worker2 # [ 47.969514] nix-grpc-daemon[814]: time=2026-09-19T21:22:08.849Z level=INFO msg="Uploading 1 narinfos"4525lb # [ 47.995199] niks3-server[1039]: 2026/09/19 21:22:08 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4526lb # [ 48.007568] niks3-server[1039]: 2026/09/19 21:22:08 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4527lb # [ 48.012545] niks3-server[1039]: 2026/09/19 21:22:08 INFO Completed upload id=94528worker2 # [ 47.997038] nix-grpc-daemon[814]: time=2026-09-19T21:22:08.876Z level=INFO msg="Upload complete. (488ms)"4529lb # [ 48.015251] niks3-server[1039]: 2026/09/19 21:22:08 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4530worker2 # [ 47.999293] nix-grpc-daemon[781]: ts=2026-09-19T21:22:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=0 paths=1 nar_bytes_in=5124531worker2 # [ 48.004350] nix-grpc-daemon[781]: ts=2026-09-19T21:22:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844532worker2 # [ 48.010101] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4533worker2 # [ 48.012366] nix-daemon[804]: reaped child process 966, status = succeeded4534worker2 # [ 48.017301] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4535worker2 # [ 49.042518] nix-daemon[804]: reaped child process 980, status = succeeded4536worker2 # [ 49.207663] nix-daemon[804]: accepted connection from pid 995, user nix-grpc-daemon (trusted)4537worker2 # [ 49.219118] nix-daemon[804]: reaped child process 998, status = succeeded4538lb # [ 49.252477] niks3-server[1039]: 2026/09/19 21:22:09 INFO Received uploads request method=POST path=/api/pending_closures4539worker2 # [ 49.243119] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.122Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4540worker2 # [ 49.244669] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.124Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4541lb # [ 49.292583] niks3-server[1039]: 2026/09/19 21:22:09 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4542lb # [ 49.303956] niks3-server[1039]: 2026/09/19 21:22:09 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4543lb # [ 49.310681] niks3-server[1039]: 2026/09/19 21:22:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4544lb # [ 49.315111] niks3-server[1039]: 2026/09/19 21:22:09 INFO Signed narinfos id=10 count=14545worker2 # [ 49.300649] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.180Z level=INFO msg="Uploading 1 narinfos"4546lb # [ 49.324709] niks3-server[1039]: 2026/09/19 21:22:09 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4547lb # [ 49.332745] niks3-server[1039]: 2026/09/19 21:22:09 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4548lb # [ 49.337239] niks3-server[1039]: 2026/09/19 21:22:09 INFO Completed upload id=104549worker2 # [ 49.322283] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.201Z level=INFO msg="Upload complete. (297ms)"4550worker2 # [ 49.325192] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.201Z level=WARN msg="Failed to register uploaded object" key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo error="server returned 404: object is not pending upload\n"4551worker2 # [ 49.334116] nix-grpc-daemon[781]: ts=2026-09-19T21:22:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14552worker2 # [ 49.342200] nix-grpc-daemon[781]: ts=2026-09-19T21:22:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386844553worker2 # [ 49.350789] nix-daemon[804]: reaped child process 978, status = succeeded4554worker1 # [ 49.353385] nix-grpc-daemon[785]: ts=2026-09-19T21:22:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:552884555worker1 # [ 49.367157] nix-grpc-daemon[785]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4556worker1 # [ 49.385646] nix-grpc-daemon[785]: ts=2026-09-19T21:22:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=1 nar_bytes_out=1284557worker2 # [ 49.630280] nix-grpc-daemon[781]: ts=2026-09-19T21:22:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:386844558worker1 # [ 49.635322] nix-grpc-daemon[785]: ts=2026-09-19T21:22:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552884559worker1 # [ 49.645285] nix-grpc-daemon[889]: time=2026-09-19T21:22:10.679Z level=INFO msg="All 1 paths already cached"4560worker1 # [ 49.658387] nix-grpc-daemon[785]: ts=2026-09-19T21:22:10Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04561worker1 # [ 49.662761] nix-grpc-daemon[785]: ts=2026-09-19T21:22:10Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14562worker2 # [ 49.667733] nix-grpc-daemon[781]: ts=2026-09-19T21:22:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844563worker2 # [ 49.679078] nix-grpc-daemon[781]: ts=2026-09-19T21:22:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844564worker2 # [ 49.691452] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.571Z level=INFO msg="All 1 paths already cached"4565worker2 # [ 49.698711] nix-grpc-daemon[781]: ts=2026-09-19T21:22:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386844566worker2 # [ 49.706317] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4567worker2 # [ 49.876514] nix-daemon[804]: accepted connection from pid 1002, user nix-grpc-daemon (trusted)4568worker2 # [ 49.890468] nix-daemon[804]: reaped child process 1005, status = succeeded4569worker2 # [ 50.051632] nix-daemon[804]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)4570worker2 # [ 50.065264] nix-daemon[804]: reaped child process 1010, status = succeeded4571lb # [ 50.098737] niks3-server[1039]: 2026/09/19 21:22:10 INFO Received uploads request method=POST path=/api/pending_closures4572worker2 # [ 50.089371] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.969Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4573worker2 # [ 50.090868] nix-grpc-daemon[814]: time=2026-09-19T21:22:10.970Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4574lb # [ 50.130713] niks3-server[1039]: 2026/09/19 21:22:10 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4575lb # [ 50.139254] niks3-server[1039]: 2026/09/19 21:22:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4576worker2 # [ 50.126668] nix-grpc-daemon[814]: time=2026-09-19T21:22:11.006Z level=INFO msg="Uploading 1 narinfos"4577lb # [ 50.144251] niks3-server[1039]: 2026/09/19 21:22:10 INFO Signed narinfos id=11 count=14578lb # [ 50.151640] niks3-server[1039]: 2026/09/19 21:22:10 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4579lb # [ 50.161636] niks3-server[1039]: 2026/09/19 21:22:10 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4580lb # [ 50.168151] niks3-server[1039]: 2026/09/19 21:22:10 INFO Completed upload id=114581worker2 # [ 50.151439] nix-grpc-daemon[814]: time=2026-09-19T21:22:11.030Z level=INFO msg="Upload complete. (430ms)"4582worker2 # [ 50.152706] nix-grpc-daemon[781]: ts=2026-09-19T21:22:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=0 paths=1 nar_bytes_in=6244583lb # [ 50.171515] niks3-server[1039]: 2026/09/19 21:22:10 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4584worker2 # [ 50.157596] nix-grpc-daemon[781]: ts=2026-09-19T21:22:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844585worker2 # [ 50.167570] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4586worker2 # [ 50.170740] nix-daemon[804]: reaped child process 1000, status = succeeded4587worker2 # [ 50.176085] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4588worker2 # [ 50.989805] nix-daemon[804]: reaped child process 1014, status = succeeded4589worker2 # [ 51.123917] nix-daemon[804]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4590worker2 # [ 51.137529] nix-daemon[804]: reaped child process 1032, status = succeeded4591lb # [ 51.171615] niks3-server[1039]: 2026/09/19 21:22:11 INFO Received uploads request method=POST path=/api/pending_closures4592worker2 # [ 51.178983] nix-grpc-daemon[814]: time=2026-09-19T21:22:12.058Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4593worker2 # [ 51.182062] nix-grpc-daemon[814]: time=2026-09-19T21:22:12.060Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4594lb # [ 51.228105] niks3-server[1039]: 2026/09/19 21:22:11 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4595lb # [ 51.242258] niks3-server[1039]: 2026/09/19 21:22:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4596lb # [ 51.245215] niks3-server[1039]: 2026/09/19 21:22:11 INFO Signed narinfos id=12 count=14597worker2 # [ 51.227643] nix-grpc-daemon[814]: time=2026-09-19T21:22:12.107Z level=INFO msg="Uploading 1 narinfos"4598lb # [ 51.250768] niks3-server[1039]: 2026/09/19 21:22:11 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4599lb # [ 51.253085] niks3-server[1039]: 2026/09/19 21:22:11 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4600lb # [ 51.257144] niks3-server[1039]: 2026/09/19 21:22:11 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4601lb # [ 51.260706] niks3-server[1039]: 2026/09/19 21:22:11 INFO Completed upload id=124602worker2 # [ 51.244473] nix-grpc-daemon[814]: time=2026-09-19T21:22:12.124Z level=INFO msg="Upload complete. (262ms)"4603lb # [ 51.264890] niks3-server[1039]: 2026/09/19 21:22:11 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4604worker2 # [ 51.250249] nix-grpc-daemon[781]: ts=2026-09-19T21:22:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14605worker2 # [ 51.256277] nix-grpc-daemon[781]: ts=2026-09-19T21:22:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386844606worker2 # [ 51.266905] nix-daemon[804]: reaped child process 1012, status = succeeded4607worker1 # [ 51.268705] nix-grpc-daemon[785]: ts=2026-09-19T21:22:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:552884608worker1 # [ 51.278121] nix-grpc-daemon[785]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4609worker1 # [ 51.293441] nix-grpc-daemon[785]: ts=2026-09-19T21:22:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=1 nar_bytes_out=1764610worker1 # [ 51.568203] nix-grpc-daemon[785]: ts=2026-09-19T21:22:12Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:552884611worker2 # [ 51.573320] nix-grpc-daemon[781]: ts=2026-09-19T21:22:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844612worker2 # [ 51.634167] nix-grpc-daemon[814]: time=2026-09-19T21:22:12.513Z level=INFO msg="All 2 paths already cached"4613worker1 # [ 51.646184] nix-grpc-daemon[785]: ts=2026-09-19T21:22:12Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04614worker1 # [ 51.648343] nix-grpc-daemon[785]: ts=2026-09-19T21:22:12Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14615worker2 # [ 51.692484] nix-grpc-daemon[781]: ts=2026-09-19T21:22:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844616worker2 # [ 51.703516] nix-grpc-daemon[781]: ts=2026-09-19T21:22:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844617worker2 # [ 51.713535] nix-grpc-daemon[814]: time=2026-09-19T21:22:12.593Z level=INFO msg="All 2 paths already cached"4618worker2 # [ 51.720479] nix-grpc-daemon[781]: ts=2026-09-19T21:22:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386844619worker2 # [ 51.729366] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4620worker2 # [ 51.915235] nix-daemon[804]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4621worker2 # [ 51.929174] nix-daemon[804]: reaped child process 1039, status = succeeded4622worker2 # [ 52.095100] nix-daemon[804]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)4623worker2 # [ 52.107215] nix-daemon[804]: reaped child process 1044, status = succeeded4624lb # [ 52.140912] niks3-server[1039]: 2026/09/19 21:22:12 INFO Received uploads request method=POST path=/api/pending_closures4625worker2 # [ 52.132073] nix-grpc-daemon[814]: time=2026-09-19T21:22:13.011Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4626worker2 # [ 52.133608] nix-grpc-daemon[814]: time=2026-09-19T21:22:13.013Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4627lb # [ 52.171733] niks3-server[1039]: 2026/09/19 21:22:12 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4628lb # [ 52.181224] niks3-server[1039]: 2026/09/19 21:22:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4629lb # [ 52.187516] niks3-server[1039]: 2026/09/19 21:22:12 INFO Signed narinfos id=13 count=14630worker2 # [ 52.172824] nix-grpc-daemon[814]: time=2026-09-19T21:22:13.052Z level=INFO msg="Uploading 1 narinfos"4631lb # [ 52.191134] niks3-server[1039]: 2026/09/19 21:22:12 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4632lb # [ 52.204213] niks3-server[1039]: 2026/09/19 21:22:12 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4633lb # [ 52.210896] niks3-server[1039]: 2026/09/19 21:22:12 INFO Completed upload id=134634worker2 # [ 52.193469] nix-grpc-daemon[814]: time=2026-09-19T21:22:13.072Z level=INFO msg="Upload complete. (449ms)"4635lb # [ 52.213298] niks3-server[1039]: 2026/09/19 21:22:12 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4636worker2 # [ 52.197362] nix-grpc-daemon[781]: ts=2026-09-19T21:22:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=0 paths=1 nar_bytes_in=7524637worker2 # [ 52.202676] nix-grpc-daemon[781]: ts=2026-09-19T21:22:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844638worker2 # [ 52.211496] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4639worker2 # [ 52.216815] nix-daemon[804]: reaped child process 1034, status = succeeded4640worker2 # [ 52.221785] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4641worker2 # [ 53.243980] nix-daemon[804]: reaped child process 1048, status = succeeded4642worker2 # [ 53.393732] nix-daemon[804]: accepted connection from pid 1063, user nix-grpc-daemon (trusted)4643worker2 # [ 53.406840] nix-daemon[804]: reaped child process 1066, status = succeeded4644lb # [ 53.440782] niks3-server[1039]: 2026/09/19 21:22:13 INFO Received uploads request method=POST path=/api/pending_closures4645worker2 # [ 53.432101] nix-grpc-daemon[814]: time=2026-09-19T21:22:14.311Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4646worker2 # [ 53.434201] nix-grpc-daemon[814]: time=2026-09-19T21:22:14.313Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4647lb # [ 53.471185] niks3-server[1039]: 2026/09/19 21:22:13 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4648lb # [ 53.482788] niks3-server[1039]: 2026/09/19 21:22:13 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4649lb # [ 53.490611] niks3-server[1039]: 2026/09/19 21:22:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4650lb # [ 53.493935] niks3-server[1039]: 2026/09/19 21:22:14 INFO Signed narinfos id=14 count=14651worker2 # [ 53.476471] nix-grpc-daemon[814]: time=2026-09-19T21:22:14.356Z level=INFO msg="Uploading 1 narinfos"4652lb # [ 53.495713] niks3-server[1039]: 2026/09/19 21:22:14 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4653lb # [ 53.501170] niks3-server[1039]: 2026/09/19 21:22:14 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4654lb # [ 53.504100] niks3-server[1039]: 2026/09/19 21:22:14 INFO Completed upload id=144655worker2 # [ 53.487495] nix-grpc-daemon[814]: time=2026-09-19T21:22:14.367Z level=INFO msg="Upload complete. (258ms)"4656lb # [ 53.505806] niks3-server[1039]: 2026/09/19 21:22:14 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4657worker2 # [ 53.492323] nix-grpc-daemon[781]: ts=2026-09-19T21:22:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14658worker2 # [ 53.499079] nix-grpc-daemon[781]: ts=2026-09-19T21:22:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386844659worker2 # [ 53.505965] nix-daemon[804]: reaped child process 1046, status = succeeded4660worker1 # [ 53.513829] nix-grpc-daemon[785]: ts=2026-09-19T21:22:14Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:552884661worker1 # [ 53.522942] nix-grpc-daemon[785]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4662worker1 # [ 53.536590] nix-grpc-daemon[785]: ts=2026-09-19T21:22:14Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=1 nar_bytes_out=2324663client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.71 seconds)4664client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4665client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4666client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4667client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4668client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4669client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4670(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.80 seconds)4671subtest: an input only one worker has still reaches the builder4672client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4673client # [ 53.836549] nix-daemon[927]: reaped child process 929, status = succeeded4674client # this derivation will be built:4675client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4676client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4677client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.38 seconds)4678client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4679client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4680worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4681worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)4682worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4683worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4684client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24685client # [ 54.703618] nix-daemon[927]: accepted connection from pid 1007, user root (trusted)4686client # this derivation will be built:4687client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4688client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4689worker1 # [ 54.916784] nix-grpc-daemon[785]: ts=2026-09-19T21:22:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:552884690worker1 # [ 54.926355] nix-grpc-daemon[785]: ts=2026-09-19T21:22:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552884691worker1 # [ 55.086888] nix-daemon[844]: accepted connection from pid 975, user nix-grpc-daemon (trusted)4692worker1 # [ 55.097727] nix-daemon[844]: reaped child process 978, status = succeeded4693lb # [ 55.132367] niks3-server[1039]: 2026/09/19 21:22:15 INFO Received uploads request method=POST path=/api/pending_closures4694worker1 # [ 55.120261] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.154Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4695worker1 # [ 55.121591] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.154Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4696lb # [ 55.155057] niks3-server[1039]: 2026/09/19 21:22:15 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4697lb # [ 55.165363] niks3-server[1039]: 2026/09/19 21:22:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4698lb # [ 55.171825] niks3-server[1039]: 2026/09/19 21:22:15 INFO Signed narinfos id=15 count=14699worker1 # [ 55.155580] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.190Z level=INFO msg="Uploading 1 narinfos"4700lb # [ 55.178669] niks3-server[1039]: 2026/09/19 21:22:15 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4701lb # [ 55.189495] niks3-server[1039]: 2026/09/19 21:22:15 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4702worker1 # [ 55.174468] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.209Z level=INFO msg="Upload complete. (251ms)"4703lb # [ 55.194643] niks3-server[1039]: 2026/09/19 21:22:15 INFO Completed upload id=154704lb # [ 55.199371] niks3-server[1039]: 2026/09/19 21:22:15 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4705worker1 # [ 55.190959] nix-grpc-daemon[785]: ts=2026-09-19T21:22:16Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04706worker1 # [ 55.195426] nix-grpc-daemon[785]: ts=2026-09-19T21:22:16Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14707worker1 # [ 55.235882] nix-grpc-daemon[785]: ts=2026-09-19T21:22:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552884708worker1 # [ 55.248287] nix-grpc-daemon[785]: ts=2026-09-19T21:22:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552884709client # copying 2 paths to 'lb:50051'...4710client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4711worker1 # [ 55.264574] nix-grpc-daemon[785]: ts=2026-09-19T21:22:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552884712client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4713worker1 # [ 55.280166] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4714worker1 # [ 55.451586] nix-daemon[844]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4715worker1 # [ 55.463811] nix-daemon[844]: reaped child process 987, status = succeeded4716worker1 # [ 55.612481] nix-daemon[844]: accepted connection from pid 990, user nix-grpc-daemon (trusted)4717worker1 # [ 55.624504] nix-daemon[844]: reaped child process 993, status = succeeded4718lb # [ 55.657669] niks3-server[1039]: 2026/09/19 21:22:16 INFO Received uploads request method=POST path=/api/pending_closures4719lb # [ 55.666142] niks3-server[1039]: 2026/09/19 21:22:16 INFO Received uploads request method=POST path=/api/pending_closures4720worker1 # [ 55.660844] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.694Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4721worker1 # [ 55.662440] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.694Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4722worker1 # [ 55.664274] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.695Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4723lb # [ 55.701822] niks3-server[1039]: 2026/09/19 21:22:16 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4724lb # [ 55.710603] niks3-server[1039]: 2026/09/19 21:22:16 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4725lb # [ 55.727894] niks3-server[1039]: 2026/09/19 21:22:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4726lb # [ 55.732229] niks3-server[1039]: 2026/09/19 21:22:16 INFO Signed narinfos id=16 count=14727lb # [ 55.734923] niks3-server[1039]: 2026/09/19 21:22:16 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4728lb # [ 55.740624] niks3-server[1039]: 2026/09/19 21:22:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4729lb # [ 55.743375] niks3-server[1039]: 2026/09/19 21:22:16 INFO Signed narinfos id=17 count=24730lb # [ 55.745616] niks3-server[1039]: 2026/09/19 21:22:16 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4731worker1 # [ 55.724235] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.758Z level=INFO msg="Uploading 3 narinfos"4732lb # [ 55.759201] niks3-server[1039]: 2026/09/19 21:22:16 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4733lb # [ 55.761782] niks3-server[1039]: 2026/09/19 21:22:16 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4734lb # [ 55.765247] niks3-server[1039]: 2026/09/19 21:22:16 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4735lb # [ 55.767943] niks3-server[1039]: 2026/09/19 21:22:16 INFO Completed upload id=164736lb # [ 55.769431] niks3-server[1039]: 2026/09/19 21:22:16 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4737lb # [ 55.772208] niks3-server[1039]: 2026/09/19 21:22:16 INFO Completed upload id=174738lb # [ 55.773841] niks3-server[1039]: 2026/09/19 21:22:16 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4739worker1 # [ 55.753477] nix-grpc-daemon[889]: time=2026-09-19T21:22:16.788Z level=INFO msg="Upload complete. (458ms)"4740worker1 # [ 55.758161] nix-grpc-daemon[785]: ts=2026-09-19T21:22:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=2 nar_bytes_in=9764741worker1 # [ 55.764326] nix-grpc-daemon[785]: ts=2026-09-19T21:22:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552884742worker1 # [ 55.777913] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4743worker1 # [ 55.785229] nix-daemon[844]: reaped child process 982, status = succeeded4744worker1 # [ 55.789112] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4745client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4746client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4747worker1 # [ 56.602246] nix-daemon[844]: reaped child process 997, status = succeeded4748worker1 # [ 56.741128] nix-daemon[844]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)4749worker1 # [ 56.752922] nix-daemon[844]: reaped child process 1015, status = succeeded4750lb # [ 56.786296] niks3-server[1039]: 2026/09/19 21:22:17 INFO Received uploads request method=POST path=/api/pending_closures4751worker1 # [ 56.773893] nix-grpc-daemon[889]: time=2026-09-19T21:22:17.808Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4752lb # [ 56.815116] niks3-server[1039]: 2026/09/19 21:22:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4753lb # [ 56.820485] niks3-server[1039]: 2026/09/19 21:22:17 INFO Signed narinfos id=18 count=14754worker1 # [ 56.803244] nix-grpc-daemon[889]: time=2026-09-19T21:22:17.838Z level=INFO msg="Uploading 1 narinfos"4755lb # [ 56.829131] niks3-server[1039]: 2026/09/19 21:22:17 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4756lb # [ 56.835140] niks3-server[1039]: 2026/09/19 21:22:17 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4757lb # [ 56.845612] niks3-server[1039]: 2026/09/19 21:22:17 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4758lb # [ 56.853309] niks3-server[1039]: 2026/09/19 21:22:17 INFO Completed upload id=184759worker1 # [ 56.833277] nix-grpc-daemon[889]: time=2026-09-19T21:22:17.868Z level=INFO msg="Upload complete. (237ms)"4760lb # [ 56.855522] niks3-server[1039]: 2026/09/19 21:22:17 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4761worker1 # [ 56.837669] nix-grpc-daemon[785]: ts=2026-09-19T21:22:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14762worker1 # [ 56.849114] nix-daemon[844]: reaped child process 995, status = succeeded4763client # copying 1 paths...4764worker1 # [ 56.883908] nix-grpc-daemon[785]: ts=2026-09-19T21:22:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552884765client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4766worker1 # [ 56.905918] nix-grpc-daemon[785]: ts=2026-09-19T21:22:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:552884767worker1 # [ 56.908919] nix-grpc-daemon[785]: ts=2026-09-19T21:22:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=1 nar_bytes_out=1204768client # [ 57.023593] nix-daemon[927]: reaped child process 1010, status = succeeded4769client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.49 seconds)4770client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24771client # [ 57.187950] nix-daemon[927]: accepted connection from pid 1028, user root (trusted)4772client # this derivation will be built:4773client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4774worker2 # [ 57.339962] nix-grpc-daemon[781]: ts=2026-09-19T21:22:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:386844775client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4776worker1 # [ 57.340993] nix-grpc-daemon[785]: ts=2026-09-19T21:22:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552884777worker1 # [ 57.349830] nix-grpc-daemon[889]: time=2026-09-19T21:22:18.384Z level=INFO msg="All 1 paths already cached"4778worker1 # [ 57.363310] nix-grpc-daemon[785]: ts=2026-09-19T21:22:18Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04779worker1 # [ 57.368166] nix-grpc-daemon[785]: ts=2026-09-19T21:22:18Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14780worker2 # [ 57.372732] nix-grpc-daemon[781]: ts=2026-09-19T21:22:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844781worker2 # [ 57.384825] nix-grpc-daemon[781]: ts=2026-09-19T21:22:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844782client # copying 1 paths to 'lb:50051'...4783client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4784worker2 # [ 57.401525] nix-grpc-daemon[781]: ts=2026-09-19T21:22:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386844785lb # [ 57.427088] envoy[919]: conn peer=[2001:db8:1::1]:34778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3429 tx=1658 ms=20294786worker2 # [ 57.413238] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4787lb # [ 57.430739] envoy[919]: conn peer=[2001:db8:1::1]:34790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=854788lb # [ 57.434148] envoy[919]: conn peer=[2001:db8:1::1]:34798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=1877 ms=17184789lb # [ 57.437573] envoy[919]: conn peer=[2001:db8:1::1]:34810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=774790lb # [ 57.440881] envoy[919]: conn peer=[2001:db8:1::1]:34822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4342 tx=2110 ms=20234791lb # [ 57.444491] envoy[919]: conn peer=[2001:db8:1::1]:36604 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=754792lb # [ 57.447873] envoy[919]: conn peer=[2001:db8:1::1]:36606 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3855 tx=1763 ms=20424793worker2 # [ 57.429717] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)4794lb # [ 57.451588] envoy[919]: conn peer=[2001:db8:1::1]:36620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=574795worker2 # [ 57.470786] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 2/5)4796worker2 # [ 57.531363] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 376 ms (attempt 3/5)4797worker2 # [ 57.914072] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 321 ms (attempt 4/5)4798worker2 # [ 58.241368] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4799worker2 # [ 58.247504] nix-grpc-daemon[781]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4800worker2 # [ 58.453511] nix-daemon[804]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4801worker2 # [ 58.466940] nix-daemon[804]: reaped child process 1080, status = succeeded4802worker2 # [ 58.607775] nix-daemon[804]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4803worker2 # [ 58.620336] nix-daemon[804]: reaped child process 1085, status = succeeded4804lb # [ 58.650265] niks3-server[1039]: 2026/09/19 21:22:19 INFO Received uploads request method=POST path=/api/pending_closures4805worker2 # [ 58.641588] nix-grpc-daemon[814]: time=2026-09-19T21:22:19.521Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4806worker2 # [ 58.643389] nix-grpc-daemon[814]: time=2026-09-19T21:22:19.522Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4807lb # [ 58.677124] niks3-server[1039]: 2026/09/19 21:22:19 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4808lb # [ 58.688516] niks3-server[1039]: 2026/09/19 21:22:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4809lb # [ 58.693805] niks3-server[1039]: 2026/09/19 21:22:19 INFO Signed narinfos id=19 count=14810worker2 # [ 58.679178] nix-grpc-daemon[814]: time=2026-09-19T21:22:19.558Z level=INFO msg="Uploading 1 narinfos"4811lb # [ 58.700129] niks3-server[1039]: 2026/09/19 21:22:19 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4812lb # [ 58.711656] niks3-server[1039]: 2026/09/19 21:22:19 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4813worker2 # [ 58.699982] nix-grpc-daemon[814]: time=2026-09-19T21:22:19.579Z level=INFO msg="Upload complete. (427ms)"4814lb # [ 58.717759] niks3-server[1039]: 2026/09/19 21:22:19 INFO Completed upload id=194815lb # [ 58.720793] niks3-server[1039]: 2026/09/19 21:22:19 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4816worker2 # [ 58.702508] nix-grpc-daemon[781]: ts=2026-09-19T21:22:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 paths=1 nar_bytes_in=5604817worker2 # [ 58.707641] nix-grpc-daemon[781]: ts=2026-09-19T21:22:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386844818worker2 # [ 58.715263] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4819worker2 # [ 58.721566] nix-daemon[804]: reaped child process 1071, status = succeeded4820worker2 # [ 58.732551] nix-grpc-daemon[781]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4821worker2 # [ 58.742309] nix-daemon[804]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4822client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4823client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4824worker2 # [ 59.968671] nix-daemon[804]: reaped child process 1090, status = succeeded4825worker2 # [ 60.125112] nix-daemon[804]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)4826worker2 # [ 60.137276] nix-daemon[804]: reaped child process 1108, status = succeeded4827lb # [ 60.172560] niks3-server[1039]: 2026/09/19 21:22:20 INFO Received uploads request method=POST path=/api/pending_closures4828worker2 # [ 60.162716] nix-grpc-daemon[814]: time=2026-09-19T21:22:21.042Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4829lb # [ 60.201802] niks3-server[1039]: 2026/09/19 21:22:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4830lb # [ 60.207101] niks3-server[1039]: 2026/09/19 21:22:20 INFO Signed narinfos id=20 count=14831worker2 # [ 60.192292] nix-grpc-daemon[814]: time=2026-09-19T21:22:21.071Z level=INFO msg="Uploading 1 narinfos"4832lb # [ 60.215763] niks3-server[1039]: 2026/09/19 21:22:20 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4833lb # [ 60.229580] niks3-server[1039]: 2026/09/19 21:22:20 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4834worker2 # [ 60.218230] nix-grpc-daemon[814]: time=2026-09-19T21:22:21.097Z level=INFO msg="Upload complete. (266ms)"4835lb # [ 60.236450] niks3-server[1039]: 2026/09/19 21:22:20 INFO Completed upload id=204836worker2 # [ 60.220755] nix-grpc-daemon[781]: ts=2026-09-19T21:22:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=14837lb # [ 60.240816] niks3-server[1039]: 2026/09/19 21:22:20 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4838worker2 # [ 60.228539] nix-daemon[804]: reaped child process 1087, status = succeeded4839lb # [ 60.244410] niks3-server[1039]: 2026/09/19 21:22:20 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4840client # copying 1 paths...4841worker1 # [ 60.232629] nix-grpc-daemon[785]: ts=2026-09-19T21:22:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552884842worker1 # [ 60.243072] nix-grpc-daemon[785]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...4843client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4844worker2 # [ 60.277116] nix-grpc-daemon[781]: ts=2026-09-19T21:22:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:386844845worker2 # [ 60.283107] nix-grpc-daemon[781]: ts=2026-09-19T21:22:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38684 duration_s=0 paths=1 nar_bytes_out=1204846client # [ 60.400971] nix-daemon[927]: reaped child process 1031, status = succeeded4847client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.38 seconds)4848client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24849client # [ 60.570320] nix-daemon[927]: accepted connection from pid 1049, user root (trusted)4850client # this derivation will be built:4851client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4852client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4853worker2 # [ 60.715880] nix-grpc-daemon[781]: ts=2026-09-19T21:22:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:386844854worker2 # [ 60.722633] nix-grpc-daemon[781]: ts=2026-09-19T21:22:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386844855worker2 # [ 60.727509] nix-grpc-daemon[814]: time=2026-09-19T21:22:21.606Z level=INFO msg="All 1 paths already cached"4856worker1 # [ 60.734740] nix-grpc-daemon[785]: ts=2026-09-19T21:22:21Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=04857worker1 # [ 60.737455] nix-grpc-daemon[785]: ts=2026-09-19T21:22:21Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14858worker1 # [ 60.740214] nix-grpc-daemon[785]: ts=2026-09-19T21:22:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552884859worker1 # [ 60.746739] nix-grpc-daemon[785]: ts=2026-09-19T21:22:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552884860worker1 # [ 60.753353] nix-grpc-daemon[889]: time=2026-09-19T21:22:21.788Z level=INFO msg="All 1 paths already cached"4861client # copying 1 paths to 'lb:50051'...4862client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...4863worker1 # [ 60.757563] nix-grpc-daemon[785]: ts=2026-09-19T21:22:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552884864worker1 # [ 60.762427] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4865worker1 # [ 60.914326] nix-daemon[844]: accepted connection from pid 1024, user nix-grpc-daemon (trusted)4866worker1 # [ 60.927226] nix-daemon[844]: reaped child process 1027, status = succeeded4867worker1 # [ 61.074626] nix-daemon[844]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4868worker1 # [ 61.086507] nix-daemon[844]: reaped child process 1032, status = succeeded4869lb # [ 61.119984] niks3-server[1039]: 2026/09/19 21:22:21 INFO Received uploads request method=POST path=/api/pending_closures4870worker1 # [ 61.109122] nix-grpc-daemon[889]: time=2026-09-19T21:22:22.143Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4871worker1 # [ 61.110462] nix-grpc-daemon[889]: time=2026-09-19T21:22:22.143Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"4872lb # [ 61.145580] niks3-server[1039]: 2026/09/19 21:22:21 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst4873lb # [ 61.156270] niks3-server[1039]: 2026/09/19 21:22:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4874lb # [ 61.160517] niks3-server[1039]: 2026/09/19 21:22:21 INFO Signed narinfos id=21 count=14875worker1 # [ 61.143884] nix-grpc-daemon[889]: time=2026-09-19T21:22:22.178Z level=INFO msg="Uploading 1 narinfos"4876lb # [ 61.170617] niks3-server[1039]: 2026/09/19 21:22:21 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls4877lb # [ 61.180840] niks3-server[1039]: 2026/09/19 21:22:21 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4878lb # [ 61.186785] niks3-server[1039]: 2026/09/19 21:22:21 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo4879lb # [ 61.188692] niks3-server[1039]: 2026/09/19 21:22:21 INFO Completed upload id=214880worker1 # [ 61.168546] nix-grpc-daemon[889]: time=2026-09-19T21:22:22.203Z level=INFO msg="Upload complete. (398ms)"4881worker1 # [ 61.170491] nix-grpc-daemon[785]: ts=2026-09-19T21:22:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=1 nar_bytes_in=5604882worker1 # [ 61.175288] nix-grpc-daemon[785]: ts=2026-09-19T21:22:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552884883worker1 # [ 61.182475] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4884worker1 # [ 61.192732] nix-daemon[844]: accepted connection from pid 785, user nix-grpc-daemon (trusted)4885client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...4886worker1 # [ 61.194074] nix-daemon[844]: reaped child process 1022, status = succeeded4887client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4888worker1 # [ 62.620861] nix-daemon[844]: reaped child process 1036, status = succeeded4889worker1 # [ 62.759354] nix-daemon[844]: accepted connection from pid 1051, user nix-grpc-daemon (trusted)4890worker1 # [ 62.769891] nix-daemon[844]: reaped child process 1054, status = succeeded4891lb # [ 62.805308] niks3-server[1039]: 2026/09/19 21:22:23 INFO Received uploads request method=POST path=/api/pending_closures4892worker1 # [ 62.796345] nix-grpc-daemon[889]: time=2026-09-19T21:22:23.831Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4893worker1 # [ 62.817611] nix-grpc-daemon[889]: time=2026-09-19T21:22:23.852Z level=INFO msg="Uploading 1 narinfos"4894lb # [ 62.837977] niks3-server[1039]: 2026/09/19 21:22:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4895lb # [ 62.842528] niks3-server[1039]: 2026/09/19 21:22:23 INFO Signed narinfos id=22 count=14896lb # [ 62.854638] niks3-server[1039]: 2026/09/19 21:22:23 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4897lb # [ 62.861540] niks3-server[1039]: 2026/09/19 21:22:23 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls4898lb # [ 62.871227] niks3-server[1039]: 2026/09/19 21:22:23 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4899lb # [ 62.877100] niks3-server[1039]: 2026/09/19 21:22:23 INFO Completed upload id=224900worker1 # [ 62.856924] nix-grpc-daemon[889]: time=2026-09-19T21:22:23.891Z level=INFO msg="Upload complete. (256ms)"4901lb # [ 62.881954] niks3-server[1039]: 2026/09/19 21:22:23 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo4902worker1 # [ 62.862414] nix-grpc-daemon[785]: ts=2026-09-19T21:22:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=14903client # copying 1 paths...4904worker1 # [ 62.874276] nix-daemon[844]: reaped child process 1034, status = succeeded4905worker2 # [ 62.875356] nix-grpc-daemon[781]: ts=2026-09-19T21:22:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386844906worker2 # [ 62.890345] nix-grpc-daemon[781]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...4907client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...4908worker1 # [ 62.917383] nix-grpc-daemon[785]: ts=2026-09-19T21:22:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:552884909worker1 # [ 62.922778] nix-grpc-daemon[785]: ts=2026-09-19T21:22:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55288 duration_s=0 paths=1 nar_bytes_out=1204910client # [ 62.994271] nix-daemon[927]: reaped child process 1052, status = succeeded4911client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.59 seconds)4912(finished: subtest: an input only one worker has still reaches the builder, in 9.25 seconds)4913subtest: upload whose reference the worker lacks is completed from the cache4914client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache4915client # this derivation will be built:4916client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv4917client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...4918client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.37 seconds)4919client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache4920client # this derivation will be built:4921client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv4922client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...4923client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.36 seconds)4924client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure4925client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds)4926worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4927worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.17 seconds)4928worker2 # [ 64.091667] systemd[1]: Stopping Nix worker-protocol over gRPC...4929worker2 # [ 64.681365] nix-grpc-daemon[781]: ts=2026-09-19T21:22:25Z level=info event=signal_exit4930worker1 # [ 64.689912] nix-grpc-daemon[785]: ts=2026-09-19T21:22:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422224931worker1 # [ 64.693783] nix-grpc-daemon[785]: ts=2026-09-19T21:22:25Z level=info event=worker_gone addr=192.168.1.4:50051 system=x86_64-linux4932worker2 # [ 64.700464] nix-grpc-daemon[781]: ts=2026-09-19T21:22:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4933worker2 # [ 64.722476] nix-daemon[804]: reaped child process 806, status = succeeded4934worker2 # [ 64.798339] nix-grpc-daemon[781]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4935worker2 # [ 64.801691] nix-grpc-daemon[781]: E0000 00:00:1789852945.677493 792 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4936worker2 # [ 64.998692] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4937worker2 # [ 65.001635] systemd[1]: Stopped Nix worker-protocol over gRPC.4938worker2 # [ 65.005468] systemd[1]: nix-grpc-daemon.service: Consumed 2.149s CPU time over 47.593s wall clock time, 51.8M memory peak, 65.7K incoming IP traffic, 116.2K outgoing IP traffic.4939worker2 # [ 65.017263] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4940worker2 # [ 65.021501] systemd[1]: Closed Nix worker-protocol over gRPC.4941worker2 # [ 65.025156] systemd[1]: nix-grpc-daemon.socket: Consumed 318us CPU time over 55.491s wall clock time, 256K memory peak, 47.6K incoming IP traffic, 38.2K outgoing IP traffic.4942lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy4943lb: must succeed: curl -sf localhost:9901/clusters4944lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4945lb: must succeed: curl -sf localhost:9901/clusters4946lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4947lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 1.14 seconds)4948client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&24949worker1 # [ 66.340630] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552884950client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache4951worker1 # [ 66.345770] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552884952client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.20 seconds)4953worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache4954worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)4955worker2 # [ 66.437368] systemd[1]: Listening on Nix worker-protocol over gRPC.4956worker1 # [ 66.496756] systemd[1]: Stopping Nix worker-protocol over gRPC...4957worker1 # [ 66.637350] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=info event=signal_exit4958worker1 # [ 66.640817] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=info event=scheduler_restarting4959worker1 # [ 66.645642] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=info event=scheduler_restarting addr=lb:500514960worker1 # [ 66.648763] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422224961worker1 # [ 66.652186] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=info event=worker_gone addr=192.168.1.3:50051 system=x86_64-linux4962worker1 # [ 66.856226] nix-grpc-daemon[785]: ts=2026-09-19T21:22:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4963worker1 # [ 66.874719] nix-daemon[844]: reaped child process 846, status = succeeded4964worker1 # [ 66.940406] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4965worker1 # [ 66.943874] systemd[1]: Stopped Nix worker-protocol over gRPC.4966worker1 # [ 66.945893] systemd[1]: nix-grpc-daemon.service: Consumed 1.322s CPU time over 49.545s wall clock time, 49.5M memory peak, 47.8K incoming IP traffic, 82.6K outgoing IP traffic.4967worker1 # [ 66.955232] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4968worker1 # [ 66.958672] systemd[1]: Closed Nix worker-protocol over gRPC.4969worker1 # [ 66.961550] systemd[1]: nix-grpc-daemon.socket: Consumed 281us CPU time over 57.587s wall clock time, 256K memory peak, 69.7K incoming IP traffic, 61.3K outgoing IP traffic.4970lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy4971lb: must succeed: curl -sf localhost:9901/clusters4972worker2 # [ 66.985203] systemd[1]: Starting Nix worker-protocol over gRPC...4973lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4974worker2 # [ 67.145475] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4975worker2 # [ 67.147108] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14976worker2 # [ 67.153688] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4977worker2 # [ 67.155325] systemd[1]: Started Nix worker-protocol over gRPC.4978worker2 # [ 67.169192] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_connected addr=lb:500514979worker2 # [ 67.173778] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4980worker2 # [ 67.375135] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_connected addr=lb:500514981worker2 # [ 67.379123] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4982lb # [ 67.426467] envoy[919]: conn peer=[2001:db8:1::1]:36638 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=584983lb # [ 67.429273] envoy[919]: conn peer=[2001:db8:1::1]:36636 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3689 tx=1919 ms=29974984lb # [ 67.433515] envoy[919]: conn peer=[2001:db8:1::1]:36640 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3703 tx=1913 ms=22194985lb # [ 67.437718] envoy[919]: conn peer=[2001:db8:1::1]:55766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=154986lb # [ 67.441685] envoy[919]: conn peer=[2001:db8:1::4]:33332 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1713 tx=732 ms=469974987lb # [ 67.446064] envoy[919]: conn peer=[2001:db8:1::1]:55780 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=164988lb # [ 67.450095] envoy[919]: conn peer=192.168.1.3:40848 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1141 tx=468 ms=483504989worker2 # [ 67.579944] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_connected addr=lb:500514990worker2 # [ 67.584234] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4991worker2 # [ 67.785137] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_connected addr=lb:500514992worker2 # [ 67.789184] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4993worker2 # [ 67.989978] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_connected addr=lb:500514994worker2 # [ 67.994165] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4995lb: must succeed: curl -sf localhost:9901/clusters4996lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4997lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 1.14 seconds)4998client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&24999worker2 # [ 68.195839] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_connected addr=lb:500515000worker2 # [ 68.199998] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5001worker2 # [ 68.311182] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582765002worker2 # [ 68.322484] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5003worker2 # [ 68.338274] nix-grpc-daemon[1130]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 1/5)5004worker2 # [ 68.400754] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_connected addr=lb:500515005worker2 # [ 68.404594] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5006worker2 # [ 68.413945] nix-grpc-daemon[1130]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 2/5)5007worker2 # [ 68.469797] nix-grpc-daemon[1130]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 363 ms (attempt 3/5)5008worker2 # [ 68.605557] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_connected addr=lb:500515009worker2 # [ 68.609577] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5010worker2 # [ 68.810461] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_connected addr=lb:500515011worker2 # [ 68.814399] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5012worker2 # [ 68.838629] nix-grpc-daemon[1130]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 4/5)5013worker2 # [ 68.896355] nix-grpc-daemon[1130]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5014client # copying 2 paths...5015client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5016worker2 # [ 68.913741] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582765017client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5018worker2 # [ 68.927129] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5019worker2 # [ 68.945951] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=niks3_push_started pid=11515020worker2 # [ 69.014799] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_connected addr=lb:500515021worker2 # [ 69.017278] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5022worker2 # [ 69.220770] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:30Z level=info event=scheduler_connected addr=lb:500515023worker2 # [ 69.222494] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5024worker2 # [ 69.284228] nix-daemon[804]: accepted connection from pid 1164, user nix-grpc-daemon (trusted)5025worker2 # [ 69.297132] nix-daemon[804]: reaped child process 1167, status = succeeded5026lb # [ 69.330904] niks3-server[1039]: 2026/09/19 21:22:29 INFO Received uploads request method=POST path=/api/pending_closures5027lb # [ 69.339825] niks3-server[1039]: 2026/09/19 21:22:29 INFO Received uploads request method=POST path=/api/pending_closures5028worker2 # [ 69.330077] nix-grpc-daemon[1151]: time=2026-09-19T21:22:30.209Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5029worker2 # [ 69.331609] nix-grpc-daemon[1151]: time=2026-09-19T21:22:30.211Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5030worker2 # [ 69.334102] nix-grpc-daemon[1151]: time=2026-09-19T21:22:30.213Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5031lb # [ 69.382656] niks3-server[1039]: 2026/09/19 21:22:29 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5032lb # [ 69.400827] niks3-server[1039]: 2026/09/19 21:22:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5033lb # [ 69.406095] niks3-server[1039]: 2026/09/19 21:22:29 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5034lb # [ 69.411175] niks3-server[1039]: 2026/09/19 21:22:29 INFO Signed narinfos id=23 count=15035lb # [ 69.414447] niks3-server[1039]: 2026/09/19 21:22:29 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5036lb # [ 69.416847] niks3-server[1039]: 2026/09/19 21:22:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5037lb # [ 69.418912] niks3-server[1039]: 2026/09/19 21:22:29 INFO Signed narinfos id=24 count=25038lb # [ 69.420426] niks3-server[1039]: 2026/09/19 21:22:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5039worker2 # [ 69.404153] nix-grpc-daemon[1151]: time=2026-09-19T21:22:30.282Z level=INFO msg="Uploading 3 narinfos"5040lb # [ 69.434437] niks3-server[1039]: 2026/09/19 21:22:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5041lb # [ 69.437167] niks3-server[1039]: 2026/09/19 21:22:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5042lb # [ 69.439508] niks3-server[1039]: 2026/09/19 21:22:29 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5043worker2 # [ 69.423075] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:30Z level=info event=scheduler_connected addr=lb:500515044lb # [ 69.443620] niks3-server[1039]: 2026/09/19 21:22:29 INFO Completed upload id=235045lb # [ 69.445106] niks3-server[1039]: 2026/09/19 21:22:29 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5046worker2 # [ 69.426716] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5047lb # [ 69.448158] niks3-server[1039]: 2026/09/19 21:22:29 INFO Completed upload id=245048lb # [ 69.449890] niks3-server[1039]: 2026/09/19 21:22:29 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5049worker2 # [ 69.431965] nix-grpc-daemon[1151]: time=2026-09-19T21:22:30.311Z level=INFO msg="Upload complete. (304ms)"5050worker2 # [ 69.435935] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=0 paths=2 nar_bytes_in=3125051worker2 # [ 69.444853] nix-daemon[804]: reaped child process 1149, status = succeeded5052client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.36 seconds)5053worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5054worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5055worker1 # [ 69.543670] systemd[1]: Listening on Nix worker-protocol over gRPC.5056worker1 # [ 69.551181] systemd[1]: Starting Nix worker-protocol over gRPC...5057worker2 # [ 69.627293] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:30Z level=info event=scheduler_connected addr=lb:500515058worker1 # [ 69.695603] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5059worker1 # [ 69.698509] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15060worker1 # [ 69.704539] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5061worker1 # [ 69.708122] systemd[1]: Started Nix worker-protocol over gRPC.5062worker1 # [ 69.715255] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:30Z level=info event=worker_hello addr=192.168.1.4:50051 system=x86_64-linux max_jobs=1 running=05063lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5064lb: must succeed: curl -sf localhost:9901/clusters5065worker1 # [ 69.726912] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:30Z level=info event=scheduler_connected addr=lb:500515066worker1 # [ 69.728623] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:30Z level=info event=worker_hello addr=192.168.1.3:50051 system=x86_64-linux max_jobs=1 running=05067lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5068lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5069(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 6.80 seconds)5070subtest: scheduler down: builds wait, then resume when it is back5071worker1 # [ 69.831271] systemd[1]: Stopping Nix worker-protocol over gRPC...5072worker1 # [ 70.705470] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:31Z level=info event=signal_exit5073worker1 # [ 70.708113] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:31Z level=info event=scheduler_restarting5074worker1 # [ 70.709511] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:31Z level=info event=scheduler_restarting addr=lb:500515075worker1 # [ 70.711335] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:344345076worker2 # [ 70.713386] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:31Z level=info event=scheduler_restarting addr=lb:500515077worker1 # [ 70.712866] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:31Z level=info event=worker_gone addr=192.168.1.3:50051 system=x86_64-linux5078worker1 # [ 70.714451] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:344345079worker1 # [ 70.716094] nix-grpc-daemon[1077]: ts=2026-09-19T21:22:31Z level=info event=worker_gone addr=192.168.1.4:50051 system=x86_64-linux5080worker2 # [ 70.913635] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:31Z level=info event=scheduler_connected addr=lb:500515081worker1 # [ 70.912870] nix-grpc-daemon[1077]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5082worker1 # [ 70.915792] nix-grpc-daemon[1077]: E0000 00:00:1789852951.947536 1120 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 13, started true, shutdown true5083worker2 # [ 71.711764] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5084worker1 # [ 71.723669] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5085worker1 # [ 71.726618] systemd[1]: Stopped Nix worker-protocol over gRPC.5086worker1 # [ 71.730323] systemd[1]: nix-grpc-daemon.service: Consumed 92ms CPU time over 2.172s wall clock time, 9.8M memory peak, 6K incoming IP traffic, 5K outgoing IP traffic.5087worker1 # [ 71.741687] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5088worker1 # [ 71.745959] systemd[1]: Closed Nix worker-protocol over gRPC.5089worker1 # [ 71.749646] systemd[1]: nix-grpc-daemon.socket: Consumed 516us CPU time over 2.208s wall clock time, 256K memory peak, 11K incoming IP traffic, 9.7K outgoing IP traffic.5090lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy5091lb: must succeed: curl -sf localhost:9901/clusters5092lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5093lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 0.05 seconds)5094client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback5095client # [ 71.850074] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback.5096client # Running as unit: waits.service; invocation ID: b2acfb22687d4d3686876ee560364c325097client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback, in 0.04 seconds)5098??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5099 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735100client: must succeed: sleep 3.05101worker2 # [ 71.913748] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:32Z level=info event=scheduler_connected addr=lb:500515102worker2 # [ 71.917726] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5103worker2 # [ 72.015519] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582765104client # [ 72.034585] nix[1128]: don't know how to build these paths:5105client # [ 72.035533] nix[1128]: /nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5106client # [ 72.037071] nix[1128]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5107worker2 # [ 72.118647] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:32Z level=info event=scheduler_connected addr=lb:500515108worker2 # [ 72.122615] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5109worker2 # [ 72.323553] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_connected addr=lb:500515110worker2 # [ 72.327565] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5111worker2 # [ 72.528390] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_connected addr=lb:500515112client # [ 72.540102] nix[1128]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5113worker2 # [ 72.532305] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5114worker2 # [ 72.732933] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_connected addr=lb:500515115worker2 # [ 72.736971] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5116worker2 # [ 72.938888] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_connected addr=lb:500515117worker2 # [ 72.942728] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5118worker2 # [ 73.143672] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_connected addr=lb:500515119worker2 # [ 73.147709] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5120worker2 # [ 73.348516] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_connected addr=lb:500515121worker2 # [ 73.352444] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5122client # [ 73.543443] nix[1128]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5123worker2 # [ 73.553353] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_connected addr=lb:500515124worker2 # [ 73.557201] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5125worker2 # [ 73.757915] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_connected addr=lb:500515126worker2 # [ 73.761989] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5127worker2 # [ 73.963973] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_connected addr=lb:500515128worker2 # [ 73.966126] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5129worker2 # [ 74.167138] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_connected addr=lb:500515130worker2 # [ 74.170976] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5131worker2 # [ 74.371871] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_connected addr=lb:500515132worker2 # [ 74.375902] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5133worker2 # [ 74.576303] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_connected addr=lb:500515134worker2 # [ 74.578753] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5135worker2 # [ 74.779933] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_connected addr=lb:500515136worker2 # [ 74.784268] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5137client: (finished: must succeed: sleep 3.0, in 3.03 seconds)5138client: must succeed: systemctl is-active waits5139client: (finished: must succeed: systemctl is-active waits, in 0.04 seconds)5140worker1 # [ 74.969731] systemd[1]: Listening on Nix worker-protocol over gRPC.5141worker1 # [ 74.977387] systemd[1]: Starting Nix worker-protocol over gRPC...5142worker2 # [ 74.986458] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:35Z level=info event=scheduler_connected addr=lb:500515143worker1 # [ 75.134971] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5144worker1 # [ 75.137795] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15145worker1 # [ 75.143750] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5146worker1 # [ 75.145313] systemd[1]: Started Nix worker-protocol over gRPC.5147worker1 # [ 75.155685] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=info event=worker_hello addr=192.168.1.4:50051 system=x86_64-linux max_jobs=1 running=05148lb: waiting until exactly no endpoints of sched are unhealthy5149lb: must succeed: curl -sf localhost:9901/clusters5150worker1 # [ 75.164115] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=info event=scheduler_connected addr=lb:500515151worker1 # [ 75.165765] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=info event=worker_hello addr=192.168.1.3:50051 system=x86_64-linux max_jobs=1 running=05152lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5153worker1 # [ 75.538876] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=debug event=want client=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv cached=05154worker1 # [ 75.543326] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:36Z level=debug event=assigned drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv worker=192.168.1.4:50051 clients=15155worker2 # [ 75.587177] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765156worker2 # [ 75.600611] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582765157client # [ 75.624075] nix[1128]: copying 1 paths to 'lb:50051'...5158worker2 # [ 75.612177] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582765159client # [ 75.627454] nix[1128]: copying path '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' to 'lb:50051'...5160worker2 # [ 75.625513] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5161worker2 # [ 75.797394] nix-daemon[804]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5162worker2 # [ 75.810754] nix-daemon[804]: reaped child process 1177, status = succeeded5163worker2 # [ 75.972565] nix-daemon[804]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5164worker2 # [ 75.986646] nix-daemon[804]: reaped child process 1182, status = succeeded5165lb # [ 76.022407] niks3-server[1039]: 2026/09/19 21:22:36 INFO Received uploads request method=POST path=/api/pending_closures5166worker2 # [ 76.012989] nix-grpc-daemon[1151]: time=2026-09-19T21:22:36.892Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5167worker2 # [ 76.015166] nix-grpc-daemon[1151]: time=2026-09-19T21:22:36.894Z level=INFO msg="Uploading 78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv (520B)"5168lb # [ 76.050322] niks3-server[1039]: 2026/09/19 21:22:36 INFO Registered completed upload object_key=nar/06bjks304hxld0mwhch6kvcfiix46iimcpysvzrdsfv41vfc14ny.nar.zst5169lb # [ 76.059931] niks3-server[1039]: 2026/09/19 21:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5170lb # [ 76.064661] niks3-server[1039]: 2026/09/19 21:22:36 INFO Signed narinfos id=25 count=15171worker2 # [ 76.050728] nix-grpc-daemon[1151]: time=2026-09-19T21:22:36.930Z level=INFO msg="Uploading 1 narinfos"5172lb # [ 76.078728] niks3-server[1039]: 2026/09/19 21:22:36 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.ls5173lb # [ 76.085547] niks3-server[1039]: 2026/09/19 21:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5174worker2 # [ 76.075097] nix-grpc-daemon[1151]: time=2026-09-19T21:22:36.954Z level=INFO msg="Upload complete. (438ms)"5175lb # [ 76.092763] niks3-server[1039]: 2026/09/19 21:22:36 INFO Completed upload id=255176lb # [ 76.095262] niks3-server[1039]: 2026/09/19 21:22:36 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.narinfo5177worker2 # [ 76.078308] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=0 paths=1 nar_bytes_in=5205178worker2 # [ 76.083966] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765179worker2 # [ 76.090811] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5180worker2 # [ 76.097142] nix-daemon[804]: reaped child process 1172, status = succeeded5181client # [ 76.112879] nix[1128]: building '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' on lb:50051...5182worker2 # [ 76.101500] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5183lb: must succeed: curl -sf localhost:9901/clusters5184lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5185lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.13 seconds)5186client: waiting for success: ! systemctl is-active waits5187worker2 # [ 77.330815] nix-daemon[804]: reaped child process 1186, status = succeeded5188lb # [ 77.427665] envoy[919]: conn peer=[2001:db8:1::1]:55790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1010 tx=305 ms=11385189lb # [ 77.433058] envoy[919]: conn peer=[2001:db8:1::3]:52380 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=470 tx=177 ms=11895190worker2 # [ 77.495818] nix-daemon[804]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5191worker2 # [ 77.508556] nix-daemon[804]: reaped child process 1204, status = succeeded5192lb # [ 77.542262] niks3-server[1039]: 2026/09/19 21:22:38 INFO Received uploads request method=POST path=/api/pending_closures5193worker2 # [ 77.528577] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.408Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5194worker2 # [ 77.531060] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.409Z level=INFO msg="Uploading wxl98jgbbzfq9nz6nhndwvzybqml1mdg-farm-a (136B)"5195lb # [ 77.559384] niks3-server[1039]: 2026/09/19 21:22:38 INFO Registered completed upload object_key=log/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv5196lb # [ 77.562542] niks3-server[1039]: 2026/09/19 21:22:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5197lb # [ 77.565774] niks3-server[1039]: 2026/09/19 21:22:38 INFO Signed narinfos id=26 count=15198worker2 # [ 77.549483] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.428Z level=INFO msg="Uploading 1 narinfos"5199lb # [ 77.567025] niks3-server[1039]: 2026/09/19 21:22:38 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst5200lb # [ 77.571428] niks3-server[1039]: 2026/09/19 21:22:38 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.ls5201lb # [ 77.575233] niks3-server[1039]: 2026/09/19 21:22:38 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5202lb # [ 77.578298] niks3-server[1039]: 2026/09/19 21:22:38 INFO Completed upload id=265203worker2 # [ 77.560384] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.440Z level=INFO msg="Upload complete. (249ms)"5204lb # [ 77.580726] niks3-server[1039]: 2026/09/19 21:22:38 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.narinfo5205worker2 # [ 77.562802] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv assign_id=1 outputs=15206worker2 # [ 77.569489] nix-daemon[804]: reaped child process 1184, status = succeeded5207worker1 # [ 77.568751] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:38Z level=debug event=want client=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv cached=05208worker1 # [ 77.573215] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:38Z level=debug event=assigned drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv worker=192.168.1.4:50051 clients=15209worker2 # [ 77.613732] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765210worker2 # [ 77.622339] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582765211worker2 # [ 77.632485] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.512Z level=INFO msg="All 1 paths already cached"5212client # [ 77.650033] nix[1128]: copying 1 paths to 'lb:50051'...5213client # [ 77.650743] nix[1128]: copying path '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' to 'lb:50051'...5214worker2 # [ 77.637938] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582765215worker2 # [ 77.646131] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5216worker2 # [ 77.813127] nix-daemon[804]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5217worker2 # [ 77.826317] nix-daemon[804]: reaped child process 1211, status = succeeded5218worker2 # [ 78.003115] nix-daemon[804]: accepted connection from pid 1213, user nix-grpc-daemon (trusted)5219worker2 # [ 78.015924] nix-daemon[804]: reaped child process 1216, status = succeeded5220lb # [ 78.045233] niks3-server[1039]: 2026/09/19 21:22:38 INFO Received uploads request method=POST path=/api/pending_closures5221worker2 # [ 78.034679] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.914Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5222worker2 # [ 78.036084] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.914Z level=INFO msg="Uploading jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv (632B)"5223lb # [ 78.066384] niks3-server[1039]: 2026/09/19 21:22:38 INFO Registered completed upload object_key=nar/06r703613wasx30c56zihv19sk7v1y1xsivlzw3jax3csnwjf02v.nar.zst5224lb # [ 78.078751] niks3-server[1039]: 2026/09/19 21:22:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5225lb # [ 78.083618] niks3-server[1039]: 2026/09/19 21:22:38 INFO Signed narinfos id=27 count=15226worker2 # [ 78.068797] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.948Z level=INFO msg="Uploading 1 narinfos"5227lb # [ 78.089055] niks3-server[1039]: 2026/09/19 21:22:38 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.ls5228lb # [ 78.100588] niks3-server[1039]: 2026/09/19 21:22:38 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5229lb # [ 78.106821] niks3-server[1039]: 2026/09/19 21:22:38 INFO Completed upload id=275230worker2 # [ 78.089182] nix-grpc-daemon[1151]: time=2026-09-19T21:22:38.968Z level=INFO msg="Upload complete. (434ms)"5231lb # [ 78.109278] niks3-server[1039]: 2026/09/19 21:22:38 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.narinfo5232worker2 # [ 78.093118] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=0 paths=1 nar_bytes_in=6325233worker2 # [ 78.097697] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765234worker2 # [ 78.108060] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5235worker2 # [ 78.111820] nix-daemon[804]: reaped child process 1206, status = succeeded5236client # [ 78.128507] nix[1128]: building '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' on lb:50051...5237worker2 # [ 78.116748] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5238worker2 # [ 79.331797] nix-daemon[804]: reaped child process 1220, status = succeeded5239worker2 # [ 79.473943] nix-daemon[804]: accepted connection from pid 1235, user nix-grpc-daemon (trusted)5240worker2 # [ 79.487180] nix-daemon[804]: reaped child process 1238, status = succeeded5241lb # [ 79.519473] niks3-server[1039]: 2026/09/19 21:22:40 INFO Received uploads request method=POST path=/api/pending_closures5242worker2 # [ 79.506324] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.385Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5243worker2 # [ 79.507819] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.387Z level=INFO msg="Uploading ahy8cs7r52ad4fklig5k1khmrwzp7bkc-farm-b (184B)"5244lb # [ 79.540060] niks3-server[1039]: 2026/09/19 21:22:40 INFO Registered completed upload object_key=nar/1bxjgkmwyii071c3ahwryw7md5gl9qidg8bm2rb2v2idzf8bvmpb.nar.zst5245lb # [ 79.542667] niks3-server[1039]: 2026/09/19 21:22:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5246lb # [ 79.545206] niks3-server[1039]: 2026/09/19 21:22:40 INFO Signed narinfos id=28 count=15247worker2 # [ 79.527692] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.407Z level=INFO msg="Uploading 1 narinfos"5248lb # [ 79.547512] niks3-server[1039]: 2026/09/19 21:22:40 INFO Registered completed upload object_key=log/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv5249lb # [ 79.550080] niks3-server[1039]: 2026/09/19 21:22:40 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.ls5250lb # [ 79.554094] niks3-server[1039]: 2026/09/19 21:22:40 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5251lb # [ 79.557463] niks3-server[1039]: 2026/09/19 21:22:40 INFO Completed upload id=285252worker2 # [ 79.540891] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.420Z level=INFO msg="Upload complete. (217ms)"5253lb # [ 79.559130] niks3-server[1039]: 2026/09/19 21:22:40 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.narinfo5254worker2 # [ 79.543434] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv assign_id=2 outputs=15255worker2 # [ 79.550396] nix-daemon[804]: reaped child process 1218, status = succeeded5256worker1 # [ 79.547783] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:40Z level=debug event=want client=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv cached=05257worker1 # [ 79.552220] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:40Z level=debug event=assigned drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv worker=192.168.1.4:50051 clients=15258worker2 # [ 79.593361] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765259worker2 # [ 79.599395] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582765260worker2 # [ 79.605159] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.484Z level=INFO msg="All 2 paths already cached"5261client # [ 79.622837] nix[1128]: copying 1 paths to 'lb:50051'...5262worker2 # [ 79.610233] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582765263client # [ 79.625510] nix[1128]: copying path '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' to 'lb:50051'...5264worker2 # [ 79.622129] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5265worker2 # [ 79.788218] nix-daemon[804]: accepted connection from pid 1242, user nix-grpc-daemon (trusted)5266worker2 # [ 79.801452] nix-daemon[804]: reaped child process 1245, status = succeeded5267worker2 # [ 79.931431] nix-daemon[804]: accepted connection from pid 1247, user nix-grpc-daemon (trusted)5268worker2 # [ 79.944369] nix-daemon[804]: reaped child process 1250, status = succeeded5269lb # [ 79.972854] niks3-server[1039]: 2026/09/19 21:22:40 INFO Received uploads request method=POST path=/api/pending_closures5270worker2 # [ 79.963881] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.843Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5271worker2 # [ 79.965265] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.843Z level=INFO msg="Uploading 4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv (760B)"5272lb # [ 79.998367] niks3-server[1039]: 2026/09/19 21:22:40 INFO Registered completed upload object_key=nar/1dx1l3qanf0yqmk397nzvl6w8vm5z1klsskxak9mqzzqlm7rj9id.nar.zst5273lb # [ 80.007258] niks3-server[1039]: 2026/09/19 21:22:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5274lb # [ 80.011721] niks3-server[1039]: 2026/09/19 21:22:40 INFO Signed narinfos id=29 count=15275worker2 # [ 79.997098] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.876Z level=INFO msg="Uploading 1 narinfos"5276lb # [ 80.022073] niks3-server[1039]: 2026/09/19 21:22:40 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.ls5277lb # [ 80.028944] niks3-server[1039]: 2026/09/19 21:22:40 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5278worker2 # [ 80.017256] nix-grpc-daemon[1151]: time=2026-09-19T21:22:40.897Z level=INFO msg="Upload complete. (386ms)"5279lb # [ 80.035078] niks3-server[1039]: 2026/09/19 21:22:40 INFO Completed upload id=295280worker2 # [ 80.019252] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=0 paths=1 nar_bytes_in=7605281worker2 # [ 80.022620] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765282lb # [ 80.040203] niks3-server[1039]: 2026/09/19 21:22:40 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.narinfo5283worker2 # [ 80.029186] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5284worker2 # [ 80.032794] nix-daemon[804]: reaped child process 1240, status = succeeded5285worker2 # [ 80.037881] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5286client # [ 80.049725] nix[1128]: building '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' on lb:50051...5287worker2 # [ 81.251853] nix-daemon[804]: reaped child process 1254, status = succeeded5288worker2 # [ 81.379917] nix-daemon[804]: accepted connection from pid 1269, user nix-grpc-daemon (trusted)5289worker2 # [ 81.393334] nix-daemon[804]: reaped child process 1272, status = succeeded5290lb # [ 81.421971] niks3-server[1039]: 2026/09/19 21:22:41 INFO Received uploads request method=POST path=/api/pending_closures5291worker2 # [ 81.412731] nix-grpc-daemon[1151]: time=2026-09-19T21:22:42.292Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5292worker2 # [ 81.414205] nix-grpc-daemon[1151]: time=2026-09-19T21:22:42.293Z level=INFO msg="Uploading 2kzynzc2x7d9fjl737krjzzjbsp5p77k-farm-top (240B)"5293lb # [ 81.456930] niks3-server[1039]: 2026/09/19 21:22:41 INFO Registered completed upload object_key=log/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5294lb # [ 81.464214] niks3-server[1039]: 2026/09/19 21:22:41 INFO Registered completed upload object_key=nar/1x5xsygwz4a6bpv0g402i3p0nk63j2j9qkxs1rdnp6s20644kc3j.nar.zst5295lb # [ 81.476899] niks3-server[1039]: 2026/09/19 21:22:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5296lb # [ 81.482238] niks3-server[1039]: 2026/09/19 21:22:41 INFO Signed narinfos id=30 count=15297worker2 # [ 81.467379] nix-grpc-daemon[1151]: time=2026-09-19T21:22:42.347Z level=INFO msg="Uploading 1 narinfos"5298lb # [ 81.486487] niks3-server[1039]: 2026/09/19 21:22:42 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.ls5299lb # [ 81.496629] niks3-server[1039]: 2026/09/19 21:22:42 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5300lb # [ 81.502613] niks3-server[1039]: 2026/09/19 21:22:42 INFO Completed upload id=305301worker2 # [ 81.485083] nix-grpc-daemon[1151]: time=2026-09-19T21:22:42.364Z level=INFO msg="Upload complete. (240ms)"5302lb # [ 81.505477] niks3-server[1039]: 2026/09/19 21:22:42 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.narinfo5303worker2 # [ 81.490320] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv assign_id=3 outputs=15304worker2 # [ 81.501660] nix-daemon[804]: reaped child process 1252, status = succeeded5305client # [ 81.537563] systemd[1]: waits.service: Deactivated successfully.5306client # [ 81.541154] systemd[1]: waits.service: Consumed 135ms CPU time over 9.690s wall clock time, 49.5M memory peak, 14.3K incoming IP traffic, 19.4K outgoing IP traffic.5307client: (finished: waiting for success: ! systemctl is-active waits, in 5.31 seconds)5308client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }5309client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.03 seconds)5310worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5311worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5312(finished: subtest: scheduler down: builds wait, then resume when it is back, in 11.87 seconds)5313subtest: clean scheduler restart: peers are told, reconnect without error or backoff5314client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5315client # [ 81.706714] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5316client # Running as unit: rs.service; invocation ID: 470ff3e8e13b4e13b54cc5f31e5e6ee85317client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5318worker1 # [ 81.876670] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:512445319worker1 # [ 81.881734] nix-daemon[844]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)5320client # [ 81.902756] nix[1188]: don't know how to build these paths:5321client # [ 81.903885] nix[1188]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5322worker1 # [ 81.892968] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:42Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05323worker1 # [ 81.894920] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:42Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15324worker1 # [ 81.898641] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:512445325worker1 # [ 81.905189] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 1/5)5326worker1 # [ 81.945553] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 110 ms (attempt 2/5)5327worker1 # [ 82.058386] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 376 ms (attempt 3/5)5328worker1 # [ 82.440172] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 579 ms (attempt 4/5)5329worker1 # [ 83.023231] nix-grpc-daemon[1138]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5330worker1 # [ 83.039450] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:512445331client # [ 83.065670] nix[1188]: copying 1 paths to 'lb:50051'...5332client # [ 83.069343] nix[1188]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5333worker1 # [ 83.055584] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:512445334worker1 # [ 83.067178] nix-daemon[844]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)5335worker1 # [ 83.086864] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:44Z level=info event=niks3_push_started pid=12125336worker1 # [ 83.388200] nix-daemon[844]: accepted connection from pid 1225, user nix-grpc-daemon (trusted)5337worker1 # [ 83.400184] nix-daemon[844]: reaped child process 1228, status = succeeded5338worker1 # [ 83.533304] nix-daemon[844]: accepted connection from pid 1230, user nix-grpc-daemon (trusted)5339worker1 # [ 83.545065] nix-daemon[844]: reaped child process 1233, status = succeeded5340lb # [ 83.581281] niks3-server[1039]: 2026/09/19 21:22:44 INFO Received uploads request method=POST path=/api/pending_closures5341worker1 # [ 83.568706] nix-grpc-daemon[1212]: time=2026-09-19T21:22:44.603Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5342worker1 # [ 83.572112] nix-grpc-daemon[1212]: time=2026-09-19T21:22:44.605Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5343lb # [ 83.614555] niks3-server[1039]: 2026/09/19 21:22:44 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5344lb # [ 83.623677] niks3-server[1039]: 2026/09/19 21:22:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5345worker1 # [ 83.610642] nix-grpc-daemon[1212]: time=2026-09-19T21:22:44.645Z level=INFO msg="Uploading 1 narinfos"5346lb # [ 83.631440] niks3-server[1039]: 2026/09/19 21:22:44 INFO Signed narinfos id=31 count=15347lb # [ 83.639364] niks3-server[1039]: 2026/09/19 21:22:44 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5348lb # [ 83.647096] niks3-server[1039]: 2026/09/19 21:22:44 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5349worker1 # [ 83.632847] nix-grpc-daemon[1212]: time=2026-09-19T21:22:44.667Z level=INFO msg="Upload complete. (372ms)"5350lb # [ 83.652984] niks3-server[1039]: 2026/09/19 21:22:44 INFO Completed upload id=315351worker1 # [ 83.634993] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51244 duration_s=0 paths=1 nar_bytes_in=4165352lb # [ 83.658105] niks3-server[1039]: 2026/09/19 21:22:44 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5353worker1 # [ 83.642091] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:512445354worker1 # [ 83.644328] nix-daemon[844]: reaped child process 1210, status = succeeded5355worker1 # [ 83.648641] nix-daemon[844]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)5356client # [ 83.668337] nix[1188]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5357worker1 # [ 83.654163] nix-daemon[844]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)5358worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5359worker2 # [ 85.283932] systemd-journald[286]: Received client request to rotate journal, rotating.5360worker2 # [ 85.292762] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/e0859137a0344eea8d026d69cd5f2ebc.5361worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5362worker1: must succeed: systemctl restart nix-grpc-daemon.service5363worker1 # [ 85.238404] systemd[1]: Stopping Nix worker-protocol over gRPC...5364worker1 # [ 85.268200] nix-daemon[844]: reaped child process 1237, status = succeeded5365worker1 # [ 85.393154] nix-daemon[844]: accepted connection from pid 1269, user nix-grpc-daemon (trusted)5366worker1 # [ 85.404167] nix-daemon[844]: reaped child process 1272, status = succeeded5367lb # [ 85.434320] niks3-server[1039]: 2026/09/19 21:22:45 INFO Received uploads request method=POST path=/api/pending_closures5368worker1 # [ 85.421672] nix-grpc-daemon[1212]: time=2026-09-19T21:22:46.456Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5369worker1 # [ 85.424058] nix-grpc-daemon[1212]: time=2026-09-19T21:22:46.458Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5370lb # [ 85.471591] niks3-server[1039]: 2026/09/19 21:22:45 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5371lb # [ 85.478661] niks3-server[1039]: 2026/09/19 21:22:45 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5372lb # [ 85.490464] niks3-server[1039]: 2026/09/19 21:22:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5373lb # [ 85.495381] niks3-server[1039]: 2026/09/19 21:22:46 INFO Signed narinfos id=32 count=15374worker1 # [ 85.479032] nix-grpc-daemon[1212]: time=2026-09-19T21:22:46.513Z level=INFO msg="Uploading 1 narinfos"5375lb # [ 85.501604] niks3-server[1039]: 2026/09/19 21:22:46 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5376lb # [ 85.512103] niks3-server[1039]: 2026/09/19 21:22:46 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5377lb # [ 85.516090] niks3-server[1039]: 2026/09/19 21:22:46 INFO Completed upload id=325378lb # [ 85.518773] niks3-server[1039]: 2026/09/19 21:22:46 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5379worker1 # [ 85.498447] nix-grpc-daemon[1212]: time=2026-09-19T21:22:46.533Z level=INFO msg="Upload complete. (236ms)"5380worker1 # [ 85.503646] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51244 duration_s=1 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15381worker1 # [ 85.514833] nix-daemon[844]: reaped child process 1235, status = succeeded5382client # [ 85.539151] systemd[1]: rs.service: Deactivated successfully.5383client # [ 85.540581] systemd[1]: rs.service: Consumed 97ms CPU time over 3.833s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9K outgoing IP traffic.5384worker1 # [ 86.147770] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=signal_exit5385worker1 # [ 86.153701] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=scheduler_restarting5386worker2 # [ 86.156603] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:47Z level=info event=scheduler_restarting addr=lb:500515387worker1 # [ 86.156479] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=scheduler_restarting addr=lb:500515388worker1 # [ 86.159402] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:512185389worker1 # [ 86.162650] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=worker_gone addr=192.168.1.4:50051 system=x86_64-linux5390worker1 # [ 86.166090] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:512185391worker1 # [ 86.169302] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=worker_gone addr=192.168.1.3:50051 system=x86_64-linux5392worker2 # [ 86.356698] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:47Z level=info event=scheduler_connected addr=lb:500515393worker1 # [ 86.355695] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=scheduler_connected addr=lb:500515394worker1 # [ 86.362418] nix-grpc-daemon[1138]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5395worker1 # [ 86.371640] nix-grpc-daemon[1138]: E0000 00:00:1789852967.393751 1181 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5396worker1 # [ 86.378271] nix-grpc-daemon[1138]: ts=2026-09-19T21:22:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5397worker1 # [ 86.394712] nix-daemon[844]: reaped child process 1199, status = succeeded5398worker1 # [ 86.785285] nix-grpc-daemon[1138]: E0000 00:00:1789852967.819431 1181 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5399worker1 # [ 86.790587] nix-grpc-daemon[1138]: E0000 00:00:1789852967.825350 1181 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5400lb # [ 87.427908] envoy[919]: conn peer=[2001:db8:1::1]:55804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9977 tx=4030 ms=94895401lb # [ 87.431634] envoy[919]: conn peer=[2001:db8:1::1]:51694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1351 ms=36375402lb # [ 87.435437] envoy[919]: conn peer=[2001:db8:1::3]:47758 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=792 tx=260 ms=112115403worker2 # [ 87.678938] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5404worker1 # [ 87.690476] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5405worker1 # [ 87.694500] systemd[1]: Stopped Nix worker-protocol over gRPC.5406worker1 # [ 87.696520] systemd[1]: nix-grpc-daemon.service: Consumed 467ms CPU time over 12.712s wall clock time, 31.1M memory peak, 17.3K incoming IP traffic, 23.4K outgoing IP traffic.5407worker1 # [ 87.712231] systemd[1]: Starting Nix worker-protocol over gRPC...5408worker1 # [ 87.853700] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5409worker1 # [ 87.855698] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15410worker1 # [ 87.861058] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5411worker1 # [ 87.863815] systemd[1]: Started Nix worker-protocol over gRPC.5412worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.65 seconds)5413worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5414worker1 # [ 87.876619] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:48Z level=info event=scheduler_connected addr=lb:500515415worker1 # [ 87.881809] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:48Z level=info event=worker_hello addr=192.168.1.3:50051 system=x86_64-linux max_jobs=1 running=05416worker1 # [ 87.883813] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:48Z level=info event=worker_hello addr=192.168.1.4:50051 system=x86_64-linux max_jobs=1 running=05417worker2 # [ 87.886155] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:48Z level=info event=scheduler_connected addr=lb:500515418worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.06 seconds)5419worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5420worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.03 seconds)5421client: waiting for success: ! systemctl is-active rs5422client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds)5423client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5424client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5425client: must fail: journalctl -u rs | grep -q 'reconnecting'5426client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5427(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.50 seconds)5428subtest: scheduler restart mid-build: build finishes, no double build5429client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5430client # [ 88.204505] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5431client # Running as unit: mid.service; invocation ID: f2957dce9b5e4626b88047e27572015c5432client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5433worker1 # [ 88.380710] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:578565434worker1 # [ 88.391661] nix-daemon[844]: accepted connection from pid 1279, user nix-grpc-daemon (trusted)5435client # [ 88.418558] nix[1220]: don't know how to build these paths:5436client # [ 88.419438] nix[1220]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5437worker1 # [ 88.413410] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:49Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05438worker1 # [ 88.418156] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:49Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15439worker1 # [ 88.462750] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578565440worker1 # [ 88.473990] nix-grpc-daemon[1279]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 1/5)5441worker1 # [ 88.520770] nix-grpc-daemon[1279]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 2/5)5442worker1 # [ 88.659731] nix-grpc-daemon[1279]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 3/5)5443worker1 # [ 88.712108] nix-grpc-daemon[1279]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 766 ms (attempt 4/5)5444worker1 # [ 89.484151] nix-grpc-daemon[1279]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5445worker1 # [ 89.497028] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578565446client # [ 89.519778] nix[1220]: copying 1 paths to 'lb:50051'...5447worker1 # [ 89.508495] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578565448client # [ 89.523910] nix[1220]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5449worker1 # [ 89.513879] nix-daemon[844]: accepted connection from pid 1279, user nix-grpc-daemon (trusted)5450worker1 # [ 89.523823] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:50Z level=info event=niks3_push_started pid=13515451worker1 # [ 89.838984] nix-daemon[844]: accepted connection from pid 1364, user nix-grpc-daemon (trusted)5452worker1 # [ 89.851138] nix-daemon[844]: reaped child process 1367, status = succeeded5453worker1 # [ 90.002709] nix-daemon[844]: accepted connection from pid 1369, user nix-grpc-daemon (trusted)5454worker1 # [ 90.012962] nix-daemon[844]: reaped child process 1372, status = succeeded5455lb # [ 90.049255] niks3-server[1039]: 2026/09/19 21:22:50 INFO Received uploads request method=POST path=/api/pending_closures5456worker1 # [ 90.037222] nix-grpc-daemon[1351]: time=2026-09-19T21:22:51.071Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5457worker1 # [ 90.038914] nix-grpc-daemon[1351]: time=2026-09-19T21:22:51.073Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5458lb # [ 90.087671] niks3-server[1039]: 2026/09/19 21:22:50 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5459lb # [ 90.094583] niks3-server[1039]: 2026/09/19 21:22:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5460worker1 # [ 90.082155] nix-grpc-daemon[1351]: time=2026-09-19T21:22:51.116Z level=INFO msg="Uploading 1 narinfos"5461lb # [ 90.102739] niks3-server[1039]: 2026/09/19 21:22:50 INFO Signed narinfos id=33 count=15462lb # [ 90.108753] niks3-server[1039]: 2026/09/19 21:22:50 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5463lb # [ 90.119703] niks3-server[1039]: 2026/09/19 21:22:50 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5464worker1 # [ 90.105476] nix-grpc-daemon[1351]: time=2026-09-19T21:22:51.140Z level=INFO msg="Upload complete. (419ms)"5465lb # [ 90.125592] niks3-server[1039]: 2026/09/19 21:22:50 INFO Completed upload id=335466worker1 # [ 90.108069] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57856 duration_s=0 paths=1 nar_bytes_in=4245467lb # [ 90.127805] niks3-server[1039]: 2026/09/19 21:22:50 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5468worker1 # [ 90.113898] nix-daemon[844]: reaped child process 1349, status = succeeded5469worker1 # [ 90.115211] nix-grpc-daemon[1279]: ts=2026-09-19T21:22:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578565470worker1 # [ 90.119401] nix-daemon[844]: accepted connection from pid 1279, user nix-grpc-daemon (trusted)5471worker1 # [ 90.124758] nix-daemon[844]: accepted connection from pid 1279, user nix-grpc-daemon (trusted)5472client # [ 90.139090] nix[1220]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5473worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5474worker1 # [ 91.791812] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1279 (nix-grpc-daemon) on client request.5475worker1 # [ 91.793631] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5476client # [ 91.819812] nix[1220]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5477worker2 # [ 91.806454] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5478client # [ 91.823797] nix[1220]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5479worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5480client: must succeed: sleep 5.05481worker1 # [ 91.825715] nix-daemon[844]: reaped child process 1374, status = succeeded5482worker1 # [ 91.826850] nix-daemon[844]: reaped child process 1338, status = succeeded5483worker1 # [ 91.830281] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5484worker1 # [ 91.832173] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5485worker1 # [ 91.833553] systemd[1]: nix-grpc-daemon.service: Consumed 322ms CPU time over 4.117s wall clock time, 30.3M memory peak, 11.3K incoming IP traffic, 13.9K outgoing IP traffic.5486worker1 # [ 91.843249] nix-daemon[1376]: unexpected Nix daemon error: error: interrupted by the user5487worker1 # [ 91.846217] nix-daemon[844]: reaped child process 1376, status = failed with exit code 15488worker2 # [ 92.006368] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:52Z level=info event=scheduler_connected addr=lb:500515489worker1 # [ 92.006578] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5490worker1 # [ 92.010910] systemd[1]: Starting Nix worker-protocol over gRPC...5491worker1 # [ 92.127163] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5492worker1 # [ 92.128852] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15493worker1 # [ 92.134671] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5494worker1 # [ 92.137963] systemd[1]: Started Nix worker-protocol over gRPC.5495worker1 # [ 92.144584] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=info event=worker_hello addr=192.168.1.4:50051 system=x86_64-linux max_jobs=1 running=05496worker1 # [ 92.148941] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=info event=scheduler_connected addr=lb:500515497worker1 # [ 92.150574] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=info event=worker_hello addr=192.168.1.3:50051 system=x86_64-linux max_jobs=1 running=05498worker1 # [ 92.312958] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05499worker1 # [ 92.315351] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:53Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15500worker2 # [ 92.360399] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765501worker2 # [ 92.372466] nix-grpc-daemon[1130]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5502worker2 # [ 92.390711] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5503client # [ 92.416254] nix[1220]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5504worker2 # [ 92.406136] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5505client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5506client: waiting for success: ! systemctl is-active mid5507worker2 # [ 97.241670] nix-daemon[804]: reaped child process 1328, status = succeeded5508worker2 # [ 97.392566] nix-daemon[804]: accepted connection from pid 1352, user nix-grpc-daemon (trusted)5509worker2 # [ 97.404232] nix-daemon[804]: reaped child process 1355, status = succeeded5510lb # [ 97.428243] envoy[919]: conn peer=[2001:db8:1::3]:40474 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=457 tx=226 ms=39285511lb # [ 97.435201] niks3-server[1039]: 2026/09/19 21:22:57 INFO Received uploads request method=POST path=/api/pending_closures5512worker2 # [ 97.426285] nix-grpc-daemon[1151]: time=2026-09-19T21:22:58.305Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5513worker2 # [ 97.427885] nix-grpc-daemon[1151]: time=2026-09-19T21:22:58.307Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5514lb # [ 97.474359] niks3-server[1039]: 2026/09/19 21:22:57 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5515lb # [ 97.489964] niks3-server[1039]: 2026/09/19 21:22:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5516lb # [ 97.496762] niks3-server[1039]: 2026/09/19 21:22:58 INFO Signed narinfos id=34 count=15517worker2 # [ 97.481503] nix-grpc-daemon[1151]: time=2026-09-19T21:22:58.361Z level=INFO msg="Uploading 1 narinfos"5518lb # [ 97.503510] niks3-server[1039]: 2026/09/19 21:22:58 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5519lb # [ 97.511122] niks3-server[1039]: 2026/09/19 21:22:58 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5520lb # [ 97.515250] niks3-server[1039]: 2026/09/19 21:22:58 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5521lb # [ 97.518899] niks3-server[1039]: 2026/09/19 21:22:58 INFO Completed upload id=345522lb # [ 97.520674] niks3-server[1039]: 2026/09/19 21:22:58 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5523worker2 # [ 97.502632] nix-grpc-daemon[1151]: time=2026-09-19T21:22:58.382Z level=INFO msg="Upload complete. (279ms)"5524worker2 # [ 97.509242] nix-grpc-daemon[1130]: ts=2026-09-19T21:22:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15525worker2 # [ 97.519725] nix-daemon[804]: reaped child process 1326, status = succeeded5526client # [ 97.558522] systemd[1]: mid.service: Deactivated successfully.5527client # [ 97.561646] systemd[1]: mid.service: Consumed 120ms CPU time over 9.353s wall clock time, 37.1M memory peak, 9.6K incoming IP traffic, 10.6K outgoing IP traffic.5528client: (finished: waiting for success: ! systemctl is-active mid, in 1.07 seconds)5529client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5530client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5531(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.02 seconds)5532subtest: interrupting the client stops the build on the worker5533client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5534client # [ 98.227165] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5535client # Running as unit: intr.service; invocation ID: 078050fe1b6e4107bfed07638f9d45cb5536client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5537worker1 # [ 98.402611] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430765538worker1 # [ 98.407716] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5539client # [ 98.429226] nix[1255]: don't know how to build these paths:5540client # [ 98.430194] nix[1255]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5541worker1 # [ 98.419471] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:59Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05542worker1 # [ 98.421618] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:59Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15543worker1 # [ 98.464675] nix-grpc-daemon[1412]: ts=2026-09-19T21:22:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765544worker1 # [ 98.470964] nix-grpc-daemon[1412]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5)5545worker1 # [ 98.538470] nix-grpc-daemon[1412]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 2/5)5546worker1 # [ 98.549550] nix-grpc-daemon[1412]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 3/5)5547worker1 # [ 98.644060] nix-grpc-daemon[1412]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 439 ms (attempt 4/5)5548worker1 # [ 99.085844] nix-grpc-daemon[1412]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5549worker1 # [ 99.096738] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430765550client # [ 99.116788] nix[1255]: copying 1 paths to 'lb:50051'...5551worker1 # [ 99.105541] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430765552client # [ 99.120919] nix[1255]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5553worker1 # [ 99.110736] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5554worker1 # [ 99.121138] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:00Z level=info event=niks3_push_started pid=14815555worker1 # [ 99.454092] nix-daemon[844]: accepted connection from pid 1494, user nix-grpc-daemon (trusted)5556worker1 # [ 99.465025] nix-daemon[844]: reaped child process 1501, status = succeeded5557worker1 # [ 99.621154] nix-daemon[844]: accepted connection from pid 1503, user nix-grpc-daemon (trusted)5558worker1 # [ 99.632680] nix-daemon[844]: reaped child process 1506, status = succeeded5559lb # [ 99.669576] niks3-server[1039]: 2026/09/19 21:23:00 INFO Received uploads request method=POST path=/api/pending_closures5560worker1 # [ 99.660130] nix-grpc-daemon[1481]: time=2026-09-19T21:23:00.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5561worker1 # [ 99.661523] nix-grpc-daemon[1481]: time=2026-09-19T21:23:00.693Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5562lb # [ 99.701988] niks3-server[1039]: 2026/09/19 21:23:00 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5563lb # [ 99.712965] niks3-server[1039]: 2026/09/19 21:23:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5564lb # [ 99.717864] niks3-server[1039]: 2026/09/19 21:23:00 INFO Signed narinfos id=35 count=15565worker1 # [ 99.700862] nix-grpc-daemon[1481]: time=2026-09-19T21:23:00.735Z level=INFO msg="Uploading 1 narinfos"5566lb # [ 99.728467] niks3-server[1039]: 2026/09/19 21:23:00 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5567lb # [ 99.738797] niks3-server[1039]: 2026/09/19 21:23:00 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5568worker1 # [ 99.725864] nix-grpc-daemon[1481]: time=2026-09-19T21:23:00.760Z level=INFO msg="Upload complete. (429ms)"5569lb # [ 99.746049] niks3-server[1039]: 2026/09/19 21:23:00 INFO Completed upload id=355570lb # [ 99.748619] niks3-server[1039]: 2026/09/19 21:23:00 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5571worker1 # [ 99.728776] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=4245572worker1 # [ 99.734790] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765573worker1 # [ 99.744471] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5574worker1 # [ 99.746346] nix-daemon[844]: reaped child process 1479, status = succeeded5575worker1 # [ 99.751346] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5576client # [ 99.766280] nix[1255]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5577client: must succeed: systemctl kill -s INT intr5578client # [ 101.694144] systemd[1]: intr.service: Sent signal SIGINT to main process 1255 (nix) on client request.5579client # [ 101.702427] nix[1255]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5580client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5581client # [ 101.708268] nix[1255]: error: interrupted by the user5582client # [ 101.733360] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5583client # [ 101.734793] systemd[1]: intr.service: Failed with result 'exit-code'.5584client # [ 101.736892] systemd[1]: intr.service: Consumed 101ms CPU time over 3.509s wall clock time, 37.1M memory peak, 7.6K incoming IP traffic, 8.9K outgoing IP traffic.5585worker1 # [ 101.767829] nix-daemon[1510]: unexpected Nix daemon error:5586worker1 # [ 101.769376] nix-daemon[844]: reaped child process 1508, status = succeeded5587worker1 # [ 101.771112] nix-daemon[1510]: error: interrupted by the user5588worker1 # [ 101.773930] nix-daemon[844]: reaped child process 1510, status = failed with exit code 15589(finished: subtest: interrupting the client stops the build on the worker, in 4.75 seconds)5590subtest: a deploy mid-build drains: the build finishes, the new generation takes over5591client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5592client # [ 102.984918] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5593client # Running as unit: sw.service; invocation ID: 1954afe46f9644028e5115b487dc69485594client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.05 seconds)5595client # [ 103.149795] nix[1274]: don't know how to build these paths:5596client # [ 103.150722] nix[1274]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5597worker2 # [ 103.136169] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582765598worker1 # [ 103.144473] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:04Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05599worker1 # [ 103.148725] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:04Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15600worker2 # [ 103.189418] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765601worker2 # [ 103.201506] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582765602client # [ 103.224180] nix[1274]: copying 1 paths to 'lb:50051'...5603worker2 # [ 103.212450] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582765604client # [ 103.225941] nix[1274]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5605worker2 # [ 103.225882] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5606worker2 # [ 103.410324] nix-daemon[804]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5607worker2 # [ 103.425272] nix-daemon[804]: reaped child process 1390, status = succeeded5608worker2 # [ 103.593398] nix-daemon[804]: accepted connection from pid 1392, user nix-grpc-daemon (trusted)5609worker2 # [ 103.606051] nix-daemon[804]: reaped child process 1395, status = succeeded5610lb # [ 103.638664] niks3-server[1039]: 2026/09/19 21:23:04 INFO Received uploads request method=POST path=/api/pending_closures5611worker2 # [ 103.626527] nix-grpc-daemon[1151]: time=2026-09-19T21:23:04.505Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5612worker2 # [ 103.628044] nix-grpc-daemon[1151]: time=2026-09-19T21:23:04.505Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5613lb # [ 103.651840] niks3-server[1039]: 2026/09/19 21:23:04 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5614lb # [ 103.655615] niks3-server[1039]: 2026/09/19 21:23:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5615lb # [ 103.657682] niks3-server[1039]: 2026/09/19 21:23:04 INFO Signed narinfos id=36 count=15616worker2 # [ 103.640072] nix-grpc-daemon[1151]: time=2026-09-19T21:23:04.519Z level=INFO msg="Uploading 1 narinfos"5617lb # [ 103.663432] niks3-server[1039]: 2026/09/19 21:23:04 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5618lb # [ 103.665441] niks3-server[1039]: 2026/09/19 21:23:04 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5619lb # [ 103.669315] niks3-server[1039]: 2026/09/19 21:23:04 INFO Completed upload id=365620worker2 # [ 103.652711] nix-grpc-daemon[1151]: time=2026-09-19T21:23:04.532Z level=INFO msg="Upload complete. (415ms)"5621lb # [ 103.670756] niks3-server[1039]: 2026/09/19 21:23:04 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5622worker2 # [ 103.654832] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=0 paths=1 nar_bytes_in=4165623worker2 # [ 103.658235] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582765624worker2 # [ 103.662918] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5625worker2 # [ 103.668362] nix-daemon[804]: reaped child process 1385, status = succeeded5626client # [ 103.684875] nix[1274]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5627worker2 # [ 103.673300] nix-daemon[804]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)5628worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25629worker2 # Checking switch inhibitors... done5630worker2 # [ 106.109899] nixos[1430]: switching to system configuration /nix/store/152vywd94lrrk25hw7y9rvwiabsnrnxx-nixos-system-worker2-test5631worker2 # activating the configuration...5632worker2 # [ 106.112926] systemd[1]: Stopped target Remote File Systems.5633worker2 # [ 106.114573] systemd[1]: Stopped target Local File Systems.5634worker2 # setting up /etc...5635worker2 # [ 106.730682] systemd[1]: Reload requested from client PID 1430 ('.switch-to-conf') (unit backdoor.service)...5636worker2 # [ 106.732580] systemd[1]: Reloading...5637worker2 # [ 107.381355] systemd[1]: Reloading finished in 645 ms.5638lb # [ 107.428547] envoy[919]: conn peer=[2001:db8:1::1]:50660 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1635 ms=91475639lb # [ 107.430090] envoy[919]: conn peer=[2001:db8:1::1]:60130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=751 ms=33085640worker2 # restarting sysinit-reactivation.target5641worker2 # [ 107.437357] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5642worker2 # [ 107.575432] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5643worker2 # [ 107.578601] systemd[1]: Reached target Reactivate sysinit units.5644worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5645worker2 # [ 107.583457] systemd[1]: Reloading D-Bus System Message Bus...5646worker2 # [ 107.585500] dbus-broker-launch[531]: Caught SIGHUP, trigger reload.5647worker2 # [ 107.589660] systemd[1]: Reloading Nix worker-protocol over gRPC...5648worker2 # [ 107.615957] dbus-broker-launch[531]: Looking up NSS user entry for 'systemd-timesync'...5649worker2 # [ 107.622076] dbus-broker-launch[531]: NSS returned no entry for 'systemd-timesync'5650worker2 # [ 107.623933] dbus-broker-launch[531]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5651worker2 # [ 107.637286] systemd[1]: Reloaded Nix worker-protocol over gRPC.5652worker2 # [ 107.653711] systemd[1]: Reloaded D-Bus System Message Bus.5653worker2 # [ 107.657107] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5654worker2 # [ 107.659130] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5655worker2 # [ 107.662645] systemd[1]: Reached target Local File Systems.5656worker2 # [ 107.667068] systemd[1]: Reached target Remote File Systems.5657worker2 # [ 107.671902] systemd[1]: Starting linger-users.service...5658worker2 # [ 107.674093] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5659worker2 # [ 107.682350] systemd[1]: Starting Create SUID/SGID Wrappers...5660worker2 # [ 107.683238] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5661worker2 # [ 107.684413] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675662worker2 # [ 107.686543] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5663worker2 # [ 107.687963] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5664worker2 # [ 107.692259] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5665worker2 # [ 107.738652] systemd[1]: linger-users.service: Deactivated successfully.5666worker2 # [ 107.740787] systemd[1]: Finished linger-users.service.5667worker2 # [ 108.119521] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5668worker2 # [ 108.120582] systemd[1]: Finished Create SUID/SGID Wrappers.5669worker2 # [ 108.168731] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:09Z level=info event=draining5670worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5671worker2 # [ 108.377495] nixos[1430]: finished switching to system configuration /nix/store/152vywd94lrrk25hw7y9rvwiabsnrnxx-nixos-system-worker2-test5672worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.98 seconds)5673worker2: must succeed: pgrep -f 'read -t [9]0 x'5674worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5675client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25676worker1 # [ 108.644438] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430765677client # don't know how to build these paths:5678client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5679worker1 # [ 108.657881] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:09Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05680worker1 # [ 108.662916] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:09Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15681worker1 # [ 108.706761] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765682worker1 # [ 108.718973] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430765683client # copying 1 paths to 'lb:50051'...5684worker1 # [ 108.731388] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430765685client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5686worker1 # [ 108.751959] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5687worker1 # [ 108.934890] nix-daemon[844]: accepted connection from pid 1564, user nix-grpc-daemon (trusted)5688worker1 # [ 108.946888] nix-daemon[844]: reaped child process 1567, status = succeeded5689worker1 # [ 109.117050] nix-daemon[844]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5690worker1 # [ 109.128889] nix-daemon[844]: reaped child process 1572, status = succeeded5691lb # [ 109.159975] niks3-server[1039]: 2026/09/19 21:23:09 INFO Received uploads request method=POST path=/api/pending_closures5692worker1 # [ 109.149917] nix-grpc-daemon[1481]: time=2026-09-19T21:23:10.184Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5693worker1 # [ 109.151381] nix-grpc-daemon[1481]: time=2026-09-19T21:23:10.184Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5694lb # [ 109.187691] niks3-server[1039]: 2026/09/19 21:23:09 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5695lb # [ 109.195382] niks3-server[1039]: 2026/09/19 21:23:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5696lb # [ 109.201962] niks3-server[1039]: 2026/09/19 21:23:09 INFO Signed narinfos id=37 count=15697worker1 # [ 109.185312] nix-grpc-daemon[1481]: time=2026-09-19T21:23:10.220Z level=INFO msg="Uploading 1 narinfos"5698lb # [ 109.208568] niks3-server[1039]: 2026/09/19 21:23:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5699lb # [ 109.219375] niks3-server[1039]: 2026/09/19 21:23:09 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5700worker1 # [ 109.206234] nix-grpc-daemon[1481]: time=2026-09-19T21:23:10.241Z level=INFO msg="Upload complete. (442ms)"5701lb # [ 109.226183] niks3-server[1039]: 2026/09/19 21:23:09 INFO Completed upload id=375702worker1 # [ 109.209070] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=5285703worker1 # [ 109.211717] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765704lb # [ 109.231969] niks3-server[1039]: 2026/09/19 21:23:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5705worker1 # [ 109.217542] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5706worker1 # [ 109.221183] nix-daemon[844]: reaped child process 1562, status = succeeded5707worker1 # [ 109.226123] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5708client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5709client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5710client # farm-a> LOG-farm-a-during-drain5711worker1 # [ 110.439403] nix-daemon[844]: reaped child process 1576, status = succeeded5712worker1 # [ 110.575539] nix-daemon[844]: accepted connection from pid 1591, user nix-grpc-daemon (trusted)5713worker1 # [ 110.586900] nix-daemon[844]: reaped child process 1594, status = succeeded5714lb # [ 110.622802] niks3-server[1039]: 2026/09/19 21:23:11 INFO Received uploads request method=POST path=/api/pending_closures5715worker1 # [ 110.612273] nix-grpc-daemon[1481]: time=2026-09-19T21:23:11.645Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5716worker1 # [ 110.613631] nix-grpc-daemon[1481]: time=2026-09-19T21:23:11.645Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5717lb # [ 110.654800] niks3-server[1039]: 2026/09/19 21:23:11 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5718lb # [ 110.671587] niks3-server[1039]: 2026/09/19 21:23:11 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5719lb # [ 110.679845] niks3-server[1039]: 2026/09/19 21:23:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5720worker1 # [ 110.665185] nix-grpc-daemon[1481]: time=2026-09-19T21:23:11.699Z level=INFO msg="Uploading 1 narinfos"5721lb # [ 110.685868] niks3-server[1039]: 2026/09/19 21:23:11 INFO Signed narinfos id=38 count=15722lb # [ 110.690159] niks3-server[1039]: 2026/09/19 21:23:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5723lb # [ 110.699902] niks3-server[1039]: 2026/09/19 21:23:11 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5724lb # [ 110.705408] niks3-server[1039]: 2026/09/19 21:23:11 INFO Completed upload id=385725worker1 # [ 110.685437] nix-grpc-daemon[1481]: time=2026-09-19T21:23:11.720Z level=INFO msg="Upload complete. (252ms)"5726lb # [ 110.706888] niks3-server[1039]: 2026/09/19 21:23:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5727worker1 # [ 110.692939] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=15728worker1 # [ 110.701479] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:11Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05729worker1 # [ 110.704956] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:11Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15730worker1 # [ 110.712203] nix-daemon[844]: reaped child process 1574, status = succeeded5731worker1 # [ 110.751375] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765732worker1 # [ 110.763669] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430765733worker1 # [ 110.775822] nix-grpc-daemon[1481]: time=2026-09-19T21:23:11.810Z level=INFO msg="All 1 paths already cached"5734client # copying 1 paths to 'lb:50051'...5735worker1 # [ 110.783783] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430765736client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5737worker1 # [ 110.803164] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5738worker1 # [ 110.975284] nix-daemon[844]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5739worker1 # [ 110.987343] nix-daemon[844]: reaped child process 1603, status = succeeded5740worker1 # [ 111.142270] nix-daemon[844]: accepted connection from pid 1605, user nix-grpc-daemon (trusted)5741worker1 # [ 111.153696] nix-daemon[844]: reaped child process 1608, status = succeeded5742lb # [ 111.189665] niks3-server[1039]: 2026/09/19 21:23:11 INFO Received uploads request method=POST path=/api/pending_closures5743worker1 # [ 111.173397] nix-grpc-daemon[1481]: time=2026-09-19T21:23:12.208Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5744worker1 # [ 111.174870] nix-grpc-daemon[1481]: time=2026-09-19T21:23:12.209Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5745lb # [ 111.204341] niks3-server[1039]: 2026/09/19 21:23:11 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5746lb # [ 111.208682] niks3-server[1039]: 2026/09/19 21:23:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5747lb # [ 111.210330] niks3-server[1039]: 2026/09/19 21:23:11 INFO Signed narinfos id=39 count=15748worker1 # [ 111.191519] nix-grpc-daemon[1481]: time=2026-09-19T21:23:12.226Z level=INFO msg="Uploading 1 narinfos"5749lb # [ 111.214626] niks3-server[1039]: 2026/09/19 21:23:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5750lb # [ 111.219380] niks3-server[1039]: 2026/09/19 21:23:11 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5751lb # [ 111.221896] niks3-server[1039]: 2026/09/19 21:23:11 INFO Completed upload id=395752worker1 # [ 111.201786] nix-grpc-daemon[1481]: time=2026-09-19T21:23:12.236Z level=INFO msg="Upload complete. (387ms)"5753lb # [ 111.223692] niks3-server[1039]: 2026/09/19 21:23:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5754worker1 # [ 111.203797] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=6405755worker1 # [ 111.207539] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765756worker1 # [ 111.213249] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5757worker1 # [ 111.215401] nix-daemon[844]: reaped child process 1598, status = succeeded5758worker1 # [ 111.220407] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5759client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5760client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5761client # farm-b> LOG-farm-b-during-drain5762worker1 # [ 112.035286] nix-daemon[844]: reaped child process 1612, status = succeeded5763worker1 # [ 112.173192] nix-daemon[844]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5764worker1 # [ 112.184642] nix-daemon[844]: reaped child process 1630, status = succeeded5765lb # [ 112.221886] niks3-server[1039]: 2026/09/19 21:23:12 INFO Received uploads request method=POST path=/api/pending_closures5766worker1 # [ 112.209897] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.244Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5767worker1 # [ 112.211343] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.244Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5768lb # [ 112.252271] niks3-server[1039]: 2026/09/19 21:23:12 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5769lb # [ 112.263157] niks3-server[1039]: 2026/09/19 21:23:12 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5770lb # [ 112.272134] niks3-server[1039]: 2026/09/19 21:23:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5771worker1 # [ 112.256904] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.291Z level=INFO msg="Uploading 1 narinfos"5772lb # [ 112.277064] niks3-server[1039]: 2026/09/19 21:23:12 INFO Signed narinfos id=40 count=15773lb # [ 112.282486] niks3-server[1039]: 2026/09/19 21:23:12 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5774lb # [ 112.290591] niks3-server[1039]: 2026/09/19 21:23:12 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5775lb # [ 112.297511] niks3-server[1039]: 2026/09/19 21:23:12 INFO Completed upload id=405776worker1 # [ 112.277530] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.312Z level=INFO msg="Upload complete. (250ms)"5777lb # [ 112.300106] niks3-server[1039]: 2026/09/19 21:23:12 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5778worker1 # [ 112.284782] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=15779worker1 # [ 112.294508] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05780worker1 # [ 112.298475] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15781worker1 # [ 112.306480] nix-daemon[844]: reaped child process 1610, status = succeeded5782worker1 # [ 112.338682] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765783worker1 # [ 112.350233] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430765784worker1 # [ 112.362580] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.397Z level=INFO msg="All 2 paths already cached"5785client # copying 1 paths to 'lb:50051'...5786client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5787worker1 # [ 112.369278] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430765788worker1 # [ 112.377406] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5789worker1 # [ 112.540263] nix-daemon[844]: accepted connection from pid 1636, user nix-grpc-daemon (trusted)5790worker1 # [ 112.552748] nix-daemon[844]: reaped child process 1639, status = succeeded5791worker1 # [ 112.701813] nix-daemon[844]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)5792worker1 # [ 112.713628] nix-daemon[844]: reaped child process 1644, status = succeeded5793lb # [ 112.747133] niks3-server[1039]: 2026/09/19 21:23:13 INFO Received uploads request method=POST path=/api/pending_closures5794worker1 # [ 112.736499] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.771Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5795worker1 # [ 112.737951] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.772Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5796lb # [ 112.775301] niks3-server[1039]: 2026/09/19 21:23:13 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5797lb # [ 112.787762] niks3-server[1039]: 2026/09/19 21:23:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5798worker1 # [ 112.773333] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.808Z level=INFO msg="Uploading 1 narinfos"5799lb # [ 112.793962] niks3-server[1039]: 2026/09/19 21:23:13 INFO Signed narinfos id=41 count=15800lb # [ 112.800743] niks3-server[1039]: 2026/09/19 21:23:13 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5801lb # [ 112.809082] niks3-server[1039]: 2026/09/19 21:23:13 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5802lb # [ 112.815761] niks3-server[1039]: 2026/09/19 21:23:13 INFO Completed upload id=415803worker1 # [ 112.795546] nix-grpc-daemon[1481]: time=2026-09-19T21:23:13.830Z level=INFO msg="Upload complete. (406ms)"5804worker1 # [ 112.798920] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=7685805lb # [ 112.820732] niks3-server[1039]: 2026/09/19 21:23:13 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5806worker1 # [ 112.805316] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765807worker1 # [ 112.813400] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5808worker1 # [ 112.817430] nix-daemon[844]: reaped child process 1634, status = succeeded5809client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5810client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5811worker1 # [ 112.822364] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5812client # farm-top> LOG-farm-top-during-drain5813worker1 # [ 113.848941] nix-daemon[844]: reaped child process 1648, status = succeeded5814worker1 # [ 113.999927] nix-daemon[844]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)5815worker1 # [ 114.011680] nix-daemon[844]: reaped child process 1666, status = succeeded5816lb # [ 114.048817] niks3-server[1039]: 2026/09/19 21:23:14 INFO Received uploads request method=POST path=/api/pending_closures5817worker1 # [ 114.036838] nix-grpc-daemon[1481]: time=2026-09-19T21:23:15.071Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5818worker1 # [ 114.038304] nix-grpc-daemon[1481]: time=2026-09-19T21:23:15.073Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5819lb # [ 114.086163] niks3-server[1039]: 2026/09/19 21:23:14 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5820lb # [ 114.102984] niks3-server[1039]: 2026/09/19 21:23:14 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5821lb # [ 114.109657] niks3-server[1039]: 2026/09/19 21:23:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5822lb # [ 114.113195] niks3-server[1039]: 2026/09/19 21:23:14 INFO Signed narinfos id=42 count=15823worker1 # [ 114.095474] nix-grpc-daemon[1481]: time=2026-09-19T21:23:15.130Z level=INFO msg="Uploading 1 narinfos"5824lb # [ 114.118593] niks3-server[1039]: 2026/09/19 21:23:14 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5825lb # [ 114.129038] niks3-server[1039]: 2026/09/19 21:23:14 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5826lb # [ 114.132901] niks3-server[1039]: 2026/09/19 21:23:14 INFO Completed upload id=425827lb # [ 114.134789] niks3-server[1039]: 2026/09/19 21:23:14 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo5828worker1 # [ 114.114394] nix-grpc-daemon[1481]: time=2026-09-19T21:23:15.149Z level=INFO msg="Upload complete. (285ms)"5829worker1 # [ 114.123410] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=15830worker1 # [ 114.135139] nix-daemon[844]: reaped child process 1646, status = succeeded5831client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 5.72 seconds)5832client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath5833client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.16 seconds)5834worker2: must succeed: pkill -f 'read -t [9]0 x'5835worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)5836client: waiting for success: ! systemctl is-active sw5837worker2 # [ 114.512516] nix-daemon[804]: reaped child process 1399, status = succeeded5838worker2 # [ 114.641587] nix-daemon[804]: accepted connection from pid 1570, user nix-grpc-daemon (trusted)5839worker2 # [ 114.654612] nix-daemon[804]: reaped child process 1573, status = succeeded5840lb # [ 114.688098] niks3-server[1039]: 2026/09/19 21:23:15 INFO Received uploads request method=POST path=/api/pending_closures5841worker2 # [ 114.674749] nix-grpc-daemon[1151]: time=2026-09-19T21:23:15.554Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5842worker2 # [ 114.676313] nix-grpc-daemon[1151]: time=2026-09-19T21:23:15.555Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"5843lb # [ 114.709802] niks3-server[1039]: 2026/09/19 21:23:15 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5844lb # [ 114.713825] niks3-server[1039]: 2026/09/19 21:23:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5845lb # [ 114.715502] niks3-server[1039]: 2026/09/19 21:23:15 INFO Signed narinfos id=43 count=15846worker2 # [ 114.698979] nix-grpc-daemon[1151]: time=2026-09-19T21:23:15.578Z level=INFO msg="Uploading 1 narinfos"5847lb # [ 114.718496] niks3-server[1039]: 2026/09/19 21:23:15 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5848lb # [ 114.721670] niks3-server[1039]: 2026/09/19 21:23:15 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls5849lb # [ 114.726868] niks3-server[1039]: 2026/09/19 21:23:15 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5850lb # [ 114.729395] niks3-server[1039]: 2026/09/19 21:23:15 INFO Completed upload id=435851worker2 # [ 114.711711] nix-grpc-daemon[1151]: time=2026-09-19T21:23:15.591Z level=INFO msg="Upload complete. (215ms)"5852lb # [ 114.732265] niks3-server[1039]: 2026/09/19 21:23:15 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo5853worker2 # [ 114.715241] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58276 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=15854worker2 # [ 114.721700] nix-daemon[804]: reaped child process 1397, status = succeeded5855client # [ 114.765525] systemd[1]: sw.service: Deactivated successfully.5856client # [ 114.769175] systemd[1]: sw.service: Consumed 104ms CPU time over 11.784s wall clock time, 39.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.5857worker2 # [ 115.172862] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:16Z level=info event=signal_exit5858worker1 # [ 115.176347] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:578925859worker1 # [ 115.180149] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=info event=worker_gone addr=192.168.1.4:50051 system=x86_64-linux5860worker2 # [ 115.186980] nix-grpc-daemon[1130]: ts=2026-09-19T21:23:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5861worker2 # [ 115.214260] nix-daemon[804]: reaped child process 1144, status = succeeded5862worker2 # [ 115.233465] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5863worker2 # [ 115.236437] systemd[1]: nix-grpc-daemon.service: Consumed 1.503s CPU time over 48.247s wall clock time, 32.4M memory peak, 61.1K incoming IP traffic, 96K outgoing IP traffic.5864worker2 # [ 115.250463] systemd[1]: Starting Nix worker-protocol over gRPC...5865worker2 # [ 115.414134] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5866worker2 # [ 115.415886] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:16Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15867worker2 # [ 115.422057] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5868worker2 # [ 115.425625] systemd[1]: Started Nix worker-protocol over gRPC.5869worker2 # [ 115.437548] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:16Z level=info event=scheduler_connected addr=lb:500515870worker1 # [ 115.436819] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=info event=worker_hello addr=192.168.1.4:50051 system=x86_64-linux max_jobs=1 running=05871client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)5872client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5873client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)5874worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5875worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.04 seconds)5876lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5877lb: must succeed: curl -sf localhost:9901/clusters5878lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5879lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5880worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5881worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5882(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.73 seconds)5883subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5884client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15885worker2 # [ 115.873853] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:562725886worker2 # [ 115.885530] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)5887worker1 # [ 115.902823] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=05888worker1 # [ 115.908073] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=15889worker1 # [ 115.912374] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=05890worker1 # [ 115.916207] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=05891worker1 # [ 115.947164] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765892worker1 # [ 115.955495] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430765893worker1 # [ 115.962742] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430765894worker1 # [ 115.966759] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5895worker1 # [ 116.125241] nix-daemon[844]: accepted connection from pid 1677, user nix-grpc-daemon (trusted)5896worker1 # [ 116.136907] nix-daemon[844]: reaped child process 1680, status = succeeded5897worker1 # [ 116.292462] nix-daemon[844]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)5898worker1 # [ 116.304070] nix-daemon[844]: reaped child process 1685, status = succeeded5899lb # [ 116.338949] niks3-server[1039]: 2026/09/19 21:23:16 INFO Received uploads request method=POST path=/api/pending_closures5900worker1 # [ 116.326455] nix-grpc-daemon[1481]: time=2026-09-19T21:23:17.360Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5901worker1 # [ 116.328089] nix-grpc-daemon[1481]: time=2026-09-19T21:23:17.361Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"5902lb # [ 116.365229] niks3-server[1039]: 2026/09/19 21:23:16 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst5903lb # [ 116.373228] niks3-server[1039]: 2026/09/19 21:23:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5904lb # [ 116.379606] niks3-server[1039]: 2026/09/19 21:23:16 INFO Signed narinfos id=44 count=15905worker1 # [ 116.362522] nix-grpc-daemon[1481]: time=2026-09-19T21:23:17.397Z level=INFO msg="Uploading 1 narinfos"5906lb # [ 116.384217] niks3-server[1039]: 2026/09/19 21:23:16 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls5907lb # [ 116.396498] niks3-server[1039]: 2026/09/19 21:23:16 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5908worker1 # [ 116.383962] nix-grpc-daemon[1481]: time=2026-09-19T21:23:17.418Z level=INFO msg="Upload complete. (411ms)"5909lb # [ 116.404091] niks3-server[1039]: 2026/09/19 21:23:16 INFO Completed upload id=445910worker1 # [ 116.386312] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=5045911lb # [ 116.408958] niks3-server[1039]: 2026/09/19 21:23:16 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo5912worker1 # [ 116.390105] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765913worker1 # [ 116.395168] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5914worker1 # [ 116.397971] nix-daemon[844]: reaped child process 1675, status = succeeded5915worker1 # [ 116.403138] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5916worker1 # [ 117.227599] nix-daemon[844]: reaped child process 1689, status = succeeded5917worker1 # [ 117.387415] nix-daemon[844]: accepted connection from pid 1704, user nix-grpc-daemon (trusted)5918worker1 # [ 117.398831] nix-daemon[844]: reaped child process 1707, status = succeeded5919lb # [ 117.429794] envoy[919]: conn peer=[2001:db8:1::1]:37362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9446 tx=3772 ms=54945920lb # [ 117.434341] envoy[919]: conn peer=[2001:db8:1::1]:37352 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1334 ms=115935921lb # [ 117.437758] envoy[919]: conn peer=[2001:db8:1::4]:47120 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5036 tx=1883 ms=480155922lb # [ 117.443727] niks3-server[1039]: 2026/09/19 21:23:17 INFO Received uploads request method=POST path=/api/pending_closures5923worker1 # [ 117.429170] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.463Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5924worker1 # [ 117.431047] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.465Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"5925lb # [ 117.475391] niks3-server[1039]: 2026/09/19 21:23:17 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5926lb # [ 117.487595] niks3-server[1039]: 2026/09/19 21:23:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5927worker1 # [ 117.471669] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.506Z level=INFO msg="Uploading 1 narinfos"5928lb # [ 117.491842] niks3-server[1039]: 2026/09/19 21:23:18 INFO Signed narinfos id=45 count=15929lb # [ 117.498251] niks3-server[1039]: 2026/09/19 21:23:18 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv5930lb # [ 117.506526] niks3-server[1039]: 2026/09/19 21:23:18 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls5931lb # [ 117.509798] niks3-server[1039]: 2026/09/19 21:23:18 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5932lb # [ 117.513275] niks3-server[1039]: 2026/09/19 21:23:18 INFO Completed upload id=455933worker1 # [ 117.493206] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.528Z level=INFO msg="Upload complete. (283ms)"5934lb # [ 117.514886] niks3-server[1039]: 2026/09/19 21:23:18 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo5935worker1 # [ 117.503241] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=15936worker1 # [ 117.508217] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=15937worker1 # [ 117.511639] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765938worker1 # [ 117.514873] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=05939worker1 # [ 117.521138] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430765940worker1 # [ 117.523308] nix-daemon[844]: reaped child process 1687, status = succeeded5941worker1 # [ 117.526592] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430765942worker1 # [ 117.531165] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5943worker1 # [ 117.680582] nix-daemon[844]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)5944worker1 # [ 117.692153] nix-daemon[844]: reaped child process 1716, status = succeeded5945worker1 # [ 117.843659] nix-daemon[844]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)5946worker1 # [ 117.854763] nix-daemon[844]: reaped child process 1721, status = succeeded5947lb # [ 117.890114] niks3-server[1039]: 2026/09/19 21:23:18 INFO Received uploads request method=POST path=/api/pending_closures5948worker1 # [ 117.874502] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.909Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5949worker1 # [ 117.875883] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.909Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"5950lb # [ 117.902432] niks3-server[1039]: 2026/09/19 21:23:18 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst5951lb # [ 117.908100] niks3-server[1039]: 2026/09/19 21:23:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5952lb # [ 117.911021] niks3-server[1039]: 2026/09/19 21:23:18 INFO Signed narinfos id=46 count=15953worker1 # [ 117.891081] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.925Z level=INFO msg="Uploading 1 narinfos"5954lb # [ 117.913243] niks3-server[1039]: 2026/09/19 21:23:18 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls5955lb # [ 117.919096] niks3-server[1039]: 2026/09/19 21:23:18 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5956lb # [ 117.922597] niks3-server[1039]: 2026/09/19 21:23:18 INFO Completed upload id=465957worker1 # [ 117.903847] nix-grpc-daemon[1481]: time=2026-09-19T21:23:18.938Z level=INFO msg="Upload complete. (368ms)"5958lb # [ 117.924572] niks3-server[1039]: 2026/09/19 21:23:18 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo5959worker1 # [ 117.905931] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=5045960worker1 # [ 117.910500] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765961worker1 # [ 117.915639] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5962worker1 # [ 117.917857] nix-daemon[844]: reaped child process 1711, status = succeeded5963worker1 # [ 117.922866] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5964worker1 # [ 119.136924] nix-daemon[844]: reaped child process 1725, status = succeeded5965worker1 # [ 119.266426] nix-daemon[844]: accepted connection from pid 1740, user nix-grpc-daemon (trusted)5966worker1 # [ 119.277921] nix-daemon[844]: reaped child process 1743, status = succeeded5967lb # [ 119.315434] niks3-server[1039]: 2026/09/19 21:23:19 INFO Received uploads request method=POST path=/api/pending_closures5968worker1 # [ 119.302643] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.337Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5969worker1 # [ 119.304171] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.339Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"5970lb # [ 119.352871] niks3-server[1039]: 2026/09/19 21:23:19 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv5971lb # [ 119.364162] niks3-server[1039]: 2026/09/19 21:23:19 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5972lb # [ 119.371728] niks3-server[1039]: 2026/09/19 21:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5973lb # [ 119.376752] niks3-server[1039]: 2026/09/19 21:23:19 INFO Signed narinfos id=47 count=15974worker1 # [ 119.359303] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.394Z level=INFO msg="Uploading 1 narinfos"5975lb # [ 119.381874] niks3-server[1039]: 2026/09/19 21:23:19 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls5976lb # [ 119.390701] niks3-server[1039]: 2026/09/19 21:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5977lb # [ 119.395780] niks3-server[1039]: 2026/09/19 21:23:19 INFO Completed upload id=475978lb # [ 119.398695] niks3-server[1039]: 2026/09/19 21:23:19 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo5979worker1 # [ 119.377590] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.412Z level=INFO msg="Upload complete. (247ms)"5980worker1 # [ 119.385857] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=15981worker1 # [ 119.393209] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=15982worker1 # [ 119.398293] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430765983worker1 # [ 119.401397] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=05984worker1 # [ 119.410666] nix-daemon[844]: reaped child process 1723, status = succeeded5985worker1 # [ 119.412159] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430765986worker1 # [ 119.419206] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430765987worker1 # [ 119.423970] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5988worker1 # [ 119.582892] nix-daemon[844]: accepted connection from pid 1749, user nix-grpc-daemon (trusted)5989worker1 # [ 119.595907] nix-daemon[844]: reaped child process 1752, status = succeeded5990worker1 # [ 119.717165] nix-daemon[844]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)5991worker1 # [ 119.728832] nix-daemon[844]: reaped child process 1757, status = succeeded5992lb # [ 119.758899] niks3-server[1039]: 2026/09/19 21:23:20 INFO Received uploads request method=POST path=/api/pending_closures5993worker1 # [ 119.747473] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.782Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5994worker1 # [ 119.749072] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.784Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"5995lb # [ 119.787784] niks3-server[1039]: 2026/09/19 21:23:20 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst5996lb # [ 119.800351] niks3-server[1039]: 2026/09/19 21:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5997worker1 # [ 119.784692] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.819Z level=INFO msg="Uploading 1 narinfos"5998lb # [ 119.805451] niks3-server[1039]: 2026/09/19 21:23:20 INFO Signed narinfos id=48 count=15999lb # [ 119.811148] niks3-server[1039]: 2026/09/19 21:23:20 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6000lb # [ 119.822708] niks3-server[1039]: 2026/09/19 21:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6001lb # [ 119.829274] niks3-server[1039]: 2026/09/19 21:23:20 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6002lb # [ 119.832850] niks3-server[1039]: 2026/09/19 21:23:20 INFO Completed upload id=486003worker1 # [ 119.812773] nix-grpc-daemon[1481]: time=2026-09-19T21:23:20.847Z level=INFO msg="Upload complete. (384ms)"6004worker1 # [ 119.816214] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=5046005worker1 # [ 119.821268] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766006worker1 # [ 119.831916] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6007worker1 # [ 119.835126] nix-daemon[844]: reaped child process 1747, status = succeeded6008worker1 # [ 119.839903] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6009worker1 # [ 120.665521] nix-daemon[844]: reaped child process 1761, status = succeeded6010worker1 # [ 120.825511] nix-daemon[844]: accepted connection from pid 1776, user nix-grpc-daemon (trusted)6011worker1 # [ 120.837314] nix-daemon[844]: reaped child process 1779, status = succeeded6012lb # [ 120.873082] niks3-server[1039]: 2026/09/19 21:23:21 INFO Received uploads request method=POST path=/api/pending_closures6013worker1 # [ 120.857042] nix-grpc-daemon[1481]: time=2026-09-19T21:23:21.891Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6014worker1 # [ 120.858476] nix-grpc-daemon[1481]: time=2026-09-19T21:23:21.893Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6015lb # [ 120.892731] niks3-server[1039]: 2026/09/19 21:23:21 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6016lb # [ 120.894815] niks3-server[1039]: 2026/09/19 21:23:21 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6017lb # [ 120.897324] niks3-server[1039]: 2026/09/19 21:23:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6018lb # [ 120.899139] niks3-server[1039]: 2026/09/19 21:23:21 INFO Signed narinfos id=49 count=16019worker1 # [ 120.879228] nix-grpc-daemon[1481]: time=2026-09-19T21:23:21.914Z level=INFO msg="Uploading 1 narinfos"6020lb # [ 120.904062] niks3-server[1039]: 2026/09/19 21:23:21 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6021worker1 # [ 120.887090] nix-grpc-daemon[1481]: time=2026-09-19T21:23:21.922Z level=INFO msg="Upload complete. (240ms)"6022lb # [ 120.907782] niks3-server[1039]: 2026/09/19 21:23:21 INFO Completed upload id=496023lb # [ 120.908978] niks3-server[1039]: 2026/09/19 21:23:21 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6024worker1 # [ 120.889814] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16025worker1 # [ 120.893174] nix-grpc-daemon[1481]: time=2026-09-19T21:23:21.924Z level=WARN msg="Failed to register uploaded object" key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo error="server returned 404: object is not pending upload\n"6026worker1 # [ 120.897424] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:21Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16027worker1 # [ 120.899503] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766028worker1 # [ 120.902353] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:21Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06029worker1 # [ 120.906735] nix-daemon[844]: reaped child process 1759, status = succeeded6030worker1 # [ 120.910234] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430766031worker1 # [ 120.915333] nix-grpc-daemon[1481]: time=2026-09-19T21:23:21.950Z level=INFO msg="All 1 paths already cached"6032worker1 # [ 120.919759] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430766033worker1 # [ 120.923678] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6034worker1 # [ 121.079169] nix-daemon[844]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)6035worker1 # [ 121.090843] nix-daemon[844]: reaped child process 1788, status = succeeded6036worker1 # [ 121.224251] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)6037worker1 # [ 121.235790] nix-daemon[844]: reaped child process 1793, status = succeeded6038lb # [ 121.266527] niks3-server[1039]: 2026/09/19 21:23:21 INFO Received uploads request method=POST path=/api/pending_closures6039worker1 # [ 121.250773] nix-grpc-daemon[1481]: time=2026-09-19T21:23:22.285Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6040worker1 # [ 121.252614] nix-grpc-daemon[1481]: time=2026-09-19T21:23:22.287Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6041lb # [ 121.290443] niks3-server[1039]: 2026/09/19 21:23:21 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6042lb # [ 121.300965] niks3-server[1039]: 2026/09/19 21:23:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6043worker1 # [ 121.288320] nix-grpc-daemon[1481]: time=2026-09-19T21:23:22.323Z level=INFO msg="Uploading 1 narinfos"6044lb # [ 121.308266] niks3-server[1039]: 2026/09/19 21:23:21 INFO Signed narinfos id=50 count=16045lb # [ 121.314560] niks3-server[1039]: 2026/09/19 21:23:21 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6046lb # [ 121.326894] niks3-server[1039]: 2026/09/19 21:23:21 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6047lb # [ 121.331375] niks3-server[1039]: 2026/09/19 21:23:21 INFO Completed upload id=506048worker1 # [ 121.313739] nix-grpc-daemon[1481]: time=2026-09-19T21:23:22.348Z level=INFO msg="Upload complete. (384ms)"6049lb # [ 121.334796] niks3-server[1039]: 2026/09/19 21:23:21 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6050worker1 # [ 121.317308] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=6246051worker1 # [ 121.323117] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766052worker1 # [ 121.331260] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6053worker1 # [ 121.335703] nix-daemon[844]: reaped child process 1783, status = succeeded6054worker1 # [ 121.341485] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6055worker1 # [ 122.758310] nix-daemon[844]: reaped child process 1797, status = succeeded6056worker1 # [ 122.901085] nix-daemon[844]: accepted connection from pid 1812, user nix-grpc-daemon (trusted)6057worker1 # [ 122.911755] nix-daemon[844]: reaped child process 1815, status = succeeded6058lb # [ 122.943553] niks3-server[1039]: 2026/09/19 21:23:23 INFO Received uploads request method=POST path=/api/pending_closures6059worker1 # [ 122.931165] nix-grpc-daemon[1481]: time=2026-09-19T21:23:23.965Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6060worker1 # [ 122.932778] nix-grpc-daemon[1481]: time=2026-09-19T21:23:23.967Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6061lb # [ 122.978768] niks3-server[1039]: 2026/09/19 21:23:23 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6062lb # [ 122.992743] niks3-server[1039]: 2026/09/19 21:23:23 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6063lb # [ 123.001247] niks3-server[1039]: 2026/09/19 21:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6064lb # [ 123.007419] niks3-server[1039]: 2026/09/19 21:23:23 INFO Signed narinfos id=51 count=16065worker1 # [ 122.990140] nix-grpc-daemon[1481]: time=2026-09-19T21:23:24.024Z level=INFO msg="Uploading 1 narinfos"6066lb # [ 123.010206] niks3-server[1039]: 2026/09/19 21:23:23 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6067lb # [ 123.019990] niks3-server[1039]: 2026/09/19 21:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6068lb # [ 123.026108] niks3-server[1039]: 2026/09/19 21:23:23 INFO Completed upload id=516069worker1 # [ 123.006118] nix-grpc-daemon[1481]: time=2026-09-19T21:23:24.040Z level=INFO msg="Upload complete. (254ms)"6070lb # [ 123.028669] niks3-server[1039]: 2026/09/19 21:23:23 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6071worker1 # [ 123.015376] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16072worker1 # [ 123.021470] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16073worker1 # [ 123.024878] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766074worker1 # [ 123.028305] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06075worker1 # [ 123.037285] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430766076worker1 # [ 123.039255] nix-daemon[844]: reaped child process 1795, status = succeeded6077worker1 # [ 123.044444] nix-grpc-daemon[1481]: time=2026-09-19T21:23:24.079Z level=INFO msg="All 1 paths already cached"6078worker1 # [ 123.047942] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430766079worker1 # [ 123.052631] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6080worker1 # [ 123.187249] nix-daemon[844]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6081worker1 # [ 123.199961] nix-daemon[844]: reaped child process 1824, status = succeeded6082worker1 # [ 123.321840] nix-daemon[844]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)6083worker1 # [ 123.333547] nix-daemon[844]: reaped child process 1829, status = succeeded6084lb # [ 123.363325] niks3-server[1039]: 2026/09/19 21:23:23 INFO Received uploads request method=POST path=/api/pending_closures6085worker1 # [ 123.351630] nix-grpc-daemon[1481]: time=2026-09-19T21:23:24.386Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6086worker1 # [ 123.353038] nix-grpc-daemon[1481]: time=2026-09-19T21:23:24.386Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6087lb # [ 123.388930] niks3-server[1039]: 2026/09/19 21:23:23 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6088lb # [ 123.398532] niks3-server[1039]: 2026/09/19 21:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6089lb # [ 123.403823] niks3-server[1039]: 2026/09/19 21:23:23 INFO Signed narinfos id=52 count=16090worker1 # [ 123.386625] nix-grpc-daemon[1481]: time=2026-09-19T21:23:24.421Z level=INFO msg="Uploading 1 narinfos"6091lb # [ 123.410652] niks3-server[1039]: 2026/09/19 21:23:23 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6092lb # [ 123.421861] niks3-server[1039]: 2026/09/19 21:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6093worker1 # [ 123.406254] nix-grpc-daemon[1481]: time=2026-09-19T21:23:24.441Z level=INFO msg="Upload complete. (349ms)"6094lb # [ 123.426563] niks3-server[1039]: 2026/09/19 21:23:23 INFO Completed upload id=526095worker1 # [ 123.408221] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=6246096lb # [ 123.429583] niks3-server[1039]: 2026/09/19 21:23:23 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6097worker1 # [ 123.413170] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766098worker1 # [ 123.419124] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6099worker1 # [ 123.420893] nix-daemon[844]: reaped child process 1819, status = succeeded6100worker1 # [ 123.425990] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6101worker1 # [ 124.852696] nix-daemon[844]: reaped child process 1833, status = succeeded6102worker1 # [ 124.995554] nix-daemon[844]: accepted connection from pid 1848, user nix-grpc-daemon (trusted)6103worker1 # [ 125.006908] nix-daemon[844]: reaped child process 1851, status = succeeded6104lb # [ 125.042981] niks3-server[1039]: 2026/09/19 21:23:25 INFO Received uploads request method=POST path=/api/pending_closures6105worker1 # [ 125.028273] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.061Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6106worker1 # [ 125.030245] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.061Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6107lb # [ 125.060060] niks3-server[1039]: 2026/09/19 21:23:25 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6108lb # [ 125.064361] niks3-server[1039]: 2026/09/19 21:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6109lb # [ 125.066410] niks3-server[1039]: 2026/09/19 21:23:25 INFO Signed narinfos id=53 count=16110worker1 # [ 125.046366] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.081Z level=INFO msg="Uploading 1 narinfos"6111lb # [ 125.069899] niks3-server[1039]: 2026/09/19 21:23:25 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6112lb # [ 125.074906] niks3-server[1039]: 2026/09/19 21:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6113lb # [ 125.077234] niks3-server[1039]: 2026/09/19 21:23:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6114lb # [ 125.079715] niks3-server[1039]: 2026/09/19 21:23:25 INFO Completed upload id=536115worker1 # [ 125.059646] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.094Z level=INFO msg="Upload complete. (225ms)"6116lb # [ 125.082573] niks3-server[1039]: 2026/09/19 21:23:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6117worker1 # [ 125.063225] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16118worker1 # [ 125.065879] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16119worker1 # [ 125.068909] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766120worker1 # [ 125.072503] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06121worker1 # [ 125.078133] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430766122worker1 # [ 125.080265] nix-daemon[844]: reaped child process 1831, status = succeeded6123worker1 # [ 125.083579] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.118Z level=INFO msg="All 1 paths already cached"6124worker1 # [ 125.087277] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430766125worker1 # [ 125.091068] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6126worker1 # [ 125.243123] nix-daemon[844]: accepted connection from pid 1857, user nix-grpc-daemon (trusted)6127worker1 # [ 125.254632] nix-daemon[844]: reaped child process 1860, status = succeeded6128worker1 # [ 125.405449] nix-daemon[844]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)6129worker1 # [ 125.416700] nix-daemon[844]: reaped child process 1865, status = succeeded6130lb # [ 125.448818] niks3-server[1039]: 2026/09/19 21:23:25 INFO Received uploads request method=POST path=/api/pending_closures6131worker1 # [ 125.432528] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.467Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6132worker1 # [ 125.434052] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.469Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6133lb # [ 125.464265] niks3-server[1039]: 2026/09/19 21:23:25 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6134lb # [ 125.467349] niks3-server[1039]: 2026/09/19 21:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6135lb # [ 125.469348] niks3-server[1039]: 2026/09/19 21:23:25 INFO Signed narinfos id=54 count=16136worker1 # [ 125.450360] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.485Z level=INFO msg="Uploading 1 narinfos"6137lb # [ 125.472749] niks3-server[1039]: 2026/09/19 21:23:25 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6138lb # [ 125.478302] niks3-server[1039]: 2026/09/19 21:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6139lb # [ 125.480782] niks3-server[1039]: 2026/09/19 21:23:25 INFO Completed upload id=546140worker1 # [ 125.460519] nix-grpc-daemon[1481]: time=2026-09-19T21:23:26.495Z level=INFO msg="Upload complete. (364ms)"6141lb # [ 125.482338] niks3-server[1039]: 2026/09/19 21:23:25 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6142worker1 # [ 125.461907] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=6246143worker1 # [ 125.466777] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766144worker1 # [ 125.471774] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6145worker1 # [ 125.473943] nix-daemon[844]: reaped child process 1855, status = succeeded6146worker1 # [ 125.479066] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6147worker1 # [ 126.692674] nix-daemon[844]: reaped child process 1869, status = succeeded6148worker1 # [ 126.839556] nix-daemon[844]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6149worker1 # [ 126.851420] nix-daemon[844]: reaped child process 1887, status = succeeded6150lb # [ 126.888825] niks3-server[1039]: 2026/09/19 21:23:27 INFO Received uploads request method=POST path=/api/pending_closures6151worker1 # [ 126.876554] nix-grpc-daemon[1481]: time=2026-09-19T21:23:27.911Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6152worker1 # [ 126.878294] nix-grpc-daemon[1481]: time=2026-09-19T21:23:27.913Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6153lb # [ 126.926060] niks3-server[1039]: 2026/09/19 21:23:27 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6154lb # [ 126.936692] niks3-server[1039]: 2026/09/19 21:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6155worker1 # [ 126.924241] nix-grpc-daemon[1481]: time=2026-09-19T21:23:27.959Z level=INFO msg="Uploading 1 narinfos"6156lb # [ 126.944435] niks3-server[1039]: 2026/09/19 21:23:27 INFO Signed narinfos id=55 count=16157lb # [ 126.950743] niks3-server[1039]: 2026/09/19 21:23:27 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6158lb # [ 126.960368] niks3-server[1039]: 2026/09/19 21:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6159lb # [ 126.964400] niks3-server[1039]: 2026/09/19 21:23:27 INFO Completed upload id=556160worker1 # [ 126.946664] nix-grpc-daemon[1481]: time=2026-09-19T21:23:27.981Z level=INFO msg="Upload complete. (260ms)"6161lb # [ 126.970192] niks3-server[1039]: 2026/09/19 21:23:27 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6162lb # [ 126.972661] niks3-server[1039]: 2026/09/19 21:23:27 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6163worker1 # [ 126.952942] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16164worker1 # [ 126.961933] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:27Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16165worker1 # [ 126.967765] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766166worker1 # [ 126.970604] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:28Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06167worker1 # [ 126.976594] nix-daemon[844]: reaped child process 1867, status = succeeded6168worker1 # [ 127.001683] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430766169worker1 # [ 127.011388] nix-grpc-daemon[1481]: time=2026-09-19T21:23:28.046Z level=INFO msg="All 2 paths already cached"6170worker1 # [ 127.017841] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430766171worker1 # [ 127.026834] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6172worker1 # [ 127.184787] nix-daemon[844]: accepted connection from pid 1893, user nix-grpc-daemon (trusted)6173worker1 # [ 127.196484] nix-daemon[844]: reaped child process 1896, status = succeeded6174worker1 # [ 127.347716] nix-daemon[844]: accepted connection from pid 1898, user nix-grpc-daemon (trusted)6175worker1 # [ 127.359347] nix-daemon[844]: reaped child process 1901, status = succeeded6176lb # [ 127.394828] niks3-server[1039]: 2026/09/19 21:23:27 INFO Received uploads request method=POST path=/api/pending_closures6177worker1 # [ 127.382092] nix-grpc-daemon[1481]: time=2026-09-19T21:23:28.417Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6178worker1 # [ 127.383673] nix-grpc-daemon[1481]: time=2026-09-19T21:23:28.418Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6179lb # [ 127.425928] niks3-server[1039]: 2026/09/19 21:23:27 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6180lb # [ 127.433249] niks3-server[1039]: 2026/09/19 21:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6181lb # [ 127.439113] niks3-server[1039]: 2026/09/19 21:23:27 INFO Signed narinfos id=56 count=16182worker1 # [ 127.422591] nix-grpc-daemon[1481]: time=2026-09-19T21:23:28.457Z level=INFO msg="Uploading 1 narinfos"6183lb # [ 127.444751] niks3-server[1039]: 2026/09/19 21:23:27 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6184lb # [ 127.455817] niks3-server[1039]: 2026/09/19 21:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6185lb # [ 127.460366] niks3-server[1039]: 2026/09/19 21:23:27 INFO Completed upload id=566186worker1 # [ 127.442813] nix-grpc-daemon[1481]: time=2026-09-19T21:23:28.477Z level=INFO msg="Upload complete. (409ms)"6187lb # [ 127.465606] niks3-server[1039]: 2026/09/19 21:23:27 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6188worker1 # [ 127.445140] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=7526189worker1 # [ 127.450266] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766190worker1 # [ 127.460059] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6191worker1 # [ 127.464427] nix-daemon[844]: reaped child process 1891, status = succeeded6192worker1 # [ 127.469912] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6193worker1 # [ 128.282788] nix-daemon[844]: reaped child process 1905, status = succeeded6194worker1 # [ 128.402926] nix-daemon[844]: accepted connection from pid 1920, user nix-grpc-daemon (trusted)6195worker1 # [ 128.413376] nix-daemon[844]: reaped child process 1923, status = succeeded6196lb # [ 128.444044] niks3-server[1039]: 2026/09/19 21:23:28 INFO Received uploads request method=POST path=/api/pending_closures6197worker1 # [ 128.429032] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.463Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6198worker1 # [ 128.430508] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.465Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6199lb # [ 128.467335] niks3-server[1039]: 2026/09/19 21:23:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6200worker1 # [ 128.454290] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.489Z level=INFO msg="Uploading 1 narinfos"6201lb # [ 128.474216] niks3-server[1039]: 2026/09/19 21:23:28 INFO Signed narinfos id=57 count=16202lb # [ 128.477833] niks3-server[1039]: 2026/09/19 21:23:28 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6203lb # [ 128.483053] niks3-server[1039]: 2026/09/19 21:23:28 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6204lb # [ 128.487408] niks3-server[1039]: 2026/09/19 21:23:29 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6205lb # [ 128.495427] niks3-server[1039]: 2026/09/19 21:23:29 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6206lb # [ 128.498871] niks3-server[1039]: 2026/09/19 21:23:29 INFO Completed upload id=576207worker1 # [ 128.478701] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.513Z level=INFO msg="Upload complete. (200ms)"6208lb # [ 128.500495] niks3-server[1039]: 2026/09/19 21:23:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6209worker1 # [ 128.481058] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16210worker1 # [ 128.485061] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:29Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16211worker1 # [ 128.487211] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766212worker1 # [ 128.493556] nix-daemon[844]: reaped child process 1903, status = succeeded6213worker1 # [ 128.530901] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430766214worker1 # [ 128.540732] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.575Z level=INFO msg="All 2 paths already cached"6215worker1 # [ 128.545343] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430766216worker1 # [ 128.548989] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6217worker1 # [ 128.680502] nix-daemon[844]: accepted connection from pid 1927, user nix-grpc-daemon (trusted)6218worker1 # [ 128.692656] nix-daemon[844]: reaped child process 1930, status = succeeded6219worker1 # [ 128.844863] nix-daemon[844]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)6220worker1 # [ 128.856218] nix-daemon[844]: reaped child process 1935, status = succeeded6221lb # [ 128.892385] niks3-server[1039]: 2026/09/19 21:23:29 INFO Received uploads request method=POST path=/api/pending_closures6222worker1 # [ 128.879857] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.914Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6223worker1 # [ 128.881195] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.914Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6224lb # [ 128.915648] niks3-server[1039]: 2026/09/19 21:23:29 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6225lb # [ 128.927248] niks3-server[1039]: 2026/09/19 21:23:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6226lb # [ 128.932116] niks3-server[1039]: 2026/09/19 21:23:29 INFO Signed narinfos id=58 count=16227worker1 # [ 128.914991] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.949Z level=INFO msg="Uploading 1 narinfos"6228lb # [ 128.939840] niks3-server[1039]: 2026/09/19 21:23:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6229lb # [ 128.948950] niks3-server[1039]: 2026/09/19 21:23:29 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6230worker1 # [ 128.934757] nix-grpc-daemon[1481]: time=2026-09-19T21:23:29.969Z level=INFO msg="Upload complete. (379ms)"6231lb # [ 128.955058] niks3-server[1039]: 2026/09/19 21:23:29 INFO Completed upload id=586232lb # [ 128.958459] niks3-server[1039]: 2026/09/19 21:23:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6233worker1 # [ 128.938381] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=7526234worker1 # [ 128.942803] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766235worker1 # [ 128.949460] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6236worker1 # [ 128.953545] nix-daemon[844]: reaped child process 1925, status = succeeded6237worker1 # [ 128.958526] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6238worker1 # [ 129.771284] nix-daemon[844]: reaped child process 1939, status = succeeded6239worker1 # [ 129.894909] nix-daemon[844]: accepted connection from pid 1954, user nix-grpc-daemon (trusted)6240worker1 # [ 129.906341] nix-daemon[844]: reaped child process 1957, status = succeeded6241lb # [ 129.941379] niks3-server[1039]: 2026/09/19 21:23:30 INFO Received uploads request method=POST path=/api/pending_closures6242worker1 # [ 129.929299] nix-grpc-daemon[1481]: time=2026-09-19T21:23:30.964Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6243worker1 # [ 129.930814] nix-grpc-daemon[1481]: time=2026-09-19T21:23:30.965Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6244lb # [ 129.978483] niks3-server[1039]: 2026/09/19 21:23:30 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6245lb # [ 129.987359] niks3-server[1039]: 2026/09/19 21:23:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6246lb # [ 129.992386] niks3-server[1039]: 2026/09/19 21:23:30 INFO Signed narinfos id=59 count=16247worker1 # [ 129.974861] nix-grpc-daemon[1481]: time=2026-09-19T21:23:31.009Z level=INFO msg="Uploading 1 narinfos"6248lb # [ 129.999689] niks3-server[1039]: 2026/09/19 21:23:30 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6249lb # [ 130.007485] niks3-server[1039]: 2026/09/19 21:23:30 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6250lb # [ 130.016511] niks3-server[1039]: 2026/09/19 21:23:30 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6251lb # [ 130.022771] niks3-server[1039]: 2026/09/19 21:23:30 INFO Completed upload id=596252lb # [ 130.024907] niks3-server[1039]: 2026/09/19 21:23:30 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6253worker1 # [ 130.004254] nix-grpc-daemon[1481]: time=2026-09-19T21:23:31.039Z level=INFO msg="Upload complete. (240ms)"6254worker1 # [ 130.011160] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16255worker1 # [ 130.015586] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:31Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16256worker1 # [ 130.024515] nix-daemon[844]: reaped child process 1937, status = succeeded6257worker1 # [ 130.053079] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766258worker1 # [ 130.065306] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430766259worker1 # [ 130.077325] nix-grpc-daemon[1481]: time=2026-09-19T21:23:31.112Z level=INFO msg="All 2 paths already cached"6260worker1 # [ 130.084074] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430766261worker1 # [ 130.094127] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6262worker1 # [ 130.242774] nix-daemon[844]: accepted connection from pid 1961, user nix-grpc-daemon (trusted)6263worker1 # [ 130.254839] nix-daemon[844]: reaped child process 1964, status = succeeded6264worker1 # [ 130.402425] nix-daemon[844]: accepted connection from pid 1966, user nix-grpc-daemon (trusted)6265worker1 # [ 130.414269] nix-daemon[844]: reaped child process 1969, status = succeeded6266lb # [ 130.447757] niks3-server[1039]: 2026/09/19 21:23:30 INFO Received uploads request method=POST path=/api/pending_closures6267worker1 # [ 130.436258] nix-grpc-daemon[1481]: time=2026-09-19T21:23:31.471Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6268worker1 # [ 130.437771] nix-grpc-daemon[1481]: time=2026-09-19T21:23:31.472Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6269lb # [ 130.478114] niks3-server[1039]: 2026/09/19 21:23:30 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6270lb # [ 130.490777] niks3-server[1039]: 2026/09/19 21:23:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6271lb # [ 130.496566] niks3-server[1039]: 2026/09/19 21:23:31 INFO Signed narinfos id=60 count=16272worker1 # [ 130.479476] nix-grpc-daemon[1481]: time=2026-09-19T21:23:31.514Z level=INFO msg="Uploading 1 narinfos"6273lb # [ 130.504080] niks3-server[1039]: 2026/09/19 21:23:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6274lb # [ 130.514334] niks3-server[1039]: 2026/09/19 21:23:31 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6275worker1 # [ 130.500188] nix-grpc-daemon[1481]: time=2026-09-19T21:23:31.535Z level=INFO msg="Upload complete. (396ms)"6276lb # [ 130.520571] niks3-server[1039]: 2026/09/19 21:23:31 INFO Completed upload id=606277lb # [ 130.524248] niks3-server[1039]: 2026/09/19 21:23:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6278worker1 # [ 130.503340] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=0 paths=1 nar_bytes_in=7526279worker1 # [ 130.508352] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430766280worker1 # [ 130.515866] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6281worker1 # [ 130.525993] nix-daemon[844]: reaped child process 1959, status = succeeded6282worker1 # [ 130.529067] nix-daemon[844]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)6283worker1 # [ 131.353802] nix-daemon[844]: reaped child process 1973, status = succeeded6284worker1 # [ 131.512499] nix-daemon[844]: accepted connection from pid 1988, user nix-grpc-daemon (trusted)6285worker1 # [ 131.522970] nix-daemon[844]: reaped child process 1991, status = succeeded6286lb # [ 131.559971] niks3-server[1039]: 2026/09/19 21:23:32 INFO Received uploads request method=POST path=/api/pending_closures6287worker1 # [ 131.548500] nix-grpc-daemon[1481]: time=2026-09-19T21:23:32.583Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6288worker1 # [ 131.549935] nix-grpc-daemon[1481]: time=2026-09-19T21:23:32.584Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6289lb # [ 131.597209] niks3-server[1039]: 2026/09/19 21:23:32 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6290lb # [ 131.605375] niks3-server[1039]: 2026/09/19 21:23:32 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6291lb # [ 131.616914] niks3-server[1039]: 2026/09/19 21:23:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6292worker1 # [ 131.601114] nix-grpc-daemon[1481]: time=2026-09-19T21:23:32.635Z level=INFO msg="Uploading 1 narinfos"6293lb # [ 131.621240] niks3-server[1039]: 2026/09/19 21:23:32 INFO Signed narinfos id=61 count=16294lb # [ 131.627327] niks3-server[1039]: 2026/09/19 21:23:32 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6295lb # [ 131.636040] niks3-server[1039]: 2026/09/19 21:23:32 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6296lb # [ 131.639892] niks3-server[1039]: 2026/09/19 21:23:32 INFO Completed upload id=616297worker1 # [ 131.619915] nix-grpc-daemon[1481]: time=2026-09-19T21:23:32.654Z level=INFO msg="Upload complete. (283ms)"6298lb # [ 131.642035] niks3-server[1039]: 2026/09/19 21:23:32 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6299worker1 # [ 131.625801] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43076 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16300worker1 # [ 131.638302] nix-daemon[844]: reaped child process 1971, status = succeeded6301client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.06 seconds)6302worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6303worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6304client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16305worker1 # [ 131.976455] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430766306worker1 # [ 131.986649] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:33Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06307client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.22 seconds)6308(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 16.35 seconds)6309subtest: low disk drains a worker and builds go to the other6310worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6311worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.97 seconds)6312worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6313worker1 # [ 133.149164] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:34Z level=info event=unhealthy reason=min_free6314worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)6315client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26316worker2 # [ 134.233996] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:562726317client # don't know how to build these paths:6318client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6319worker1 # [ 134.241072] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:35Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06320worker1 # [ 134.242883] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:35Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16321worker2 # [ 134.286819] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:562726322worker2 # [ 134.297412] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 1/5)6323worker2 # [ 134.388677] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 2/5)6324worker2 # [ 134.560959] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 330 ms (attempt 3/5)6325worker2 # [ 134.897274] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 319 ms (attempt 4/5)6326worker2 # [ 135.223533] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6327worker2 # [ 135.243313] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:562726328client # copying 1 paths to 'lb:50051'...6329worker2 # [ 135.255898] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:562726330client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6331worker2 # [ 135.270865] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6332worker2 # [ 135.289930] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:36Z level=info event=niks3_push_started pid=16066333worker2 # [ 135.663720] nix-daemon[804]: accepted connection from pid 1619, user nix-grpc-daemon (trusted)6334worker2 # [ 135.677749] nix-daemon[804]: reaped child process 1622, status = succeeded6335worker2 # [ 135.836299] nix-daemon[804]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)6336worker2 # [ 135.849256] nix-daemon[804]: reaped child process 1627, status = succeeded6337lb # [ 135.881837] niks3-server[1039]: 2026/09/19 21:23:36 INFO Received uploads request method=POST path=/api/pending_closures6338worker2 # [ 135.873786] nix-grpc-daemon[1606]: time=2026-09-19T21:23:36.753Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6339worker2 # [ 135.876940] nix-grpc-daemon[1606]: time=2026-09-19T21:23:36.755Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6340lb # [ 135.919354] niks3-server[1039]: 2026/09/19 21:23:36 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6341lb # [ 135.931633] niks3-server[1039]: 2026/09/19 21:23:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6342lb # [ 135.937866] niks3-server[1039]: 2026/09/19 21:23:36 INFO Signed narinfos id=62 count=16343worker2 # [ 135.923606] nix-grpc-daemon[1606]: time=2026-09-19T21:23:36.803Z level=INFO msg="Uploading 1 narinfos"6344lb # [ 135.946656] niks3-server[1039]: 2026/09/19 21:23:36 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6345lb # [ 135.952347] niks3-server[1039]: 2026/09/19 21:23:36 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6346lb # [ 135.955253] niks3-server[1039]: 2026/09/19 21:23:36 INFO Completed upload id=626347worker2 # [ 135.937705] nix-grpc-daemon[1606]: time=2026-09-19T21:23:36.817Z level=INFO msg="Upload complete. (443ms)"6348lb # [ 135.957239] niks3-server[1039]: 2026/09/19 21:23:36 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6349worker2 # [ 135.941089] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56272 duration_s=0 paths=1 nar_bytes_in=5126350worker2 # [ 135.946288] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:562726351worker2 # [ 135.953137] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6352worker2 # [ 135.958988] nix-daemon[804]: reaped child process 1604, status = succeeded6353client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6354client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6355worker2 # [ 135.964788] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6356worker2 # [ 137.177933] nix-daemon[804]: reaped child process 1631, status = succeeded6357client # farm-a> LOG-farm-a-drain6358worker2 # [ 137.335517] nix-daemon[804]: accepted connection from pid 1646, user nix-grpc-daemon (trusted)6359worker2 # [ 137.346831] nix-daemon[804]: reaped child process 1649, status = succeeded6360lb # [ 137.378982] niks3-server[1039]: 2026/09/19 21:23:37 INFO Received uploads request method=POST path=/api/pending_closures6361worker2 # [ 137.368823] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.248Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6362worker2 # [ 137.370326] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.250Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6363lb # [ 137.417469] niks3-server[1039]: 2026/09/19 21:23:37 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6364lb # [ 137.426176] niks3-server[1039]: 2026/09/19 21:23:37 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6365lb # [ 137.431575] envoy[919]: conn peer=[2001:db8:1::1]:58272 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26808 tx=10562 ms=158126366lb # [ 137.436371] envoy[919]: conn peer=[2001:db8:1::1]:45442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=708 tx=438 ms=266367lb # [ 137.444297] niks3-server[1039]: 2026/09/19 21:23:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6368lb # [ 137.449472] niks3-server[1039]: 2026/09/19 21:23:37 INFO Signed narinfos id=63 count=16369worker2 # [ 137.432817] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.311Z level=INFO msg="Uploading 1 narinfos"6370lb # [ 137.453374] niks3-server[1039]: 2026/09/19 21:23:37 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6371lb # [ 137.462252] niks3-server[1039]: 2026/09/19 21:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6372lb # [ 137.464876] niks3-server[1039]: 2026/09/19 21:23:37 INFO Completed upload id=636373worker2 # [ 137.447270] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.327Z level=INFO msg="Upload complete. (276ms)"6374lb # [ 137.467534] niks3-server[1039]: 2026/09/19 21:23:37 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6375worker2 # [ 137.449791] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56272 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16376worker2 # [ 137.456753] nix-daemon[804]: reaped child process 1629, status = succeeded6377worker1 # [ 137.456766] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:38Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06378worker1 # [ 137.460913] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:38Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16379worker2 # [ 137.502126] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:562726380worker2 # [ 137.510222] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:562726381worker2 # [ 137.517443] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.397Z level=INFO msg="All 1 paths already cached"6382client # copying 1 paths to 'lb:50051'...6383worker2 # [ 137.522141] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:562726384client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6385worker2 # [ 137.529570] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6386worker2 # [ 137.692489] nix-daemon[804]: accepted connection from pid 1653, user nix-grpc-daemon (trusted)6387worker2 # [ 137.706076] nix-daemon[804]: reaped child process 1656, status = succeeded6388worker2 # [ 137.856159] nix-daemon[804]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)6389worker2 # [ 137.869238] nix-daemon[804]: reaped child process 1661, status = succeeded6390lb # [ 137.897793] niks3-server[1039]: 2026/09/19 21:23:38 INFO Received uploads request method=POST path=/api/pending_closures6391worker2 # [ 137.885947] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.765Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6392worker2 # [ 137.887309] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.765Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6393lb # [ 137.919408] niks3-server[1039]: 2026/09/19 21:23:38 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6394lb # [ 137.930659] niks3-server[1039]: 2026/09/19 21:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6395lb # [ 137.937105] niks3-server[1039]: 2026/09/19 21:23:38 INFO Signed narinfos id=64 count=16396worker2 # [ 137.922506] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.802Z level=INFO msg="Uploading 1 narinfos"6397lb # [ 137.941843] niks3-server[1039]: 2026/09/19 21:23:38 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6398lb # [ 137.953161] niks3-server[1039]: 2026/09/19 21:23:38 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6399worker2 # [ 137.940247] nix-grpc-daemon[1606]: time=2026-09-19T21:23:38.820Z level=INFO msg="Upload complete. (403ms)"6400lb # [ 137.958043] niks3-server[1039]: 2026/09/19 21:23:38 INFO Completed upload id=646401worker2 # [ 137.942354] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56272 duration_s=0 paths=1 nar_bytes_in=6246402worker2 # [ 137.944852] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:562726403lb # [ 137.963239] niks3-server[1039]: 2026/09/19 21:23:38 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6404worker2 # [ 137.950148] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6405worker2 # [ 137.955237] nix-daemon[804]: reaped child process 1651, status = succeeded6406client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6407client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6408worker2 # [ 137.961197] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6409client # farm-b> LOG-farm-b-drain6410worker2 # [ 139.386461] nix-daemon[804]: reaped child process 1665, status = succeeded6411worker2 # [ 139.538526] nix-daemon[804]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6412worker2 # [ 139.551705] nix-daemon[804]: reaped child process 1683, status = succeeded6413lb # [ 139.582694] niks3-server[1039]: 2026/09/19 21:23:40 INFO Received uploads request method=POST path=/api/pending_closures6414worker2 # [ 139.573273] nix-grpc-daemon[1606]: time=2026-09-19T21:23:40.452Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6415worker2 # [ 139.574730] nix-grpc-daemon[1606]: time=2026-09-19T21:23:40.454Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6416lb # [ 139.615694] niks3-server[1039]: 2026/09/19 21:23:40 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6417lb # [ 139.629646] niks3-server[1039]: 2026/09/19 21:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6418lb # [ 139.634785] niks3-server[1039]: 2026/09/19 21:23:40 INFO Signed narinfos id=65 count=16419worker2 # [ 139.620333] nix-grpc-daemon[1606]: time=2026-09-19T21:23:40.499Z level=INFO msg="Uploading 1 narinfos"6420lb # [ 139.644040] niks3-server[1039]: 2026/09/19 21:23:40 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6421lb # [ 139.653955] niks3-server[1039]: 2026/09/19 21:23:40 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6422lb # [ 139.657818] niks3-server[1039]: 2026/09/19 21:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6423lb # [ 139.662756] niks3-server[1039]: 2026/09/19 21:23:40 INFO Completed upload id=656424worker2 # [ 139.645569] nix-grpc-daemon[1606]: time=2026-09-19T21:23:40.525Z level=INFO msg="Upload complete. (276ms)"6425lb # [ 139.664959] niks3-server[1039]: 2026/09/19 21:23:40 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6426worker2 # [ 139.650686] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56272 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16427worker1 # [ 139.654406] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:40Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06428worker2 # [ 139.663803] nix-daemon[804]: reaped child process 1663, status = succeeded6429worker1 # [ 139.659252] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:40Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16430worker2 # [ 139.702252] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:562726431worker2 # [ 139.714850] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:562726432worker2 # [ 139.727364] nix-grpc-daemon[1606]: time=2026-09-19T21:23:40.607Z level=INFO msg="All 2 paths already cached"6433client # copying 1 paths to 'lb:50051'...6434client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6435worker2 # [ 139.735703] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:562726436worker2 # [ 139.746160] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6437worker2 # [ 139.920324] nix-daemon[804]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6438worker2 # [ 139.933756] nix-daemon[804]: reaped child process 1690, status = succeeded6439worker2 # [ 140.097550] nix-daemon[804]: accepted connection from pid 1692, user nix-grpc-daemon (trusted)6440worker2 # [ 140.110244] nix-daemon[804]: reaped child process 1695, status = succeeded6441lb # [ 140.145365] niks3-server[1039]: 2026/09/19 21:23:40 INFO Received uploads request method=POST path=/api/pending_closures6442worker2 # [ 140.136701] nix-grpc-daemon[1606]: time=2026-09-19T21:23:41.016Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6443worker2 # [ 140.138093] nix-grpc-daemon[1606]: time=2026-09-19T21:23:41.016Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6444lb # [ 140.171609] niks3-server[1039]: 2026/09/19 21:23:40 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6445lb # [ 140.181426] niks3-server[1039]: 2026/09/19 21:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6446lb # [ 140.185525] niks3-server[1039]: 2026/09/19 21:23:40 INFO Signed narinfos id=66 count=16447worker2 # [ 140.171025] nix-grpc-daemon[1606]: time=2026-09-19T21:23:41.050Z level=INFO msg="Uploading 1 narinfos"6448lb # [ 140.191679] niks3-server[1039]: 2026/09/19 21:23:40 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6449lb # [ 140.202518] niks3-server[1039]: 2026/09/19 21:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6450worker2 # [ 140.189371] nix-grpc-daemon[1606]: time=2026-09-19T21:23:41.069Z level=INFO msg="Upload complete. (430ms)"6451lb # [ 140.207428] niks3-server[1039]: 2026/09/19 21:23:40 INFO Completed upload id=666452worker2 # [ 140.192118] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56272 duration_s=0 paths=1 nar_bytes_in=7526453lb # [ 140.212244] niks3-server[1039]: 2026/09/19 21:23:40 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6454worker2 # [ 140.198564] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:562726455worker2 # [ 140.207383] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6456worker2 # [ 140.208977] nix-daemon[804]: reaped child process 1685, status = succeeded6457client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6458worker2 # [ 140.214023] nix-daemon[804]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6459client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6460client # farm-top> LOG-farm-top-drain6461worker2 # [ 141.028148] nix-daemon[804]: reaped child process 1699, status = succeeded6462worker2 # [ 141.182354] nix-daemon[804]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)6463worker2 # [ 141.195473] nix-daemon[804]: reaped child process 1717, status = succeeded6464lb # [ 141.225246] niks3-server[1039]: 2026/09/19 21:23:41 INFO Received uploads request method=POST path=/api/pending_closures6465worker2 # [ 141.215456] nix-grpc-daemon[1606]: time=2026-09-19T21:23:42.094Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6466worker2 # [ 141.216900] nix-grpc-daemon[1606]: time=2026-09-19T21:23:42.096Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6467lb # [ 141.257169] niks3-server[1039]: 2026/09/19 21:23:41 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6468lb # [ 141.271728] niks3-server[1039]: 2026/09/19 21:23:41 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6469lb # [ 141.280897] niks3-server[1039]: 2026/09/19 21:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6470lb # [ 141.287367] niks3-server[1039]: 2026/09/19 21:23:41 INFO Signed narinfos id=67 count=16471worker2 # [ 141.272376] nix-grpc-daemon[1606]: time=2026-09-19T21:23:42.151Z level=INFO msg="Uploading 1 narinfos"6472lb # [ 141.290195] niks3-server[1039]: 2026/09/19 21:23:41 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6473lb # [ 141.301728] niks3-server[1039]: 2026/09/19 21:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6474lb # [ 141.307384] niks3-server[1039]: 2026/09/19 21:23:41 INFO Completed upload id=676475worker2 # [ 141.289742] nix-grpc-daemon[1606]: time=2026-09-19T21:23:42.169Z level=INFO msg="Upload complete. (269ms)"6476lb # [ 141.308945] niks3-server[1039]: 2026/09/19 21:23:41 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6477worker2 # [ 141.295700] nix-grpc-daemon[1580]: ts=2026-09-19T21:23:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56272 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16478worker2 # [ 141.308693] nix-daemon[804]: reaped child process 1697, status = succeeded6479client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 7.27 seconds)6480client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6481client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.18 seconds)6482worker1: must succeed: rm /nix/.rw-store/fill6483worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6484worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6485worker1 # [ 142.156761] nix-grpc-daemon[1412]: ts=2026-09-19T21:23:43Z level=info event=healthy reason=min_free6486worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6487(finished: subtest: low disk drains a worker and builds go to the other, in 10.77 seconds)6488(finished: run the VM test script, in 143.76 seconds)6489test script finished in 144.02s6490cleanup6491kill QemuMachine (pid 49)6492client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6493kill QemuMachine (pid 50)6494lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6495kill QemuMachine (pid 51)6496worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6497kill QemuMachine (pid 52)6498worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6499(finished: cleanup, in 0.96 seconds)6500additionally exposed symbols:6501 client, lb, worker1, worker2,6502 vlan1,6503 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh