vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #234
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.nh0QtyWd6P', fmt=raw size=107374182414lb: QEMU running (pid 50)15lb # mke2fs 1.47.4 (6-Mar-2025)16lb # Discarding device blocks: 0/262144 done17lb # Creating filesystem with 262144 4k blocks and 65536 inodes18lb # Filesystem UUID: f5ef4c32-ff5b-46bf-8216-ad448f93e43719lb # Superblock backups stored on blocks:20lb # 32768, 98304, 163840, 22937621lb # 22lb # Allocating group tables: 0/8 done23lb # Writing inode tables: 0/8 done24lb # Creating journal (8192 blocks): done25lb # Writing superblocks and filesystem accounting information: 0/8 done26lb # 27lb # Virtualisation disk image created.28worker2 # Disk image does not exist, creating the virtualisation disk image...29worker1 # Disk image does not exist, creating the virtualisation disk image...30worker2: QEMU running (pid 52)31worker1 # Formatting '/build/vm-state-worker1/tmp.WA681AZyXZ', fmt=raw size=107374182432worker2 # Formatting '/build/vm-state-worker2/tmp.CXiwWCpazO', fmt=raw size=107374182433worker1 # mke2fs 1.47.4 (6-Mar-2025)34worker2 # mke2fs 1.47.4 (6-Mar-2025)35worker1 # Discarding device blocks: 0/262144 done36worker2 # Discarding device blocks: 0/262144 done37worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes38worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes39worker1 # Filesystem UUID: 6278512c-759a-4e91-a3db-d7609fc87f7340worker2 # Filesystem UUID: 84fb0c30-e6b8-4a6d-a7f3-4a4bda4a21f541worker1 # Superblock backups stored on blocks:42worker2 # Superblock backups stored on blocks:43worker1 # 32768, 98304, 163840, 22937644worker2 # 32768, 98304, 163840, 22937645worker1 # 46worker2 # 47worker1 # Allocating group tables: 0/8 done48worker2 # Allocating group tables: 0/8 done49worker1 # Writing inode tables: 0/8 done50worker2 # Writing inode tables: 0/8 done51worker1 # Creating journal (8192 blocks): done52worker2 # Creating journal (8192 blocks): done53worker1 # Writing superblocks and filesystem accounting information: 0/8 done54worker2 # Writing superblocks and filesystem accounting information: 0/8 done55worker1 # 56worker2 # 57worker1 # Virtualisation disk image created.58worker2 # Virtualisation disk image created.59worker1: QEMU running (pid 51)60client # Disk image does not exist, creating the virtualisation disk image...61client: QEMU running (pid 49)62client # Formatting '/build/vm-state-client/tmp.WCeKDvHdyO', fmt=raw size=107374182463(finished: start all VMs, in 0.27 seconds)64client # mke2fs 1.47.4 (6-Mar-2025)65client # Discarding device blocks: 0/262144 done66client # Creating filesystem with 262144 4k blocks and 65536 inodes67client # Filesystem UUID: 05020d80-d178-4dbe-ad00-dee0efabc19168client # Superblock backups stored on blocks:69client # 32768, 98304, 163840, 22937670client # 71client # Allocating group tables: 0/8 done72client: waiting for unit network-addresses-eth1.service73client # Writing inode tables: 0/8 done74client: waiting for the VM to finish booting75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83lb # 84lb # 85worker2 # 86worker2 # 87lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0088worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker1 # 90worker1 # 91lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...92lb # 93lb # 94lb # 95lb # 96worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0097worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...98worker2 # 99worker2 # 100worker2 # 101worker2 # 102lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...105worker1 # 106worker1 # 107worker1 # 108worker1 # 109worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00110client # 111client # 112lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...113lb # 114lb # 115worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...116worker2 # 117worker2 # 118client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00119worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...120worker1 # 121worker1 # 122client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123client # 124client # 125client # 126client # 127client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129client # 130client # 131lb # Booting from ROM...132worker2 # Booting from ROM...133worker1 # Booting from ROM...134client # Booting from ROM...135lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026138lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0139lb # [ 0.000000] BIOS-provided physical RAM map:140worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r82fdnll60v9pg56p639vsbi108v3aky-nixos-system-worker2-test/init regInfo=/nix/store/jw4r36mnjikcdv457p30jjrmv8zbhhpx-closure-info/registration console=ttyS0,115200n8 console=tty0141lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable142worker2 # [ 0.000000] BIOS-provided physical RAM map:143worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/66fqrxi71qr4bqw0x9w16f7c4ara1c1k-nixos-system-worker1-test/init regInfo=/nix/store/dlfk5cr9kqn0yj3w4xyvadshnrm7nqz7-closure-info/registration console=ttyS0,115200n8 console=tty0144lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved145worker1 # [ 0.000000] BIOS-provided physical RAM map:146worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable147worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved148worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable149lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved150worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved151lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable152worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved153worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable154lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved155worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved156worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved157lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved158worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable159worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved160lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved161worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved162worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved163lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved164worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved165worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved166lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved167worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved168worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved169lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved170worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved171lb # [ 0.000000] NX (Execute Disable) protection: active172worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved173worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved174lb # [ 0.000000] APIC: Static calls initialized175worker2 # [ 0.000000] NX (Execute Disable) protection: active176lb # [ 0.000000] SMBIOS 2.8 present.177worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved178worker2 # [ 0.000000] APIC: Static calls initialized179worker2 # [ 0.000000] SMBIOS 2.8 present.180worker1 # [ 0.000000] NX (Execute Disable) protection: active181lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014182worker1 # [ 0.000000] APIC: Static calls initialized183lb # [ 0.000000] DMI: Memory slots populated: 1/1184worker1 # [ 0.000000] SMBIOS 2.8 present.185worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014186lb # [ 0.000000] Hypervisor detected: KVM187worker2 # [ 0.000000] DMI: Memory slots populated: 1/1188lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000189worker2 # [ 0.000000] Hypervisor detected: KVM190worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014191lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00192worker1 # [ 0.000000] DMI: Memory slots populated: 1/1193worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000194worker1 # [ 0.000000] Hypervisor detected: KVM195lb # [ 0.000001] kvm-clock: using sched offset of 465922511 cycles196worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00197worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000198worker2 # [ 0.000001] kvm-clock: using sched offset of 462510447 cycles199worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00200lb # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns201worker1 # [ 0.000000] kvm-clock: using sched offset of 463786361 cycles202lb # [ 0.000007] tsc: Detected 2400.012 MHz processor203worker2 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns204lb # [ 0.000862] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000205worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor206worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns207worker2 # [ 0.000858] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000208lb # [ 0.000891] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs209worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor210worker2 # [ 0.000887] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs211worker1 # [ 0.000862] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000212lb # [ 0.000894] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT213lb # [ 0.002893] found SMP MP-table at [mem 0x000f5450-0x000f545f]214worker2 # [ 0.000889] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT215worker1 # [ 0.000891] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs216lb # [ 0.002908] Using GB pages for direct mapping217worker2 # [ 0.002886] found SMP MP-table at [mem 0x000f5450-0x000f545f]218lb # [ 0.003010] RAMDISK: [mem 0x5e367000-0x5ffcffff]219worker1 # [ 0.000894] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT220worker2 # [ 0.002900] Using GB pages for direct mapping221lb # [ 0.003019] ACPI: Early table checksum verification disabled222worker2 # [ 0.003044] RAMDISK: [mem 0x5e367000-0x5ffcffff]223worker1 # [ 0.002901] found SMP MP-table at [mem 0x000f5450-0x000f545f]224client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026225worker1 # [ 0.002915] Using GB pages for direct mapping226worker2 # [ 0.003052] ACPI: Early table checksum verification disabled227lb # [ 0.003023] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )228worker1 # [ 0.003046] RAMDISK: [mem 0x5e367000-0x5ffcffff]229worker2 # [ 0.003056] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )230lb # [ 0.003027] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)231worker1 # [ 0.003055] ACPI: Early table checksum verification disabled232worker2 # [ 0.003060] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)233worker1 # [ 0.003059] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )234lb # [ 0.003032] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)235worker2 # [ 0.003066] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)236worker1 # [ 0.003064] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)237lb # [ 0.003039] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)238client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test/init regInfo=/nix/store/rbfzgwchdp4dp77jy1l66b3dkyp8avvd-closure-info/registration console=ttyS0,115200n8 console=tty0239lb # [ 0.003041] ACPI: FACS 0x000000005FFE0000 000040240worker2 # [ 0.003073] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)241client # [ 0.000000] BIOS-provided physical RAM map:242worker1 # [ 0.003070] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)243worker2 # [ 0.003075] ACPI: FACS 0x000000005FFE0000 000040244client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable245lb # [ 0.003043] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)246worker1 # [ 0.003080] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)247worker2 # [ 0.003077] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)248client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved249worker1 # [ 0.003083] ACPI: FACS 0x000000005FFE0000 000040250lb # [ 0.003045] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)251worker2 # [ 0.003078] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)252client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved253worker1 # [ 0.003085] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)254lb # [ 0.003046] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)255client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable256worker2 # [ 0.003080] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)257worker1 # [ 0.003087] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)258lb # [ 0.003048] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)259client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved260worker2 # [ 0.003081] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)261lb # [ 0.003049] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]262worker1 # [ 0.003088] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)263client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved264worker2 # [ 0.003083] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]265lb # [ 0.003050] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]266client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved267worker1 # [ 0.003090] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)268worker2 # [ 0.003084] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]269lb # [ 0.003051] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]270client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved271worker1 # [ 0.003091] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]272worker2 # [ 0.003085] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]273lb # [ 0.003051] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]274client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved275worker1 # [ 0.003092] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]276worker2 # [ 0.003085] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]277lb # [ 0.003052] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]278worker1 # [ 0.003093] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]279client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved280worker2 # [ 0.003086] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]281client # [ 0.000000] NX (Execute Disable) protection: active282lb # [ 0.003052] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]283worker1 # [ 0.003093] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]284client # [ 0.000000] APIC: Static calls initialized285worker2 # [ 0.003086] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]286client # [ 0.000000] SMBIOS 2.8 present.287lb # [ 0.003053] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]288worker1 # [ 0.003094] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]289lb # [ 0.003294] No NUMA configuration found290worker2 # [ 0.003087] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]291worker2 # [ 0.003322] No NUMA configuration found292worker1 # [ 0.003094] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]293client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014294lb # [ 0.003295] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]295client # [ 0.000000] DMI: Memory slots populated: 1/1296worker2 # [ 0.003323] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]297lb # [ 0.003297] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]298worker1 # [ 0.003095] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]299client # [ 0.000000] Hypervisor detected: KVM300lb # [ 0.005668] Zone ranges:301worker1 # [ 0.003343] No NUMA configuration found302worker2 # [ 0.003326] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]303client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000304worker2 # [ 0.005678] Zone ranges:305lb # [ 0.005669] DMA [mem 0x0000000000001000-0x0000000000ffffff]306worker1 # [ 0.003344] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]307client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00308worker2 # [ 0.005679] DMA [mem 0x0000000000001000-0x0000000000ffffff]309lb # [ 0.005670] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]310worker1 # [ 0.003347] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]311lb # [ 0.005672] Normal empty312client # [ 0.000001] kvm-clock: using sched offset of 483023135 cycles313worker1 # [ 0.005765] Zone ranges:314worker2 # [ 0.005681] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]315lb # [ 0.005673] Device empty316worker2 # [ 0.005682] Normal empty317worker1 # [ 0.005766] DMA [mem 0x0000000000001000-0x0000000000ffffff]318lb # [ 0.005673] Movable zone start for each node319worker2 # [ 0.005683] Device empty320client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns321lb # [ 0.005674] Early memory node ranges322worker2 # [ 0.005684] Movable zone start for each node323worker1 # [ 0.005768] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]324client # [ 0.000006] tsc: Detected 2400.012 MHz processor325worker2 # [ 0.005685] Early memory node ranges326worker1 # [ 0.005770] Normal empty327lb # [ 0.005674] node 0: [mem 0x0000000000001000-0x000000000009efff]328worker1 # [ 0.005771] Device empty329client # [ 0.000852] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000330worker2 # [ 0.005685] node 0: [mem 0x0000000000001000-0x000000000009efff]331lb # [ 0.005675] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]332worker1 # [ 0.005771] Movable zone start for each node333worker1 # [ 0.005772] Early memory node ranges334worker2 # [ 0.005686] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]335client # [ 0.000881] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs336lb # [ 0.005677] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]337worker1 # [ 0.005773] node 0: [mem 0x0000000000001000-0x000000000009efff]338worker2 # [ 0.005687] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]339client # [ 0.000884] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT340lb # [ 0.005698] On node 0, zone DMA: 1 pages in unavailable ranges341worker1 # [ 0.005774] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]342worker2 # [ 0.005708] On node 0, zone DMA: 1 pages in unavailable ranges343client # [ 0.002862] found SMP MP-table at [mem 0x000f5450-0x000f545f]344lb # [ 0.005978] On node 0, zone DMA: 97 pages in unavailable ranges345client # [ 0.002875] Using GB pages for direct mapping346worker1 # [ 0.005775] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]347worker2 # [ 0.005986] On node 0, zone DMA: 97 pages in unavailable ranges348lb # [ 0.034959] On node 0, zone DMA32: 40 pages in unavailable ranges349client # [ 0.002963] RAMDISK: [mem 0x5e366000-0x5ffcffff]350lb # [ 0.035456] ACPI: PM-Timer IO Port: 0x608351worker2 # [ 0.034752] On node 0, zone DMA32: 40 pages in unavailable ranges352worker1 # [ 0.005795] On node 0, zone DMA: 1 pages in unavailable ranges353client # [ 0.002972] ACPI: Early table checksum verification disabled354worker2 # [ 0.035245] ACPI: PM-Timer IO Port: 0x608355lb # [ 0.035471] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])356worker1 # [ 0.006079] On node 0, zone DMA: 97 pages in unavailable ranges357worker2 # [ 0.035260] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])358lb # [ 0.035504] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23359worker1 # [ 0.035011] On node 0, zone DMA32: 40 pages in unavailable ranges360client # [ 0.002975] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )361worker1 # [ 0.035515] ACPI: PM-Timer IO Port: 0x608362worker2 # [ 0.035292] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23363lb # [ 0.035507] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)364client # [ 0.002979] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)365worker1 # [ 0.035528] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])366worker2 # [ 0.035294] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)367lb # [ 0.035509] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)368client # [ 0.002985] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)369worker1 # [ 0.035559] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23370lb # [ 0.035510] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)371worker2 # [ 0.035296] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)372client # [ 0.002992] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)373worker1 # [ 0.035562] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)374worker2 # [ 0.035298] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)375lb # [ 0.035511] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)376client # [ 0.002995] ACPI: FACS 0x000000005FFE0000 000040377worker1 # [ 0.035563] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)378worker2 # [ 0.035299] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)379lb # [ 0.035512] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)380client # [ 0.002996] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)381worker1 # [ 0.035565] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)382worker2 # [ 0.035300] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)383lb # [ 0.035515] ACPI: Using ACPI (MADT) for SMP configuration information384worker1 # [ 0.035566] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)385client # [ 0.002998] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)386lb # [ 0.035516] ACPI: HPET id: 0x8086a201 base: 0xfed00000387worker2 # [ 0.035302] ACPI: Using ACPI (MADT) for SMP configuration information388lb # [ 0.035521] TSC deadline timer available389worker2 # [ 0.035303] ACPI: HPET id: 0x8086a201 base: 0xfed00000390worker1 # [ 0.035567] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)391client # [ 0.002999] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)392lb # [ 0.035525] CPU topo: Max. logical packages: 1393worker2 # [ 0.035308] TSC deadline timer available394worker1 # [ 0.035569] ACPI: Using ACPI (MADT) for SMP configuration information395lb # [ 0.035526] CPU topo: Max. logical dies: 1396worker2 # [ 0.035313] CPU topo: Max. logical packages: 1397client # [ 0.003001] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)398worker1 # [ 0.035570] ACPI: HPET id: 0x8086a201 base: 0xfed00000399lb # [ 0.035526] CPU topo: Max. dies per package: 1400worker2 # [ 0.035314] CPU topo: Max. logical dies: 1401worker1 # [ 0.035575] TSC deadline timer available402lb # [ 0.035530] CPU topo: Max. threads per core: 1403worker2 # [ 0.035314] CPU topo: Max. dies per package: 1404client # [ 0.003002] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]405worker1 # [ 0.035579] CPU topo: Max. logical packages: 1406worker2 # [ 0.035318] CPU topo: Max. threads per core: 1407lb # [ 0.035531] CPU topo: Num. cores per package: 1408worker1 # [ 0.035580] CPU topo: Max. logical dies: 1409client # [ 0.003003] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]410lb # [ 0.035531] CPU topo: Num. threads per package: 1411worker2 # [ 0.035318] CPU topo: Num. cores per package: 1412worker1 # [ 0.035581] CPU topo: Max. dies per package: 1413worker2 # [ 0.035319] CPU topo: Num. threads per package: 1414client # [ 0.003004] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]415lb # [ 0.035531] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs416worker1 # [ 0.035584] CPU topo: Max. threads per core: 1417worker2 # [ 0.035319] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs418worker1 # [ 0.035585] CPU topo: Num. cores per package: 1419client # [ 0.003004] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]420lb # [ 0.035556] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()421worker1 # [ 0.035586] CPU topo: Num. threads per package: 1422worker2 # [ 0.035342] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()423client # [ 0.003005] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]424lb # [ 0.035594] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]425worker1 # [ 0.035586] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs426worker2 # [ 0.035378] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]427client # [ 0.003005] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]428lb # [ 0.035595] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]429worker1 # [ 0.035608] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()430worker2 # [ 0.035379] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]431client # [ 0.003006] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]432lb # [ 0.035597] [mem 0x60000000-0xafffffff] available for PCI devices433client # [ 0.003250] No NUMA configuration found434worker1 # [ 0.035645] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]435lb # [ 0.035599] Booting paravirtualized kernel on KVM436worker2 # [ 0.035381] [mem 0x60000000-0xafffffff] available for PCI devices437worker2 # [ 0.035383] Booting paravirtualized kernel on KVM438client # [ 0.003251] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]439worker1 # [ 0.035646] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]440lb # [ 0.035603] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns441client # [ 0.003253] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]442worker1 # [ 0.035648] [mem 0x60000000-0xafffffff] available for PCI devices443client # [ 0.005791] Zone ranges:444worker2 # [ 0.035386] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns445worker1 # [ 0.035650] Booting paravirtualized kernel on KVM446lb # [ 0.040267] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1447client # [ 0.005792] DMA [mem 0x0000000000001000-0x0000000000ffffff]448worker2 # [ 0.040060] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1449lb # [ 0.043091] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152450client # [ 0.005793] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]451worker1 # [ 0.035653] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns452client # [ 0.005795] Normal empty453worker2 # [ 0.042382] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152454lb # [ 0.043148] kvm-guest: PV spinlocks disabled, single CPU455client # [ 0.005796] Device empty456worker2 # [ 0.042437] kvm-guest: PV spinlocks disabled, single CPU457worker1 # [ 0.040389] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1458client # [ 0.005796] Movable zone start for each node459client # [ 0.005797] Early memory node ranges460worker1 # [ 0.043206] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152461client # [ 0.005798] node 0: [mem 0x0000000000001000-0x000000000009efff]462worker1 # [ 0.043254] kvm-guest: PV spinlocks disabled, single CPU463client # [ 0.005799] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]464client # [ 0.005800] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]465lb # [ 0.043150] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0466worker2 # [ 0.042438] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r82fdnll60v9pg56p639vsbi108v3aky-nixos-system-worker2-test/init regInfo=/nix/store/jw4r36mnjikcdv457p30jjrmv8zbhhpx-closure-info/registration console=ttyS0,115200n8 console=tty0467client # [ 0.005822] On node 0, zone DMA: 1 pages in unavailable ranges468client # [ 0.006110] On node 0, zone DMA: 97 pages in unavailable ranges469lb # [ 0.043252] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.470lb # [ 0.043267] random: crng init done471client # [ 0.035976] On node 0, zone DMA32: 40 pages in unavailable ranges472worker1 # [ 0.043256] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/66fqrxi71qr4bqw0x9w16f7c4ara1c1k-nixos-system-worker1-test/init regInfo=/nix/store/dlfk5cr9kqn0yj3w4xyvadshnrm7nqz7-closure-info/registration console=ttyS0,115200n8 console=tty0473worker2 # [ 0.042539] Unknown kernel command line parameters "regInfo=/nix/store/jw4r36mnjikcdv457p30jjrmv8zbhhpx-closure-info/registration", will be passed to user space.474client # [ 0.036472] ACPI: PM-Timer IO Port: 0x608475worker2 # [ 0.042553] random: crng init done476lb # [ 0.043268] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes477client # [ 0.036484] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])478worker2 # [ 0.042554] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes479worker1 # [ 0.043361] Unknown kernel command line parameters "regInfo=/nix/store/dlfk5cr9kqn0yj3w4xyvadshnrm7nqz7-closure-info/registration", will be passed to user space.480lb # [ 0.045562] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)481client # [ 0.036516] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23482worker1 # [ 0.043375] random: crng init done483worker2 # [ 0.044835] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)484lb # [ 0.046704] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)485client # [ 0.036518] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)486worker1 # [ 0.043375] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes487lb # [ 0.046747] Fallback order for Node 0: 0488worker2 # [ 0.046293] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)489client # [ 0.036520] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)490worker2 # [ 0.046328] Fallback order for Node 0: 0491worker1 # [ 0.045634] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)492lb # [ 0.046751] Built 1 zonelists, mobility grouping on. Total pages: 393078493lb # [ 0.046753] Policy zone: DMA32494client # [ 0.036522] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)495worker2 # [ 0.046331] Built 1 zonelists, mobility grouping on. Total pages: 393078496worker1 # [ 0.046817] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)497worker2 # [ 0.046332] Policy zone: DMA32498lb # [ 0.049427] mem auto-init: stack:all(zero), heap alloc:on, heap free:off499client # [ 0.036523] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)500worker1 # [ 0.046853] Fallback order for Node 0: 0501worker2 # [ 0.049354] mem auto-init: stack:all(zero), heap alloc:on, heap free:off502lb # [ 0.053051] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1503client # [ 0.036524] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)504worker1 # [ 0.046856] Built 1 zonelists, mobility grouping on. Total pages: 393078505lb # [ 0.056925] allocated 3145728 bytes of page_ext506worker1 # [ 0.046857] Policy zone: DMA32507worker2 # [ 0.052894] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1508client # [ 0.036526] ACPI: Using ACPI (MADT) for SMP configuration information509worker2 # [ 0.056451] allocated 3145728 bytes of page_ext510lb # [ 0.067532] ftrace: allocating 48731 entries in 192 pages511worker1 # [ 0.049572] mem auto-init: stack:all(zero), heap alloc:on, heap free:off512client # [ 0.036527] ACPI: HPET id: 0x8086a201 base: 0xfed00000513lb # [ 0.067535] ftrace: allocated 192 pages with 2 groups514worker2 # [ 0.067083] ftrace: allocating 48731 entries in 192 pages515client # [ 0.036531] TSC deadline timer available516worker1 # [ 0.053135] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1517lb # [ 0.068457] Dynamic Preempt: lazy518worker2 # [ 0.067084] ftrace: allocated 192 pages with 2 groups519client # [ 0.036535] CPU topo: Max. logical packages: 1520worker1 # [ 0.057051] allocated 3145728 bytes of page_ext521worker2 # [ 0.067970] Dynamic Preempt: lazy522lb # [ 0.068619] rcu: Preemptible hierarchical RCU implementation.523client # [ 0.036536] CPU topo: Max. logical dies: 1524worker1 # [ 0.067834] ftrace: allocating 48731 entries in 192 pages525lb # [ 0.068620] rcu: RCU event tracing is enabled.526worker2 # [ 0.068135] rcu: Preemptible hierarchical RCU implementation.527client # [ 0.036537] CPU topo: Max. dies per package: 1528worker1 # [ 0.067836] ftrace: allocated 192 pages with 2 groups529worker2 # [ 0.068135] rcu: RCU event tracing is enabled.530lb # [ 0.068620] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.531worker1 # [ 0.068741] Dynamic Preempt: lazy532client # [ 0.036540] CPU topo: Max. threads per core: 1533lb # [ 0.068622] Trampoline variant of Tasks RCU enabled.534worker2 # [ 0.068136] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.535client # [ 0.036541] CPU topo: Num. cores per package: 1536worker1 # [ 0.068886] rcu: Preemptible hierarchical RCU implementation.537lb # [ 0.068622] Rude variant of Tasks RCU enabled.538worker2 # [ 0.068138] Trampoline variant of Tasks RCU enabled.539client # [ 0.036541] CPU topo: Num. threads per package: 1540worker1 # [ 0.068887] rcu: RCU event tracing is enabled.541worker2 # [ 0.068138] Rude variant of Tasks RCU enabled.542lb # [ 0.068622] Tracing variant of Tasks RCU enabled.543client # [ 0.036541] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs544worker1 # [ 0.068888] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.545worker2 # [ 0.068138] Tracing variant of Tasks RCU enabled.546lb # [ 0.068623] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.547worker1 # [ 0.068889] Trampoline variant of Tasks RCU enabled.548client # [ 0.036563] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()549worker2 # [ 0.068139] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.550worker1 # [ 0.068890] Rude variant of Tasks RCU enabled.551lb # [ 0.068624] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1552client # [ 0.036599] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]553worker1 # [ 0.068890] Tracing variant of Tasks RCU enabled.554worker2 # [ 0.068140] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1555lb # [ 0.068647] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.556client # [ 0.036601] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]557worker1 # [ 0.068890] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.558worker2 # [ 0.068157] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.559client # [ 0.036602] [mem 0x60000000-0xafffffff] available for PCI devices560lb # [ 0.068649] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.561worker1 # [ 0.068891] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1562client # [ 0.036604] Booting paravirtualized kernel on KVM563worker2 # [ 0.068159] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.564lb # [ 0.068650] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.565worker1 # [ 0.068943] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.566worker2 # [ 0.068160] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.567client # [ 0.036608] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns568lb # [ 0.073106] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16569worker1 # [ 0.068945] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570worker2 # [ 0.073114] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16571lb # [ 0.073418] rcu: srcu_init: Setting srcu_struct sizes based on contention.572client # [ 0.041138] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1573worker2 # [ 0.073409] rcu: srcu_init: Setting srcu_struct sizes based on contention.574worker1 # [ 0.068946] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.575client # [ 0.043478] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152576lb # [ 0.073427] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns577worker1 # [ 0.073422] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16578client # [ 0.043529] kvm-guest: PV spinlocks disabled, single CPU579worker2 # [ 0.073417] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns580worker1 # [ 0.073711] rcu: srcu_init: Setting srcu_struct sizes based on contention.581lb # [ 0.073539] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)582lb # [ 0.077157] Console: colour VGA+ 80x25583worker2 # [ 0.073529] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)584worker1 # [ 0.073719] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns585lb # [ 0.077161] printk: legacy console [tty0] enabled586worker2 # [ 0.077110] Console: colour VGA+ 80x25587worker2 # [ 0.077113] printk: legacy console [tty0] enabled588lb # [ 0.106893] printk: legacy console [ttyS0] enabled589worker1 # [ 0.073828] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)590worker2 # [ 0.106792] printk: legacy console [ttyS0] enabled591lb # [ 0.203037] ACPI: Core revision 20250807592worker1 # [ 0.077457] Console: colour VGA+ 80x25593worker2 # [ 0.202682] ACPI: Core revision 20250807594client # [ 0.043530] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test/init regInfo=/nix/store/rbfzgwchdp4dp77jy1l66b3dkyp8avvd-closure-info/registration console=ttyS0,115200n8 console=tty0595worker1 # [ 0.077460] printk: legacy console [tty0] enabled596worker1 # [ 0.107411] printk: legacy console [ttyS0] enabled597lb # [ 0.203907] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns598worker1 # [ 0.204099] ACPI: Core revision 20250807599worker2 # [ 0.203617] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns600client # [ 0.043632] Unknown kernel command line parameters "regInfo=/nix/store/rbfzgwchdp4dp77jy1l66b3dkyp8avvd-closure-info/registration", will be passed to user space.601lb # [ 0.205488] APIC: Switch to symmetric I/O mode setup602client # [ 0.043647] random: crng init done603worker2 # [ 0.205161] APIC: Switch to symmetric I/O mode setup604lb # [ 0.206428] x2apic enabled605worker1 # [ 0.204980] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns606worker2 # [ 0.206109] x2apic enabled607client # [ 0.043648] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes608lb # [ 0.207157] APIC: Switched APIC routing to: physical x2apic609worker1 # [ 0.206571] APIC: Switch to symmetric I/O mode setup610client # [ 0.045941] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)611worker2 # [ 0.206861] APIC: Switched APIC routing to: physical x2apic612worker1 # [ 0.207510] x2apic enabled613client # [ 0.047411] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)614lb # [ 0.208938] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1615client # [ 0.047444] Fallback order for Node 0: 0616worker1 # [ 0.208242] APIC: Switched APIC routing to: physical x2apic617worker2 # [ 0.208606] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1618client # [ 0.047447] Built 1 zonelists, mobility grouping on. Total pages: 393078619client # [ 0.047448] Policy zone: DMA32620lb # [ 0.209905] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns621worker1 # [ 0.210028] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1622worker2 # [ 0.209546] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns623client # [ 0.050128] mem auto-init: stack:all(zero), heap alloc:on, heap free:off624client # [ 0.053762] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1625lb # [ 0.211539] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)626worker2 # [ 0.211124] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)627client # [ 0.057333] allocated 3145728 bytes of page_ext628worker1 # [ 0.211006] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns629lb # [ 0.212624] x86/cpu: User Mode Instruction Prevention (UMIP) activated630client # [ 0.068362] ftrace: allocating 48731 entries in 192 pages631worker2 # [ 0.213208] x86/cpu: User Mode Instruction Prevention (UMIP) activated632client # [ 0.068364] ftrace: allocated 192 pages with 2 groups633worker1 # [ 0.212643] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)634client # [ 0.069258] Dynamic Preempt: lazy635lb # [ 0.213714] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127636worker2 # [ 0.214251] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127637client # [ 0.069444] rcu: Preemptible hierarchical RCU implementation.638worker1 # [ 0.213728] x86/cpu: User Mode Instruction Prevention (UMIP) activated639lb # [ 0.214537] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0640client # [ 0.069444] rcu: RCU event tracing is enabled.641worker2 # [ 0.215122] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0642worker1 # [ 0.214772] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127643client # [ 0.069445] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.644lb # [ 0.215541] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto645client # [ 0.069447] Trampoline variant of Tasks RCU enabled.646worker2 # [ 0.216125] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto647worker1 # [ 0.215641] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0648client # [ 0.069447] Rude variant of Tasks RCU enabled.649client # [ 0.069447] Tracing variant of Tasks RCU enabled.650lb # [ 0.217537] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl651worker2 # [ 0.217121] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl652worker1 # [ 0.216644] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto653client # [ 0.069449] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.654lb # [ 0.218537] Transient Scheduler Attacks: Vulnerable: No microcode655worker2 # [ 0.219122] Transient Scheduler Attacks: Vulnerable: No microcode656client # [ 0.069449] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1657lb # [ 0.219536] Spectre V2 : Mitigation: Enhanced / Automatic IBRS658worker1 # [ 0.217640] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl659worker2 # [ 0.220026] Spectre V2 : Mitigation: Enhanced / Automatic IBRS660client # [ 0.069471] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.661lb # [ 0.220537] Speculative Return Stack Overflow: Mitigation: Safe RET662worker1 # [ 0.218641] Transient Scheduler Attacks: Vulnerable: No microcode663worker2 # [ 0.221121] Speculative Return Stack Overflow: Mitigation: Safe RET664client # [ 0.069473] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.665worker1 # [ 0.219640] Spectre V2 : Mitigation: Enhanced / Automatic IBRS666client # [ 0.069474] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.667worker1 # [ 0.220640] Speculative Return Stack Overflow: Mitigation: Safe RET668client # [ 0.074408] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16669client # [ 0.074709] rcu: srcu_init: Setting srcu_struct sizes based on contention.670lb # [ 0.221536] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization671worker2 # [ 0.222121] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization672lb # [ 0.223544] Spectre V2 : Enabling IBPB for BPF673worker2 # [ 0.224129] Spectre V2 : Enabling IBPB for BPF674client # [ 0.074717] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns675worker1 # [ 0.221640] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization676lb # [ 0.224537] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier677client # [ 0.074835] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)678worker2 # [ 0.225639] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier679client # [ 0.078395] Console: colour VGA+ 80x25680worker1 # [ 0.223648] Spectre V2 : Enabling IBPB for BPF681worker2 # [ 0.226122] active return thunk: srso_alias_return_thunk682lb # [ 0.225538] active return thunk: srso_alias_return_thunk683client # [ 0.078398] printk: legacy console [tty0] enabled684client # [ 0.107885] printk: legacy console [ttyS0] enabled685worker1 # [ 0.224641] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier686worker2 # [ 0.227758] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'687lb # [ 0.226558] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'688client # [ 0.205746] ACPI: Core revision 20250807689worker1 # [ 0.225641] active return thunk: srso_alias_return_thunk690worker2 # [ 0.228997] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'691lb # [ 0.227537] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'692worker2 # [ 0.229852] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'693worker1 # [ 0.226662] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'694client # [ 0.206689] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns695lb # [ 0.228536] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'696worker2 # [ 0.230848] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'697client # [ 0.208255] APIC: Switch to symmetric I/O mode setup698worker1 # [ 0.227640] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'699lb # [ 0.229536] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'700client # [ 0.209220] x2apic enabled701worker2 # [ 0.231863] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'702worker1 # [ 0.228640] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'703lb # [ 0.230536] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'704worker2 # [ 0.232853] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'705client # [ 0.210002] APIC: Switched APIC routing to: physical x2apic706worker1 # [ 0.229640] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'707lb # [ 0.231536] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'708worker2 # [ 0.233121] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'709worker1 # [ 0.230640] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'710lb # [ 0.232536] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'711client # [ 0.211867] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1712worker2 # [ 0.235018] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256713worker1 # [ 0.231640] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'714lb # [ 0.233537] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256715worker2 # [ 0.235826] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64716lb # [ 0.235230] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64717worker1 # [ 0.232640] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'718client # [ 0.212857] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns719worker2 # [ 0.236824] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512720lb # [ 0.236237] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512721worker1 # [ 0.233641] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256722worker2 # [ 0.237121] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024723client # [ 0.214546] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)724lb # [ 0.236537] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024725worker1 # [ 0.234640] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64726worker2 # [ 0.238121] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8727client # [ 0.215634] x86/cpu: User Mode Instruction Prevention (UMIP) activated728lb # [ 0.237536] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8729worker1 # [ 0.235640] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512730worker2 # [ 0.239121] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.731client # [ 0.216696] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127732worker1 # [ 0.236640] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024733lb # [ 0.238536] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.734client # [ 0.218231] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0735worker1 # [ 0.237640] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8736worker1 # [ 0.238640] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.737client # [ 0.219348] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto738client # [ 0.220543] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl739client # [ 0.222543] Transient Scheduler Attacks: Vulnerable: No microcode740client # [ 0.223542] Spectre V2 : Mitigation: Enhanced / Automatic IBRS741client # [ 0.224542] Speculative Return Stack Overflow: Mitigation: Safe RET742client # [ 0.225542] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization743client # [ 0.227551] Spectre V2 : Enabling IBPB for BPF744client # [ 0.228306] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745client # [ 0.229543] active return thunk: srso_alias_return_thunk746client # [ 0.230565] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747client # [ 0.231542] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748client # [ 0.232542] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749client # [ 0.233542] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750client # [ 0.234542] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751client # [ 0.235542] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752client # [ 0.236542] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753client # [ 0.237543] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754client # [ 0.239308] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755client # [ 0.240308] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756client # [ 0.241307] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757client # [ 0.242304] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758client # [ 0.243309] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759lb # [ 0.273613] Freeing SMP alternatives memory: 44K760worker2 # [ 0.274674] Freeing SMP alternatives memory: 44K761lb # [ 0.274391] pid_max: default: 32768 minimum: 301762worker2 # [ 0.275126] pid_max: default: 32768 minimum: 301763lb # [ 0.275159] LSM: initializing lsm=capability,landlock,yama,bpf,ima764worker2 # [ 0.276220] LSM: initializing lsm=capability,landlock,yama,bpf,ima765worker1 # [ 0.274815] Freeing SMP alternatives memory: 44K766lb # [ 0.275645] landlock: Up and running.767worker2 # [ 0.277237] landlock: Up and running.768worker1 # [ 0.275596] pid_max: default: 32768 minimum: 301769lb # [ 0.276537] Yama: becoming mindful.770worker2 # [ 0.277835] Yama: becoming mindful.771lb # [ 0.277720] LSM support for eBPF active772worker1 # [ 0.276273] LSM: initializing lsm=capability,landlock,yama,bpf,ima773worker2 # [ 0.278754] LSM support for eBPF active774worker1 # [ 0.277472] landlock: Up and running.775lb # [ 0.278461] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)776worker1 # [ 0.278065] Yama: becoming mindful.777worker2 # [ 0.279250] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)778worker1 # [ 0.278863] LSM support for eBPF active779lb # [ 0.279579] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)780worker2 # [ 0.280167] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)781worker1 # [ 0.279732] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)782worker1 # [ 0.280676] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)783lb # [ 0.281904] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)784worker2 # [ 0.283108] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)785lb # [ 0.283120] Performance Events: Fam17h+ core perfctr, AMD PMU driver.786worker2 # [ 0.283724] Performance Events: Fam17h+ core perfctr, AMD PMU driver.787lb # [ 0.283546] ... version: 2788worker1 # [ 0.283223] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)789worker2 # [ 0.284126] ... version: 2790lb # [ 0.284236] ... bit width: 48791worker2 # [ 0.284803] ... bit width: 48792lb # [ 0.284539] ... generic counters: 6793worker2 # [ 0.285124] ... generic counters: 6794worker1 # [ 0.284172] Performance Events: Fam17h+ core perfctr, AMD PMU driver.795lb # [ 0.285237] ... generic bitmap: 000000000000003f796worker1 # [ 0.284646] ... version: 2797worker2 # [ 0.285797] ... generic bitmap: 000000000000003f798lb # [ 0.285539] ... fixed-purpose counters: 0799worker1 # [ 0.285336] ... bit width: 48800worker2 # [ 0.286135] ... fixed-purpose counters: 0801worker1 # [ 0.285643] ... generic counters: 6802lb # [ 0.286233] ... fixed-purpose bitmap: 0000000000000000803worker2 # [ 0.286812] ... fixed-purpose bitmap: 0000000000000000804worker1 # [ 0.286325] ... generic bitmap: 000000000000003f805lb # [ 0.286539] ... value mask: 0000ffffffffffff806worker2 # [ 0.287123] ... value mask: 0000ffffffffffff807worker1 # [ 0.286693] ... fixed-purpose counters: 0808lb # [ 0.287382] ... max period: 00007fffffffffff809worker2 # [ 0.288009] ... max period: 00007fffffffffff810worker1 # [ 0.287396] ... fixed-purpose bitmap: 0000000000000000811lb # [ 0.288194] ... global_ctrl mask: 000000000000003f812worker2 # [ 0.288758] ... global_ctrl mask: 000000000000003f813worker1 # [ 0.287643] ... value mask: 0000ffffffffffff814lb # [ 0.288659] signal: max sigframe size: 3376815worker2 # [ 0.289247] signal: max sigframe size: 3376816worker1 # [ 0.288510] ... max period: 00007fffffffffff817lb # [ 0.289426] rcu: Hierarchical SRCU implementation.818worker2 # [ 0.290049] rcu: Hierarchical SRCU implementation.819worker1 # [ 0.289283] ... global_ctrl mask: 000000000000003f820lb # [ 0.290112] rcu: Max phase no-delay instances is 400.821worker2 # [ 0.290687] rcu: Max phase no-delay instances is 400.822worker1 # [ 0.289789] signal: max sigframe size: 3376823worker1 # [ 0.290566] rcu: Hierarchical SRCU implementation.824worker1 # [ 0.291252] rcu: Max phase no-delay instances is 400.825lb # [ 0.295332] smp: Bringing up secondary CPUs ...826worker2 # [ 0.295978] smp: Bringing up secondary CPUs ...827lb # [ 0.296102] smp: Brought up 1 node, 1 CPU828worker2 # [ 0.296711] smp: Brought up 1 node, 1 CPU829lb # [ 0.296540] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)830worker2 # [ 0.297125] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)831worker1 # [ 0.296628] smp: Bringing up secondary CPUs ...832worker1 # [ 0.297264] smp: Brought up 1 node, 1 CPU833lb # [ 0.297687] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)834worker2 # [ 0.298356] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)835worker1 # [ 0.297646] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)836lb # [ 0.298845] devtmpfs: initialized837client # [ 0.281364] Freeing SMP alternatives memory: 44K838worker2 # [ 0.299401] devtmpfs: initialized839client # [ 0.282155] pid_max: default: 32768 minimum: 301840lb # [ 0.299657] x86/mm: Memory block size: 128MB841worker2 # [ 0.300160] x86/mm: Memory block size: 128MB842worker1 # [ 0.298815] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)843client # [ 0.282673] LSM: initializing lsm=capability,landlock,yama,bpf,ima844client # [ 0.283666] landlock: Up and running.845worker1 # [ 0.299933] devtmpfs: initialized846lb # [ 0.301422] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)847client # [ 0.284543] Yama: becoming mindful.848worker2 # [ 0.301984] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)849worker1 # [ 0.300709] x86/mm: Memory block size: 128MB850client # [ 0.285789] LSM support for eBPF active851lb # [ 0.302434] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).852worker2 # [ 0.303037] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).853lb # [ 0.303659] pinctrl core: initialized pinctrl subsystem854client # [ 0.286712] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)855worker2 # [ 0.304223] pinctrl core: initialized pinctrl subsystem856worker1 # [ 0.302686] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)857lb # [ 0.304844] PM: RTC time: 08:14:58, date: 2026-09-20858worker2 # [ 0.305358] PM: RTC time: 08:14:58, date: 2026-09-20859client # [ 0.287601] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)860worker1 # [ 0.303683] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).861worker1 # [ 0.304733] pinctrl core: initialized pinctrl subsystem862worker1 # [ 0.305839] PM: RTC time: 08:14:58, date: 2026-09-20863client # [ 0.290541] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)864worker2 # [ 0.309045] NET: Registered PF_NETLINK/PF_ROUTE protocol family865lb # [ 0.308784] NET: Registered PF_NETLINK/PF_ROUTE protocol family866client # [ 0.291146] Performance Events: Fam17h+ core perfctr, AMD PMU driver.867client # [ 0.291547] ... version: 2868worker2 # [ 0.310468] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations869lb # [ 0.310074] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations870client # [ 0.292254] ... bit width: 48871worker1 # [ 0.309882] NET: Registered PF_NETLINK/PF_ROUTE protocol family872worker2 # [ 0.311164] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations873lb # [ 0.310562] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations874client # [ 0.292545] ... generic counters: 6875client # [ 0.293239] ... generic bitmap: 000000000000003f876client # [ 0.293556] ... fixed-purpose counters: 0877worker2 # [ 0.312411] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations878worker1 # [ 0.311204] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations879lb # [ 0.311832] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations880client # [ 0.294230] ... fixed-purpose bitmap: 0000000000000000881worker2 # [ 0.313139] audit: initializing netlink subsys (disabled)882lb # [ 0.312553] audit: initializing netlink subsys (disabled)883worker1 # [ 0.311666] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations884client # [ 0.294545] ... value mask: 0000ffffffffffff885worker2 # [ 0.314261] thermal_sys: Registered thermal governor 'fair_share'886lb # [ 0.313697] thermal_sys: Registered thermal governor 'fair_share'887client # [ 0.295469] ... max period: 00007fffffffffff888worker1 # [ 0.312949] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations889worker2 # [ 0.314264] thermal_sys: Registered thermal governor 'bang_bang'890lb # [ 0.313700] thermal_sys: Registered thermal governor 'bang_bang'891client # [ 0.296213] ... global_ctrl mask: 000000000000003f892worker1 # [ 0.313655] audit: initializing netlink subsys (disabled)893worker2 # [ 0.315125] thermal_sys: Registered thermal governor 'step_wise'894lb # [ 0.314540] thermal_sys: Registered thermal governor 'step_wise'895client # [ 0.296669] signal: max sigframe size: 3376896worker2 # [ 0.316025] thermal_sys: Registered thermal governor 'user_space'897client # [ 0.297471] rcu: Hierarchical SRCU implementation.898lb # [ 0.315464] thermal_sys: Registered thermal governor 'user_space'899worker1 # [ 0.314645] audit: type=2000 audit(1789892099.165:1): state=initialized audit_enabled=0 res=1900client # [ 0.298120] rcu: Max phase no-delay instances is 400.901worker2 # [ 0.316843] audit: type=2000 audit(1789892099.166:1): state=initialized audit_enabled=0 res=1902worker1 # [ 0.315813] thermal_sys: Registered thermal governor 'fair_share'903lb # [ 0.316252] audit: type=2000 audit(1789892099.164:1): state=initialized audit_enabled=0 res=1904worker2 # [ 0.318127] thermal_sys: Registered thermal governor 'power_allocator'905worker1 # [ 0.315815] thermal_sys: Registered thermal governor 'bang_bang'906lb # [ 0.317542] thermal_sys: Registered thermal governor 'power_allocator'907worker2 # [ 0.318144] cpuidle: using governor menu908lb # [ 0.317558] cpuidle: using governor menu909worker1 # [ 0.316644] thermal_sys: Registered thermal governor 'step_wise'910worker1 # [ 0.317584] thermal_sys: Registered thermal governor 'user_space'911worker2 # [ 0.320363] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5912lb # [ 0.319765] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5913worker1 # [ 0.318354] thermal_sys: Registered thermal governor 'power_allocator'914worker1 # [ 0.318662] cpuidle: using governor menu915worker2 # [ 0.321376] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]916lb # [ 0.320836] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]917client # [ 0.303390] smp: Bringing up secondary CPUs ...918client # [ 0.304123] smp: Brought up 1 node, 1 CPU919worker2 # [ 0.322128] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry920lb # [ 0.321543] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry921worker1 # [ 0.320857] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5922worker2 # [ 0.323141] PCI: Using configuration type 1 for base access923client # [ 0.304546] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)924lb # [ 0.322555] PCI: Using configuration type 1 for base access925worker1 # [ 0.321876] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]926worker2 # [ 0.324222] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.927lb # [ 0.323648] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.928worker1 # [ 0.322647] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry929client # [ 0.305760] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)930worker1 # [ 0.323656] PCI: Using configuration type 1 for base access931client # [ 0.306877] devtmpfs: initialized932client # [ 0.307734] x86/mm: Memory block size: 128MB933worker1 # [ 0.324731] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.934client # [ 0.309599] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)935lb # [ 0.328679] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages936lb # [ 0.329542] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page937client # [ 0.310574] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).938worker2 # [ 0.331432] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages939client # [ 0.311663] pinctrl core: initialized pinctrl subsystem940worker1 # [ 0.329920] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages941worker2 # [ 0.332126] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page942client # [ 0.312790] PM: RTC time: 08:14:58, date: 2026-09-20943worker1 # [ 0.330644] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page944lb # [ 0.334541] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages945lb # [ 0.335539] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page946client # [ 0.316737] NET: Registered PF_NETLINK/PF_ROUTE protocol family947worker2 # [ 0.337125] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages948worker1 # [ 0.335644] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages949worker2 # [ 0.338125] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page950client # [ 0.318104] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations951worker1 # [ 0.336643] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page952client # [ 0.318572] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations953client # [ 0.319841] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations954client # [ 0.320568] audit: initializing netlink subsys (disabled)955client # [ 0.321745] thermal_sys: Registered thermal governor 'fair_share'956client # [ 0.321747] thermal_sys: Registered thermal governor 'bang_bang'957client # [ 0.322546] thermal_sys: Registered thermal governor 'step_wise'958client # [ 0.323467] thermal_sys: Registered thermal governor 'user_space'959lb # [ 0.345937] ACPI: Added _OSI(Module Device)960lb # [ 0.346541] ACPI: Added _OSI(Processor Device)961client # [ 0.324244] audit: type=2000 audit(1789892099.194:1): state=initialized audit_enabled=0 res=1962worker2 # [ 0.347584] ACPI: Added _OSI(Module Device)963lb # [ 0.347269] ACPI: Added _OSI(Processor Aggregator Device)964worker2 # [ 0.348126] ACPI: Added _OSI(Processor Device)965client # [ 0.325548] thermal_sys: Registered thermal governor 'power_allocator'966worker2 # [ 0.348830] ACPI: Added _OSI(Processor Aggregator Device)967client # [ 0.325568] cpuidle: using governor menu968worker1 # [ 0.347102] ACPI: Added _OSI(Module Device)969worker1 # [ 0.347645] ACPI: Added _OSI(Processor Device)970client # [ 0.327586] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5971worker1 # [ 0.348358] ACPI: Added _OSI(Processor Aggregator Device)972client # [ 0.328815] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]973client # [ 0.329549] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry974client # [ 0.330560] PCI: Using configuration type 1 for base access975client # [ 0.331639] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.976worker2 # [ 0.355691] ACPI: 1 ACPI AML tables successfully acquired and loaded977lb # [ 0.355886] ACPI: 1 ACPI AML tables successfully acquired and loaded978worker1 # [ 0.357339] ACPI: 1 ACPI AML tables successfully acquired and loaded979worker2 # [ 0.359538] ACPI: Interpreter enabled980client # [ 0.336861] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages981worker2 # [ 0.360140] ACPI: PM: (supports S0 S3 S4 S5)982lb # [ 0.359942] ACPI: Interpreter enabled983client # [ 0.337547] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page984worker2 # [ 0.360873] ACPI: Using IOAPIC for interrupt routing985lb # [ 0.360555] ACPI: PM: (supports S0 S3 S4 S5)986lb # [ 0.361245] ACPI: Using IOAPIC for interrupt routing987client # [ 0.338527] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages988worker1 # [ 0.361094] ACPI: Interpreter enabled989worker1 # [ 0.361661] ACPI: PM: (supports S0 S3 S4 S5)990worker2 # [ 0.363179] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug991worker1 # [ 0.362353] ACPI: Using IOAPIC for interrupt routing992lb # [ 0.363611] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug993worker2 # [ 0.364124] PCI: Using E820 reservations for host bridge windows994worker1 # [ 0.362719] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug995lb # [ 0.364540] PCI: Using E820 reservations for host bridge windows996worker1 # [ 0.363644] PCI: Using E820 reservations for host bridge windows997worker2 # [ 0.367206] ACPI: Enabled 2 GPEs in block 00 to 3F998lb # [ 0.367659] ACPI: Enabled 2 GPEs in block 00 to 3F999worker1 # [ 0.366750] ACPI: Enabled 2 GPEs in block 00 to 3F1000client # [ 0.347546] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1001worker2 # [ 0.375431] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1002lb # [ 0.375391] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1003client # [ 0.354022] ACPI: Added _OSI(Module Device)1004client # [ 0.354547] ACPI: Added _OSI(Processor Device)1005worker2 # [ 0.376130] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1006lb # [ 0.376321] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1007client # [ 0.355238] ACPI: Added _OSI(Processor Aggregator Device)1008worker1 # [ 0.375353] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1009worker2 # [ 0.377202] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1010lb # [ 0.377625] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1011worker1 # [ 0.375650] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1012worker2 # [ 0.378244] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1013lb # [ 0.378662] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1014worker2 # [ 0.379489] PCI host bridge to bus 0000:001015lb # [ 0.379909] PCI host bridge to bus 0000:001016worker1 # [ 0.377467] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1017worker2 # [ 0.380129] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1018lb # [ 0.380544] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1019worker1 # [ 0.378604] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1020worker2 # [ 0.381124] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1021lb # [ 0.381540] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1022worker1 # [ 0.379819] PCI host bridge to bus 0000:001023worker2 # [ 0.382124] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1024worker1 # [ 0.380487] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1025lb # [ 0.382539] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1026worker2 # [ 0.383124] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1027worker1 # [ 0.381418] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1028lb # [ 0.383545] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1029worker2 # [ 0.384124] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1030worker1 # [ 0.382424] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1031lb # [ 0.384539] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1032client # [ 0.364129] ACPI: 1 ACPI AML tables successfully acquired and loaded1033worker2 # [ 0.385124] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1034worker1 # [ 0.383503] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1035lb # [ 0.385566] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1036worker2 # [ 0.386124] pci_bus 0000:00: root bus resource [bus 00-ff]1037worker1 # [ 0.384487] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1038lb # [ 0.386540] pci_bus 0000:00: root bus resource [bus 00-ff]1039worker2 # [ 0.387113] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1040worker1 # [ 0.385506] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1041lb # [ 0.387519] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1042worker1 # [ 0.386531] pci_bus 0000:00: root bus resource [bus 00-ff]1043client # [ 0.367988] ACPI: Interpreter enabled1044worker2 # [ 0.388556] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1045client # [ 0.368562] ACPI: PM: (supports S0 S3 S4 S5)1046lb # [ 0.389005] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1047worker1 # [ 0.387415] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1048client # [ 0.369238] ACPI: Using IOAPIC for interrupt routing1049worker1 # [ 0.389041] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1050client # [ 0.369614] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1051client # [ 0.370545] PCI: Using E820 reservations for host bridge windows1052client # [ 0.373604] ACPI: Enabled 2 GPEs in block 00 to 3F1053worker2 # [ 0.391312] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1054lb # [ 0.391604] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1055worker2 # [ 0.392138] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1056lb # [ 0.392552] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1057worker2 # [ 0.393097] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1058worker1 # [ 0.391708] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1059lb # [ 0.393555] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1060worker1 # [ 0.392788] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1061worker2 # [ 0.394247] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1062lb # [ 0.394722] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1063worker1 # [ 0.393709] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1064client # [ 0.382237] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1065worker2 # [ 0.395875] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1066lb # [ 0.396291] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1067worker1 # [ 0.394966] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1068client # [ 0.382553] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1069worker1 # [ 0.396358] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1070worker2 # [ 0.399131] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1071lb # [ 0.398548] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1072client # [ 0.384462] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1073worker2 # [ 0.399949] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1074lb # [ 0.399388] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1075client # [ 0.385490] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1076worker2 # [ 0.400856] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1077lb # [ 0.400279] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1078worker1 # [ 0.398651] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1079client # [ 0.386714] PCI host bridge to bus 0000:001080worker2 # [ 0.401130] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1081worker1 # [ 0.399474] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1082lb # [ 0.400545] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1083client # [ 0.387383] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1084worker1 # [ 0.400345] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1085client # [ 0.388319] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1086worker2 # [ 0.402700] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1087lb # [ 0.402102] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1088worker1 # [ 0.400648] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1089client # [ 0.389312] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1090client # [ 0.390395] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1091worker1 # [ 0.402535] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1092worker2 # [ 0.404131] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1093lb # [ 0.403576] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1094client # [ 0.391413] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1095worker2 # [ 0.404950] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1096lb # [ 0.404404] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1097client # [ 0.392406] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1098worker2 # [ 0.405831] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1099lb # [ 0.405261] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1100worker1 # [ 0.404650] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1101client # [ 0.393421] pci_bus 0000:00: root bus resource [bus 00-ff]1102worker1 # [ 0.405478] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1103worker2 # [ 0.406677] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1104lb # [ 0.406105] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1105client # [ 0.394256] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1106worker1 # [ 0.406361] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1107client # [ 0.395989] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1108worker1 # [ 0.407206] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109worker2 # [ 0.409025] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1110lb # [ 0.408429] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1111worker2 # [ 0.409786] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1112lb # [ 0.409193] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1113worker2 # [ 0.410145] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1114lb # [ 0.409561] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1115worker2 # [ 0.411679] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116worker1 # [ 0.409883] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1117lb # [ 0.411095] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118worker1 # [ 0.411345] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1119worker1 # [ 0.411665] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1120worker2 # [ 0.413131] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1121lb # [ 0.412547] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1122worker2 # [ 0.413987] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1123lb # [ 0.413391] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1124worker1 # [ 0.413195] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1125worker2 # [ 0.414856] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1126client # [ 0.398617] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1127lb # [ 0.414279] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1128client # [ 0.399558] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1129worker1 # [ 0.414652] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1130worker2 # [ 0.416008] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1131client # [ 0.400745] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1132lb # [ 0.415382] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133worker1 # [ 0.415505] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1134worker1 # [ 0.416365] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1135client # [ 0.401797] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1136worker2 # [ 0.418132] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1137lb # [ 0.417563] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1138worker2 # [ 0.418957] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1139lb # [ 0.418445] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1140worker2 # [ 0.419860] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1141client # [ 0.403395] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1142worker1 # [ 0.417186] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143lb # [ 0.419292] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1144worker2 # [ 0.420680] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1145worker1 # [ 0.418670] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1146lb # [ 0.420141] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1147client # [ 0.405552] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1148worker1 # [ 0.419532] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1149client # [ 0.406364] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1150worker1 # [ 0.420342] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1151worker2 # [ 0.422276] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1152client # [ 0.407246] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1153client # [ 0.407551] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1154worker1 # [ 0.421204] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1155lb # [ 0.422758] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1156worker2 # [ 0.423131] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1157lb # [ 0.423546] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1158worker2 # [ 0.424042] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1159client # [ 0.409041] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1160lb # [ 0.424485] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1161worker2 # [ 0.425519] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1162lb # [ 0.425989] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1163worker1 # [ 0.423678] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1164client # [ 0.410554] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1165client # [ 0.411374] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1166worker1 # [ 0.424669] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1167worker2 # [ 0.427131] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1168lb # [ 0.427547] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1169client # [ 0.412242] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1170worker1 # [ 0.425578] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1171worker2 # [ 0.427976] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1172lb # [ 0.428356] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1173worker2 # [ 0.428814] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1174worker1 # [ 0.427020] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1175client # [ 0.413109] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1176lb # [ 0.429306] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1177worker2 # [ 0.429130] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1178lb # [ 0.429545] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1179worker1 # [ 0.428672] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1180worker2 # [ 0.430845] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1181worker1 # [ 0.429488] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1182client # [ 0.415531] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1183lb # [ 0.431612] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1184worker2 # [ 0.432882] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1185worker1 # [ 0.430336] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1186client # [ 0.416162] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1187worker2 # [ 0.433146] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1188worker1 # [ 0.430649] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1189client # [ 0.416567] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1190lb # [ 0.433391] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1191lb # [ 0.434255] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1192worker2 # [ 0.434645] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1193client # [ 0.418105] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1194worker1 # [ 0.432130] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1195lb # [ 0.435078] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1196worker2 # [ 0.436141] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1197worker1 # [ 0.433497] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1198client # [ 0.419553] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1199worker2 # [ 0.436989] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1200worker1 # [ 0.434372] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1201client # [ 0.420366] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1202lb # [ 0.436548] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1203worker2 # [ 0.437836] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1204lb # [ 0.437373] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1205client # [ 0.421247] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1206worker1 # [ 0.435197] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1207worker2 # [ 0.438713] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1208lb # [ 0.438256] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1209client # [ 0.422494] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1210worker1 # [ 0.436684] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1211worker1 # [ 0.437548] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1212lb # [ 0.439949] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1213worker2 # [ 0.440131] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1214client # [ 0.424553] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1215worker2 # [ 0.440970] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1216worker1 # [ 0.438405] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1217client # [ 0.425370] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1218worker2 # [ 0.441825] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1219lb # [ 0.441547] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1220client # [ 0.426246] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1221lb # [ 0.442397] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1222worker1 # [ 0.439729] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1223worker2 # [ 0.442686] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1224lb # [ 0.443296] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1225client # [ 0.427152] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1226worker2 # [ 0.443737] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1227worker1 # [ 0.441650] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1228lb # [ 0.444109] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1229worker1 # [ 0.442452] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1230worker2 # [ 0.444332] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1231worker1 # [ 0.443377] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1232lb # [ 0.445116] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1233client # [ 0.428553] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1234worker2 # [ 0.445657] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1235client # [ 0.429552] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1236worker1 # [ 0.444229] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1237lb # [ 0.445741] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1238client # [ 0.430463] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1239worker1 # [ 0.445308] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1240lb # [ 0.447094] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1241client # [ 0.431926] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1242worker1 # [ 0.445850] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1243client # [ 0.433553] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1244worker1 # [ 0.447200] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1245client # [ 0.434385] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1246client # [ 0.435249] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1247client # [ 0.435551] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1248client # [ 0.437038] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1249worker2 # [ 0.446323] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1250client # [ 0.439332] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1251client # [ 0.440258] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1252worker2 # [ 0.448631] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1253client # [ 0.441092] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1254worker2 # [ 0.449347] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1255lb # [ 0.447743] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1256worker2 # [ 0.450624] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1257lb # [ 0.450070] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1258client # [ 0.443534] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1259lb # [ 0.450781] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1260worker2 # [ 0.451393] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1261worker1 # [ 0.447840] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1262client # [ 0.444151] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1263lb # [ 0.452049] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1264worker1 # [ 0.450194] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1265worker2 # [ 0.452406] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1266client # [ 0.444571] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1267worker1 # [ 0.450883] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1268worker2 # [ 0.453380] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1269lb # [ 0.453112] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1270client # [ 0.446110] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1271worker1 # [ 0.452166] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1272worker2 # [ 0.454968] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1273lb # [ 0.453835] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1274worker2 # [ 0.455771] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1275client # [ 0.447554] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1276worker1 # [ 0.452913] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1277lb # [ 0.454798] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1278client # [ 0.448378] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1279worker2 # [ 0.456433] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1280client # [ 0.449240] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1281worker1 # [ 0.453936] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1282lb # [ 0.456357] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1283worker2 # [ 0.457668] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1284lb # [ 0.457200] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1285worker1 # [ 0.454905] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1286client # [ 0.450116] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1287lb # [ 0.457850] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1288client # [ 0.451254] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1289worker1 # [ 0.456524] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1290worker1 # [ 0.457272] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1291worker2 # [ 0.461169] ACPI: PCI: Interrupt link LNKA configured for IRQ 101292lb # [ 0.459160] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1293client # [ 0.451762] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1294worker2 # [ 0.462216] ACPI: PCI: Interrupt link LNKB configured for IRQ 101295worker1 # [ 0.457958] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1296client # [ 0.453109] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1297worker2 # [ 0.463220] ACPI: PCI: Interrupt link LNKC configured for IRQ 111298worker1 # [ 0.459242] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1299worker2 # [ 0.464222] ACPI: PCI: Interrupt link LNKD configured for IRQ 111300lb # [ 0.462573] ACPI: PCI: Interrupt link LNKA configured for IRQ 101301worker2 # [ 0.465221] ACPI: PCI: Interrupt link LNKE configured for IRQ 101302lb # [ 0.463645] ACPI: PCI: Interrupt link LNKB configured for IRQ 101303worker2 # [ 0.466220] ACPI: PCI: Interrupt link LNKF configured for IRQ 101304lb # [ 0.464637] ACPI: PCI: Interrupt link LNKC configured for IRQ 111305worker2 # [ 0.467221] ACPI: PCI: Interrupt link LNKG configured for IRQ 111306worker1 # [ 0.462992] ACPI: PCI: Interrupt link LNKA configured for IRQ 101307lb # [ 0.465640] ACPI: PCI: Interrupt link LNKD configured for IRQ 111308worker2 # [ 0.468218] ACPI: PCI: Interrupt link LNKH configured for IRQ 111309worker1 # [ 0.463779] ACPI: PCI: Interrupt link LNKB configured for IRQ 101310lb # [ 0.466639] ACPI: PCI: Interrupt link LNKE configured for IRQ 101311worker2 # [ 0.469162] ACPI: PCI: Interrupt link GSIA configured for IRQ 161312worker1 # [ 0.464745] ACPI: PCI: Interrupt link LNKC configured for IRQ 111313worker2 # [ 0.470141] ACPI: PCI: Interrupt link GSIB configured for IRQ 171314lb # [ 0.467662] ACPI: PCI: Interrupt link LNKF configured for IRQ 101315worker1 # [ 0.465756] ACPI: PCI: Interrupt link LNKD configured for IRQ 111316worker2 # [ 0.471146] ACPI: PCI: Interrupt link GSIC configured for IRQ 181317lb # [ 0.468652] ACPI: PCI: Interrupt link LNKG configured for IRQ 111318worker1 # [ 0.466761] ACPI: PCI: Interrupt link LNKE configured for IRQ 101319worker2 # [ 0.472116] ACPI: PCI: Interrupt link GSID configured for IRQ 191320lb # [ 0.469660] ACPI: PCI: Interrupt link LNKH configured for IRQ 111321worker1 # [ 0.467762] ACPI: PCI: Interrupt link LNKF configured for IRQ 101322worker2 # [ 0.472888] ACPI: PCI: Interrupt link GSIE configured for IRQ 201323lb # [ 0.470582] ACPI: PCI: Interrupt link GSIA configured for IRQ 161324worker1 # [ 0.468753] ACPI: PCI: Interrupt link LNKG configured for IRQ 111325worker2 # [ 0.473138] ACPI: PCI: Interrupt link GSIF configured for IRQ 211326lb # [ 0.471553] ACPI: PCI: Interrupt link GSIB configured for IRQ 171327client # [ 0.453748] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1328worker2 # [ 0.474054] ACPI: PCI: Interrupt link GSIG configured for IRQ 221329worker1 # [ 0.469748] ACPI: PCI: Interrupt link LNKH configured for IRQ 111330lb # [ 0.472457] ACPI: PCI: Interrupt link GSIC configured for IRQ 181331client # [ 0.456113] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1332worker2 # [ 0.474851] ACPI: PCI: Interrupt link GSIH configured for IRQ 231333worker1 # [ 0.470682] ACPI: PCI: Interrupt link GSIA configured for IRQ 161334lb # [ 0.473280] ACPI: PCI: Interrupt link GSID configured for IRQ 191335worker1 # [ 0.471660] ACPI: PCI: Interrupt link GSIB configured for IRQ 171336lb # [ 0.474252] ACPI: PCI: Interrupt link GSIE configured for IRQ 201337client # [ 0.456834] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1338worker2 # [ 0.476203] iommu: Default domain type: Translated1339worker1 # [ 0.472626] ACPI: PCI: Interrupt link GSIC configured for IRQ 181340lb # [ 0.474551] ACPI: PCI: Interrupt link GSIF configured for IRQ 211341worker2 # [ 0.476956] iommu: DMA domain TLB invalidation policy: lazy mode1342client # [ 0.458107] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1343worker1 # [ 0.473403] ACPI: PCI: Interrupt link GSID configured for IRQ 191344lb # [ 0.475513] ACPI: PCI: Interrupt link GSIG configured for IRQ 221345worker2 # [ 0.478081] ACPI: bus type USB registered1346worker1 # [ 0.473658] ACPI: PCI: Interrupt link GSIE configured for IRQ 201347lb # [ 0.476271] ACPI: PCI: Interrupt link GSIH configured for IRQ 231348worker2 # [ 0.478678] usbcore: registered new interface driver usbfs1349client # [ 0.458814] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1350worker1 # [ 0.474592] ACPI: PCI: Interrupt link GSIF configured for IRQ 211351worker2 # [ 0.479140] usbcore: registered new interface driver hub1352worker1 # [ 0.475380] ACPI: PCI: Interrupt link GSIG configured for IRQ 221353lb # [ 0.477699] iommu: Default domain type: Translated1354worker2 # [ 0.479976] usbcore: registered new device driver usb1355client # [ 0.459836] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1356worker1 # [ 0.475660] ACPI: PCI: Interrupt link GSIH configured for IRQ 231357lb # [ 0.478479] iommu: DMA domain TLB invalidation policy: lazy mode1358worker2 # [ 0.481601] NetLabel: Initializing1359client # [ 0.460829] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1360lb # [ 0.479546] ACPI: bus type USB registered1361worker2 # [ 0.482125] NetLabel: domain hash size = 1281362lb # [ 0.480290] usbcore: registered new interface driver usbfs1363worker1 # [ 0.477853] iommu: Default domain type: Translated1364worker2 # [ 0.482920] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1365client # [ 0.462461] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1366lb # [ 0.480564] usbcore: registered new interface driver hub1367worker1 # [ 0.478650] iommu: DMA domain TLB invalidation policy: lazy mode1368worker2 # [ 0.484006] NetLabel: unlabeled traffic allowed by default1369client # [ 0.463173] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1370lb # [ 0.481478] usbcore: registered new device driver usb1371worker1 # [ 0.479886] ACPI: bus type USB registered1372worker2 # [ 0.484815] PCI: Using ACPI for IRQ routing1373worker1 # [ 0.480647] usbcore: registered new interface driver usbfs1374client # [ 0.463887] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1375lb # [ 0.483191] NetLabel: Initializing1376worker1 # [ 0.481545] usbcore: registered new interface driver hub1377lb # [ 0.483541] NetLabel: domain hash size = 1281378worker1 # [ 0.482302] usbcore: registered new device driver usb1379client # [ 0.465193] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1380lb # [ 0.484259] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1381worker1 # [ 0.483615] NetLabel: Initializing1382lb # [ 0.484598] NetLabel: unlabeled traffic allowed by default1383worker1 # [ 0.484051] NetLabel: domain hash size = 1281384lb # [ 0.485551] PCI: Using ACPI for IRQ routing1385worker1 # [ 0.484643] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1386worker1 # [ 0.485578] NetLabel: unlabeled traffic allowed by default1387client # [ 0.468732] ACPI: PCI: Interrupt link LNKA configured for IRQ 101388worker1 # [ 0.486330] PCI: Using ACPI for IRQ routing1389client # [ 0.469652] ACPI: PCI: Interrupt link LNKB configured for IRQ 101390client # [ 0.470641] ACPI: PCI: Interrupt link LNKC configured for IRQ 111391client # [ 0.471644] ACPI: PCI: Interrupt link LNKD configured for IRQ 111392client # [ 0.472641] ACPI: PCI: Interrupt link LNKE configured for IRQ 101393client # [ 0.473640] ACPI: PCI: Interrupt link LNKF configured for IRQ 101394client # [ 0.474645] ACPI: PCI: Interrupt link LNKG configured for IRQ 111395client # [ 0.475643] ACPI: PCI: Interrupt link LNKH configured for IRQ 111396client # [ 0.476583] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397client # [ 0.477560] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398client # [ 0.478499] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399client # [ 0.479258] ACPI: PCI: Interrupt link GSID configured for IRQ 191400client # [ 0.479556] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401client # [ 0.480473] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402client # [ 0.481253] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403client # [ 0.481561] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404client # [ 0.483890] iommu: Default domain type: Translated1405client # [ 0.484558] iommu: DMA domain TLB invalidation policy: lazy mode1406client # [ 0.485763] ACPI: bus type USB registered1407client # [ 0.486488] usbcore: registered new interface driver usbfs1408client # [ 0.487199] usbcore: registered new interface driver hub1409client # [ 0.487557] usbcore: registered new device driver usb1410client # [ 0.489285] NetLabel: Initializing1411client # [ 0.489547] NetLabel: domain hash size = 1281412client # [ 0.490240] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413client # [ 0.490586] NetLabel: unlabeled traffic allowed by default1414client # [ 0.491460] PCI: Using ACPI for IRQ routing1415worker2 # [ 0.527774] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker2 # [ 0.528120] pci 0000:00:01.0: vgaarb: bridge control possible1417worker2 # [ 0.528120] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker2 # [ 0.528129] vgaarb: loaded1419worker2 # [ 0.528833] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker2 # [ 0.529125] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421lb # [ 0.530341] pci 0000:00:01.0: vgaarb: setting as boot VGA device1422lb # [ 0.530535] pci 0000:00:01.0: vgaarb: bridge control possible1423worker1 # [ 0.529520] pci 0000:00:01.0: vgaarb: setting as boot VGA device1424lb # [ 0.530535] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1425lb # [ 0.530543] vgaarb: loaded1426worker1 # [ 0.529639] pci 0000:00:01.0: vgaarb: bridge control possible1427worker2 # [ 0.533215] clocksource: Switched to clocksource kvm-clock1428lb # [ 0.531246] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01429worker1 # [ 0.529639] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1430worker1 # [ 0.529647] vgaarb: loaded1431lb # [ 0.531541] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1432worker1 # [ 0.530377] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01433worker1 # [ 0.530643] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434worker2 # [ 0.536727] VFS: Disk quotas dquot_6.6.01435worker2 # [ 0.537401] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1436worker2 # [ 0.538726] pnp: PnP ACPI init1437worker2 # [ 0.539469] ACPI: IRQ 4 override to edge(!), high(!)1438lb # [ 0.536636] clocksource: Switched to clocksource kvm-clock1439worker2 # [ 0.540406] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1440worker1 # [ 0.534749] clocksource: Switched to clocksource kvm-clock1441worker2 # [ 0.541906] pnp: PnP ACPI: found 6 devices1442lb # [ 0.540300] VFS: Disk quotas dquot_6.6.01443worker1 # [ 0.538453] VFS: Disk quotas dquot_6.6.01444lb # [ 0.541126] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1445lb # [ 0.542526] pnp: PnP ACPI init1446worker1 # [ 0.539212] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1447worker1 # [ 0.540562] pnp: PnP ACPI init1448lb # [ 0.543381] ACPI: IRQ 4 override to edge(!), high(!)1449worker1 # [ 0.541406] ACPI: IRQ 4 override to edge(!), high(!)1450lb # [ 0.544346] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1451worker1 # [ 0.542380] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1452lb # [ 0.545856] pnp: PnP ACPI: found 6 devices1453worker2 # [ 0.549566] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1454worker1 # [ 0.543891] pnp: PnP ACPI: found 6 devices1455worker2 # [ 0.550964] clocksource: Switched to clocksource acpi_pm1456worker2 # [ 0.551905] NET: Registered PF_INET protocol family1457worker2 # [ 0.553050] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1458lb # [ 0.553488] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1459client # [ 0.534815] pci 0000:00:01.0: vgaarb: setting as boot VGA device1460lb # [ 0.554910] clocksource: Switched to clocksource acpi_pm1461worker1 # [ 0.551548] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1462client # [ 0.535541] pci 0000:00:01.0: vgaarb: bridge control possible1463worker1 # [ 0.553042] clocksource: Switched to clocksource acpi_pm1464lb # [ 0.555895] NET: Registered PF_INET protocol family1465client # [ 0.535541] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1466worker1 # [ 0.553988] NET: Registered PF_INET protocol family1467client # [ 0.535552] vgaarb: loaded1468lb # [ 0.557202] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1469client # [ 0.536317] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01470worker1 # [ 0.555169] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1471client # [ 0.536547] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1472client # [ 0.538650] clocksource: Switched to clocksource kvm-clock1473client # [ 0.542361] VFS: Disk quotas dquot_6.6.01474worker2 # [ 0.570129] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1475client # [ 0.543086] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1476client # [ 0.544460] pnp: PnP ACPI init1477worker2 # [ 0.571654] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1478client # [ 0.545285] ACPI: IRQ 4 override to edge(!), high(!)1479worker2 # [ 0.572933] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1480client # [ 0.546265] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1481worker2 # [ 0.574231] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1482client # [ 0.547782] pnp: PnP ACPI: found 6 devices1483worker2 # [ 0.575425] TCP: Hash tables configured (established 16384 bind 16384)1484worker2 # [ 0.576503] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1485worker2 # [ 0.577746] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1486worker2 # [ 0.578779] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1487lb # [ 0.574407] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1488worker2 # [ 0.579940] NET: Registered PF_UNIX/PF_LOCAL protocol family1489worker1 # [ 0.572802] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1490lb # [ 0.575989] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1491worker2 # [ 0.580866] NET: Registered PF_XDP protocol family1492worker1 # [ 0.574414] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1493lb # [ 0.577294] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1494worker2 # [ 0.581654] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1495worker2 # [ 0.582618] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1496lb # [ 0.578622] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1497worker1 # [ 0.575725] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1498client # [ 0.555516] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1499worker2 # [ 0.583576] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1500lb # [ 0.579838] TCP: Hash tables configured (established 16384 bind 16384)1501worker1 # [ 0.577055] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1502client # [ 0.556923] clocksource: Switched to clocksource acpi_pm1503worker2 # [ 0.584635] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1504client # [ 0.557873] NET: Registered PF_INET protocol family1505worker1 # [ 0.578274] TCP: Hash tables configured (established 16384 bind 16384)1506lb # [ 0.580945] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1507worker2 # [ 0.585698] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1508lb # [ 0.582191] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1509worker1 # [ 0.579379] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1510client # [ 0.559017] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1511worker2 # [ 0.586783] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1512lb # [ 0.583255] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1513worker1 # [ 0.580626] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1514worker2 # [ 0.588453] ACPI: \_SB_.GSIA: Enabled at IRQ 161515lb # [ 0.584449] NET: Registered PF_UNIX/PF_LOCAL protocol family1516worker1 # [ 0.581702] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1517lb # [ 0.585395] NET: Registered PF_XDP protocol family1518worker1 # [ 0.582947] NET: Registered PF_UNIX/PF_LOCAL protocol family1519lb # [ 0.586246] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1520worker2 # [ 0.590751] ACPI: \_SB_.GSIB: Enabled at IRQ 171521worker1 # [ 0.583877] NET: Registered PF_XDP protocol family1522lb # [ 0.587250] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1523worker1 # [ 0.584722] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1524lb # [ 0.588246] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1525worker1 # [ 0.585705] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1526worker2 # [ 0.592973] ACPI: \_SB_.GSIC: Enabled at IRQ 181527lb # [ 0.589325] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1528worker1 # [ 0.586704] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1529lb # [ 0.590408] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1530worker2 # [ 0.594933] ACPI: \_SB_.GSID: Enabled at IRQ 191531worker1 # [ 0.587791] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1532lb # [ 0.591500] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1533worker1 # [ 0.588862] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1534worker2 # [ 0.596587] PCI: CLS 0 bytes, default 641535worker1 # [ 0.589976] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1536lb # [ 0.593306] ACPI: \_SB_.GSIA: Enabled at IRQ 161537worker2 # [ 0.597468] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1538worker1 # [ 0.591668] ACPI: \_SB_.GSIA: Enabled at IRQ 161539worker2 # [ 0.599166] Trying to unpack rootfs image as initramfs...1540lb # [ 0.595590] ACPI: \_SB_.GSIB: Enabled at IRQ 171541worker1 # [ 0.593909] ACPI: \_SB_.GSIB: Enabled at IRQ 171542lb # [ 0.597758] ACPI: \_SB_.GSIC: Enabled at IRQ 181543worker1 # [ 0.595876] ACPI: \_SB_.GSIC: Enabled at IRQ 181544lb # [ 0.599765] ACPI: \_SB_.GSID: Enabled at IRQ 191545client # [ 0.576212] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1546worker1 # [ 0.597865] ACPI: \_SB_.GSID: Enabled at IRQ 191547lb # [ 0.601459] PCI: CLS 0 bytes, default 641548client # [ 0.577746] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1549worker1 # [ 0.599570] PCI: CLS 0 bytes, default 641550client # [ 0.579073] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1551lb # [ 0.602396] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1552worker1 # [ 0.600476] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1553client # [ 0.580388] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1554lb # [ 0.604172] Trying to unpack rootfs image as initramfs...1555worker1 # [ 0.602220] Trying to unpack rootfs image as initramfs...1556client # [ 0.581610] TCP: Hash tables configured (established 16384 bind 16384)1557client # [ 0.582715] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1558client # [ 0.583973] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559client # [ 0.585040] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560client # [ 0.586335] NET: Registered PF_UNIX/PF_LOCAL protocol family1561client # [ 0.587290] NET: Registered PF_XDP protocol family1562client # [ 0.588113] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563client # [ 0.589095] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564client # [ 0.590080] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565client # [ 0.591169] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566client # [ 0.592257] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567client # [ 0.593340] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568client # [ 0.595034] ACPI: \_SB_.GSIA: Enabled at IRQ 161569client # [ 0.597724] ACPI: \_SB_.GSIB: Enabled at IRQ 171570client # [ 0.599683] ACPI: \_SB_.GSIC: Enabled at IRQ 181571client # [ 0.601690] ACPI: \_SB_.GSID: Enabled at IRQ 191572client # [ 0.603684] PCI: CLS 0 bytes, default 641573client # [ 0.604579] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574client # [ 0.606300] Trying to unpack rootfs image as initramfs...1575worker2 # [ 0.644284] Initialise system trusted keyrings1576worker2 # [ 0.647773] workingset: timestamp_bits=40 max_order=19 bucket_order=01577lb # [ 0.651582] Initialise system trusted keyrings1578worker1 # [ 0.649391] Initialise system trusted keyrings1579lb # [ 0.652549] workingset: timestamp_bits=40 max_order=19 bucket_order=01580worker1 # [ 0.650440] workingset: timestamp_bits=40 max_order=19 bucket_order=01581worker2 # [ 0.669148] Key type asymmetric registered1582worker2 # [ 0.669871] Asymmetric key parser 'x509' registered1583worker2 # [ 0.670684] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584worker2 # [ 0.675857] io scheduler mq-deadline registered1585worker2 # [ 0.676587] io scheduler kyber registered1586worker1 # [ 0.671976] Key type asymmetric registered1587lb # [ 0.675260] Key type asymmetric registered1588worker2 # [ 0.679345] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1589worker1 # [ 0.672694] Asymmetric key parser 'x509' registered1590client # [ 0.652319] Initialise system trusted keyrings1591lb # [ 0.676004] Asymmetric key parser 'x509' registered1592worker1 # [ 0.673528] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1593worker2 # [ 0.680563] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1594lb # [ 0.676907] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1595client # [ 0.655904] workingset: timestamp_bits=40 max_order=19 bucket_order=01596lb # [ 0.680270] io scheduler mq-deadline registered1597lb # [ 0.681010] io scheduler kyber registered1598worker2 # [ 0.685571] Linux agpgart interface v0.1031599worker1 # [ 0.679089] io scheduler mq-deadline registered1600worker2 # [ 0.686321] ACPI: bus type drm_connector registered1601worker1 # [ 0.679819] io scheduler kyber registered1602worker2 # [ 0.689192] usbcore: registered new interface driver usbserial_generic1603lb # [ 0.685326] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1604worker2 # [ 0.690215] usbserial: USB Serial support registered for generic1605worker1 # [ 0.683565] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1606lb # [ 0.686595] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1607worker1 # [ 0.684831] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1608worker2 # [ 0.693730] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1609worker2 # [ 0.693730] Please enable it if your BIOS has the CPPC option.1610worker1 # [ 0.688737] Linux agpgart interface v0.1031611lb # [ 0.692176] Linux agpgart interface v0.1031612worker2 # [ 0.695850] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1613worker1 # [ 0.689510] ACPI: bus type drm_connector registered1614lb # [ 0.692925] ACPI: bus type drm_connector registered1615worker2 # [ 0.698879] drop_monitor: Initializing network drop monitor service1616worker1 # [ 0.692393] usbcore: registered new interface driver usbserial_generic1617lb # [ 0.695629] usbcore: registered new interface driver usbserial_generic1618worker2 # [ 0.700013] NET: Registered PF_INET6 protocol family1619worker1 # [ 0.693441] usbserial: USB Serial support registered for generic1620lb # [ 0.696655] usbserial: USB Serial support registered for generic1621worker2 # [ 0.703229] Segment Routing with IPv61622worker1 # [ 0.696956] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1623client # [ 0.677264] Key type asymmetric registered1624lb # [ 0.700155] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1625worker1 # [ 0.696956] Please enable it if your BIOS has the CPPC option.1626client # [ 0.678012] Asymmetric key parser 'x509' registered1627lb # [ 0.700155] Please enable it if your BIOS has the CPPC option.1628worker1 # [ 0.699092] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1629worker2 # [ 0.706743] In-situ OAM (IOAM) with IPv61630lb # [ 0.702283] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1631worker2 # [ 0.707778] IPI shorthand broadcast: enabled1632client # [ 0.680886] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1633worker1 # [ 0.702072] drop_monitor: Initializing network drop monitor service1634worker1 # [ 0.703204] NET: Registered PF_INET6 protocol family1635lb # [ 0.706291] drop_monitor: Initializing network drop monitor service1636client # [ 0.683918] io scheduler mq-deadline registered1637lb # [ 0.707534] NET: Registered PF_INET6 protocol family1638client # [ 0.684646] io scheduler kyber registered1639lb # [ 0.710230] Segment Routing with IPv61640lb # [ 0.710868] In-situ OAM (IOAM) with IPv61641client # [ 0.687503] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1642worker1 # [ 0.708448] Segment Routing with IPv61643worker2 # [ 0.716101] sched_clock: Marking stable (582014269, 133703622)->(786595636, -70877745)1644client # [ 0.688750] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1645lb # [ 0.714443] IPI shorthand broadcast: enabled1646worker1 # [ 0.711971] In-situ OAM (IOAM) with IPv61647worker1 # [ 0.713020] IPI shorthand broadcast: enabled1648worker2 # [ 0.720940] registered taskstats version 11649client # [ 0.694151] Linux agpgart interface v0.1031650worker2 # [ 0.721894] Loading compiled-in X.509 certificates1651client # [ 0.694894] ACPI: bus type drm_connector registered1652client # [ 0.698141] usbcore: registered new interface driver usbserial_generic1653client # [ 0.699162] usbserial: USB Serial support registered for generic1654lb # [ 0.722651] sched_clock: Marking stable (588015123, 134109639)->(797966080, -75841318)1655lb # [ 0.724209] registered taskstats version 11656worker1 # [ 0.721279] sched_clock: Marking stable (586013712, 134920826)->(798562427, -77627889)1657client # [ 0.701854] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1658client # [ 0.701854] Please enable it if your BIOS has the CPPC option.1659lb # [ 0.727148] Loading compiled-in X.509 certificates1660client # [ 0.703980] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1661worker1 # [ 0.726207] registered taskstats version 11662worker1 # [ 0.727130] Loading compiled-in X.509 certificates1663client # [ 0.707054] drop_monitor: Initializing network drop monitor service1664client # [ 0.708237] NET: Registered PF_INET6 protocol family1665worker2 # [ 0.738241] Demotion targets for Node 0: null1666client # [ 0.711367] Segment Routing with IPv61667client # [ 0.713870] In-situ OAM (IOAM) with IPv61668worker2 # [ 0.741776] Key type .fscrypt registered1669client # [ 0.714910] IPI shorthand broadcast: enabled1670worker2 # [ 0.742458] Key type fscrypt-provisioning registered1671worker2 # [ 0.743420] ima: No TPM chip found, activating TPM-bypass!1672worker2 # [ 0.745735] ima: Allocated hash algorithm: sha11673worker2 # [ 0.746550] ima: No architecture policies found1674lb # [ 0.743793] Demotion targets for Node 0: null1675lb # [ 0.744709] Key type .fscrypt registered1676worker2 # [ 0.748730] PM: Magic number: 10:536:2201677worker2 # [ 0.749449] dmi id: hash matches1678worker1 # [ 0.743602] Demotion targets for Node 0: null1679client # [ 0.723259] sched_clock: Marking stable (587015637, 135824511)->(798053860, -75213712)1680lb # [ 0.747137] Key type fscrypt-provisioning registered1681lb # [ 0.748036] ima: No TPM chip found, activating TPM-bypass!1682lb # [ 0.748923] ima: Allocated hash algorithm: sha11683worker2 # [ 0.752968] RAS: Correctable Errors collector initialized.1684worker1 # [ 0.747001] Key type .fscrypt registered1685client # [ 0.727095] registered taskstats version 11686worker1 # [ 0.747642] Key type fscrypt-provisioning registered1687lb # [ 0.751162] ima: No architecture policies found1688client # [ 0.728027] Loading compiled-in X.509 certificates1689worker1 # [ 0.748562] ima: No TPM chip found, activating TPM-bypass!1690lb # [ 0.753146] PM: Magic number: 10:536:2201691lb # [ 0.753886] dmi id: hash matches1692worker1 # [ 0.750949] ima: Allocated hash algorithm: sha11693worker1 # [ 0.751701] ima: No architecture policies found1694worker1 # [ 0.753955] PM: Magic number: 10:536:2201695worker1 # [ 0.754687] dmi id: hash matches1696worker2 # [ 0.761558] clk: Disabling unused clocks1697lb # [ 0.757367] RAS: Correctable Errors collector initialized.1698worker2 # [ 0.764753] PM: genpd: Disabling unused power domains1699worker1 # [ 0.758156] RAS: Correctable Errors collector initialized.1700lb # [ 0.766051] clk: Disabling unused clocks1701lb # [ 0.769144] PM: genpd: Disabling unused power domains1702worker1 # [ 0.766817] clk: Disabling unused clocks1703client # [ 0.747853] Demotion targets for Node 0: null1704worker1 # [ 0.768967] PM: genpd: Disabling unused power domains1705client # [ 0.748759] Key type .fscrypt registered1706client # [ 0.750851] Key type fscrypt-provisioning registered1707client # [ 0.751751] ima: No TPM chip found, activating TPM-bypass!1708client # [ 0.752632] ima: Allocated hash algorithm: sha11709client # [ 0.754887] ima: No architecture policies found1710client # [ 0.756855] PM: Magic number: 10:536:2201711client # [ 0.757588] dmi id: hash matches1712client # [ 0.761112] RAS: Correctable Errors collector initialized.1713client # [ 0.769782] clk: Disabling unused clocks1714client # [ 0.771871] PM: genpd: Disabling unused power domains1715worker2 # [ 0.937276] Freeing initrd memory: 29092K1716worker2 # [ 0.940451] Freeing unused decrypted memory: 2028K1717worker2 # [ 0.943075] Freeing unused kernel image (initmem) memory: 3644K1718worker2 # [ 0.944113] Write protecting the kernel read-only data: 32768k1719worker1 # [ 0.938452] Freeing initrd memory: 29092K1720worker2 # [ 0.946415] Freeing unused kernel image (text/rodata gap) memory: 1208K1721worker2 # [ 0.947979] Freeing unused kernel image (rodata/data gap) memory: 752K1722lb # [ 0.944385] Freeing initrd memory: 29092K1723worker1 # [ 0.941676] Freeing unused decrypted memory: 2028K1724worker1 # [ 0.944321] Freeing unused kernel image (initmem) memory: 3644K1725lb # [ 0.947562] Freeing unused decrypted memory: 2028K1726worker1 # [ 0.945382] Write protecting the kernel read-only data: 32768k1727lb # [ 0.950197] Freeing unused kernel image (initmem) memory: 3644K1728worker1 # [ 0.947281] Freeing unused kernel image (text/rodata gap) memory: 1208K1729lb # [ 0.951281] Write protecting the kernel read-only data: 32768k1730worker1 # [ 0.948814] Freeing unused kernel image (rodata/data gap) memory: 752K1731lb # [ 0.953136] Freeing unused kernel image (text/rodata gap) memory: 1208K1732lb # [ 0.954611] Freeing unused kernel image (rodata/data gap) memory: 752K1733client # [ 0.952068] Freeing initrd memory: 29096K1734client # [ 0.955435] Freeing unused decrypted memory: 2028K1735client # [ 0.958181] Freeing unused kernel image (initmem) memory: 3644K1736client # [ 0.959227] Write protecting the kernel read-only data: 32768k1737client # [ 0.961091] Freeing unused kernel image (text/rodata gap) memory: 1208K1738client # [ 0.962569] Freeing unused kernel image (rodata/data gap) memory: 752K1739worker2 # [ 0.999019] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740worker2 # [ 1.000059] Run /init as init process1741worker1 # [ 1.000076] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742worker1 # [ 1.001119] Run /init as init process1743lb # [ 1.005739] x86/mm: Checked W+X mappings: passed, no W+X pages found.1744worker2 # [ 1.010403] systemd[1]: Inserted module 'autofs4'1745lb # [ 1.006852] Run /init as init process1746worker1 # [ 1.011501] systemd[1]: Inserted module 'autofs4'1747lb # [ 1.017620] systemd[1]: Inserted module 'autofs4'1748worker2 # [ 1.027133] fuse: init (API version 7.45)1749worker2 # [ 1.033155] ACPI: \_SB_.GSIG: Enabled at IRQ 221750worker1 # [ 1.028002] fuse: init (API version 7.45)1751worker2 # [ 1.035539] ACPI: \_SB_.GSIH: Enabled at IRQ 231752lb # [ 1.033906] fuse: init (API version 7.45)1753worker2 # [ 1.038353] ACPI: \_SB_.GSIE: Enabled at IRQ 201754worker2 # [ 1.040611] ACPI: \_SB_.GSIF: Enabled at IRQ 211755worker1 # [ 1.033868] ACPI: \_SB_.GSIG: Enabled at IRQ 221756client # [ 1.014152] x86/mm: Checked W+X mappings: passed, no W+X pages found.1757client # [ 1.015200] Run /init as init process1758worker1 # [ 1.036231] ACPI: \_SB_.GSIH: Enabled at IRQ 231759lb # [ 1.039809] ACPI: \_SB_.GSIG: Enabled at IRQ 221760worker1 # [ 1.039058] ACPI: \_SB_.GSIE: Enabled at IRQ 201761lb # [ 1.042149] ACPI: \_SB_.GSIH: Enabled at IRQ 231762worker1 # [ 1.041229] ACPI: \_SB_.GSIF: Enabled at IRQ 211763lb # [ 1.044966] ACPI: \_SB_.GSIE: Enabled at IRQ 201764lb # [ 1.047153] ACPI: \_SB_.GSIF: Enabled at IRQ 211765client # [ 1.025965] systemd[1]: Inserted module 'autofs4'1766worker2 # [ 1.066552] systemd[1]: Successfully made /usr/ read-only.1767client # [ 1.042718] fuse: init (API version 7.45)1768client # [ 1.048945] ACPI: \_SB_.GSIG: Enabled at IRQ 221769worker1 # [ 1.070157] systemd[1]: Successfully made /usr/ read-only.1770client # [ 1.051686] ACPI: \_SB_.GSIH: Enabled at IRQ 231771lb # [ 1.074919] systemd[1]: Successfully made /usr/ read-only.1772client # [ 1.055236] ACPI: \_SB_.GSIE: Enabled at IRQ 201773client # [ 1.057699] ACPI: \_SB_.GSIF: Enabled at IRQ 211774client # [ 1.084743] systemd[1]: Successfully made /usr/ read-only.1775worker2 # [ 1.403169] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1776worker2 # [ 1.414874] systemd[1]: Detected virtualization kvm.1777worker1 # [ 1.406249] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker1 # [ 1.411051] systemd[1]: Detected virtualization kvm.1779worker2 # [ 1.416939] systemd[1]: Detected architecture x86-64.1780lb # [ 1.410432] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1781worker1 # [ 1.411857] systemd[1]: Detected architecture x86-64.1782lb # [ 1.415213] systemd[1]: Detected virtualization kvm.1783worker1 # [ 1.412731] systemd[1]: Running in initrd.1784worker2 # [ 1.419003] systemd[1]: Running in initrd.1785lb # [ 1.416031] systemd[1]: Detected architecture x86-64.1786lb # [ 1.416884] systemd[1]: Running in initrd.1787worker1 # [ 1.414008] systemd[1]: Initializing machine ID from random generator.1788worker1 # [ 1.415173] systemd[1]: Hostname set to <worker1>.1789lb # [ 1.417994] systemd[1]: Initializing machine ID from random generator.1790worker2 # [ 1.421383] systemd[1]: Initializing machine ID from random generator.1791lb # [ 1.419167] systemd[1]: Hostname set to <lb>.1792worker2 # [ 1.424197] systemd[1]: Hostname set to <worker2>.1793client # [ 1.420396] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1794client # [ 1.425046] systemd[1]: Detected virtualization kvm.1795client # [ 1.425870] systemd[1]: Detected architecture x86-64.1796client # [ 1.426695] systemd[1]: Running in initrd.1797client # [ 1.427775] systemd[1]: Initializing machine ID from random generator.1798client # [ 1.428933] systemd[1]: Hostname set to <client>.1799lb # [ 1.614659] systemd[1]: bpf-restrict-fs: LSM BPF program attached1800worker1 # [ 1.625340] systemd[1]: bpf-restrict-fs: LSM BPF program attached1801worker2 # [ 1.634046] systemd[1]: bpf-restrict-fs: LSM BPF program attached1802client # [ 1.621324] systemd[1]: bpf-restrict-fs: LSM BPF program attached1803lb # [ 1.665729] systemd[1]: Queued start job for default target Initrd Default Target.1804worker2 # [ 1.673226] systemd[1]: Queued start job for default target Initrd Default Target.1805lb # [ 1.669575] systemd[1]: Created slice Slice /system/modprobe.1806lb # [ 1.670841] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1807lb # [ 1.672248] systemd[1]: Expecting device /dev/disk/by-label/nixos...1808worker2 # [ 1.677067] systemd[1]: Created slice Slice /system/modprobe.1809lb # [ 1.673327] systemd[1]: Reached target Path Units.1810lb # [ 1.674194] systemd[1]: Reached target Slice Units.1811worker2 # [ 1.678195] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1812lb # [ 1.675047] systemd[1]: Reached target Swaps.1813worker2 # [ 1.679527] systemd[1]: Expecting device /dev/disk/by-label/nixos...1814lb # [ 1.675852] systemd[1]: Reached target Timer Units.1815worker2 # [ 1.680556] systemd[1]: Reached target Path Units.1816lb # [ 1.676843] systemd[1]: Listening on D-Bus System Message Bus Socket.1817worker2 # [ 1.681441] systemd[1]: Reached target Slice Units.1818worker2 # [ 1.682281] systemd[1]: Reached target Swaps.1819lb # [ 1.678047] systemd[1]: Listening on Journal Socket (/dev/log).1820worker2 # [ 1.683050] systemd[1]: Reached target Timer Units.1821lb # [ 1.679216] systemd[1]: Listening on Journal Sockets.1822worker2 # [ 1.683991] systemd[1]: Listening on D-Bus System Message Bus Socket.1823lb # [ 1.680212] systemd[1]: Listening on udev Control Socket.1824worker1 # [ 1.677315] systemd[1]: Queued start job for default target Initrd Default Target.1825worker2 # [ 1.685158] systemd[1]: Listening on Journal Socket (/dev/log).1826lb # [ 1.681229] systemd[1]: Listening on udev Kernel Socket.1827lb # [ 1.682189] systemd[1]: Reached target Socket Units.1828worker2 # [ 1.686271] systemd[1]: Listening on Journal Sockets.1829worker2 # [ 1.687217] systemd[1]: Listening on udev Control Socket.1830worker2 # [ 1.688172] systemd[1]: Listening on udev Kernel Socket.1831worker1 # [ 1.681285] systemd[1]: Created slice Slice /system/modprobe.1832lb # [ 1.684201] systemd[1]: Starting Create List of Static Device Nodes...1833client # [ 1.661038] systemd[1]: Queued start job for default target Initrd Default Target.1834worker2 # [ 1.689094] systemd[1]: Reached target Socket Units.1835worker1 # [ 1.682439] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1836worker1 # [ 1.683797] systemd[1]: Expecting device /dev/disk/by-label/nixos...1837worker2 # [ 1.690997] systemd[1]: Starting Create List of Static Device Nodes...1838worker1 # [ 1.684834] systemd[1]: Reached target Path Units.1839lb # [ 1.688089] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1840worker1 # [ 1.685698] systemd[1]: Reached target Slice Units.1841client # [ 1.665380] systemd[1]: Created slice Slice /system/modprobe.1842worker1 # [ 1.686545] systemd[1]: Reached target Swaps.1843worker1 # [ 1.687342] systemd[1]: Reached target Timer Units.1844client # [ 1.666525] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1845worker2 # [ 1.694609] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1846worker1 # [ 1.688319] systemd[1]: Listening on D-Bus System Message Bus Socket.1847client # [ 1.667894] systemd[1]: Expecting device /dev/disk/by-label/nixos...1848client # [ 1.668941] systemd[1]: Reached target Path Units.1849worker1 # [ 1.689498] systemd[1]: Listening on Journal Socket (/dev/log).1850client # [ 1.669757] systemd[1]: Reached target Slice Units.1851worker1 # [ 1.690623] systemd[1]: Listening on Journal Sockets.1852client # [ 1.670614] systemd[1]: Reached target Swaps.1853worker1 # [ 1.691626] systemd[1]: Listening on udev Control Socket.1854client # [ 1.671406] systemd[1]: Reached target Timer Units.1855worker1 # [ 1.692628] systemd[1]: Listening on udev Kernel Socket.1856client # [ 1.672373] systemd[1]: Listening on D-Bus System Message Bus Socket.1857worker1 # [ 1.693606] systemd[1]: Reached target Socket Units.1858client # [ 1.673558] systemd[1]: Listening on Journal Socket (/dev/log).1859lb # [ 1.697376] systemd[1]: Starting Load Kernel Module configfs...1860worker2 # [ 1.701818] systemd[1]: Starting Load Kernel Module configfs...1861client # [ 1.674706] systemd[1]: Listening on Journal Sockets.1862worker1 # [ 1.695560] systemd[1]: Starting Create List of Static Device Nodes...1863client # [ 1.675755] systemd[1]: Listening on udev Control Socket.1864client # [ 1.676883] systemd[1]: Listening on udev Kernel Socket.1865client # [ 1.677809] systemd[1]: Reached target Socket Units.1866client # [ 1.679786] systemd[1]: Starting Create List of Static Device Nodes...1867worker1 # [ 1.701019] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1868client # [ 1.684932] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1869worker1 # [ 1.706012] systemd[1]: Starting Load Kernel Module configfs...1870worker2 # [ 1.714952] systemd[1]: Starting Journal Service...1871client # [ 1.689959] systemd[1]: Starting Load Kernel Module configfs...1872lb # [ 1.714793] systemd[1]: Starting Journal Service...1873worker1 # [ 1.718034] systemd[1]: Starting Journal Service...1874client # [ 1.705942] systemd[1]: Starting Journal Service...1875worker2 # [ 1.727802] systemd[1]: Starting Load Kernel Modules...1876lb # [ 1.730249] systemd[1]: Starting Load Kernel Modules...1877worker1 # [ 1.731014] systemd[1]: Starting Load Kernel Modules...1878worker2 # [ 1.750472] netfs: FS-Cache loaded1879lb # [ 1.748550] netfs: FS-Cache loaded1880lb # [ 1.753793] 9pnet: Installing 9P2000 support1881worker2 # [ 1.758650] 9pnet: Installing 9P2000 support1882client # [ 1.720939] systemd[1]: Starting Load Kernel Modules...1883worker2 # [ 1.759601] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1884worker1 # [ 1.754418] netfs: FS-Cache loaded1885client # [ 1.741172] netfs: FS-Cache loaded1886worker1 # [ 1.762817] 9pnet: Installing 9P2000 support1887lb # [ 1.765279] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1888worker2 # [ 1.770963] systemd[1]: Starting Coldplug All udev Devices...1889worker1 # [ 1.763729] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1890client # [ 1.748364] 9pnet: Installing 9P2000 support1891lb # [ 1.774276] systemd[1]: Starting Coldplug All udev Devices...1892worker1 # [ 1.775150] systemd[1]: Starting Coldplug All udev Devices...1893client # [ 1.756069] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1894worker2 # [ 1.787866] systemd[1]: Finished Create List of Static Device Nodes.1895worker2 # [ 1.795801] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1896lb # [ 1.792220] systemd[1]: Finished Create List of Static Device Nodes.1897client # [ 1.769168] systemd[1]: Starting Coldplug All udev Devices...1898worker1 # [ 1.790041] systemd[1]: Finished Create List of Static Device Nodes.1899worker2 # [ 1.800021] systemd-journald[67]: Collecting audit messages is disabled.1900worker1 # [ 1.795861] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1901worker2 # [ 1.803165] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1902lb # [ 1.803457] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1903worker2 # [ 1.810194] systemd[1]: modprobe@configfs.service: Deactivated successfully.1904worker1 # [ 1.804346] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1905worker1 # [ 1.805800] systemd-journald[67]: Collecting audit messages is disabled.1906lb # [ 1.809690] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1907worker2 # [ 1.814784] systemd[1]: Finished Load Kernel Module configfs.1908client # [ 1.787957] systemd[1]: Finished Create List of Static Device Nodes.1909worker1 # [ 1.808387] systemd[1]: modprobe@configfs.service: Deactivated successfully.1910lb # [ 1.812325] systemd-journald[67]: Collecting audit messages is disabled.1911worker2 # [ 1.816481] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1912worker2 # [ 1.820234] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1913client # [ 1.795374] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1914worker1 # [ 1.815839] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1915lb # [ 1.819682] systemd[1]: modprobe@configfs.service: Deactivated successfully.1916worker1 # [ 1.818334] systemd[1]: Finished Load Kernel Module configfs.1917client # [ 1.798608] systemd-journald[67]: Collecting audit messages is disabled.1918worker2 # [ 1.825874] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1919lb # [ 1.822628] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1920worker1 # [ 1.822497] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1921lb # [ 1.826650] systemd[1]: Finished Load Kernel Module configfs.1922client # [ 1.803420] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1923worker2 # [ 1.832968] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1924lb # [ 1.830807] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1925worker1 # [ 1.829081] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1926client # [ 1.808986] systemd[1]: modprobe@configfs.service: Deactivated successfully.1927lb # [ 1.835398] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1928worker1 # [ 1.834011] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1929client # [ 1.816384] systemd[1]: Finished Load Kernel Module configfs.1930client # [ 1.819993] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1931lb # [ 1.844065] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1932client # [ 1.822974] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1933worker2 # [ 1.856442] systemd[1]: Finished Load Kernel Modules.1934client # [ 1.828873] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1935worker2 # [ 1.864978] systemd[1]: Starting Apply Kernel Variables...1936worker1 # [ 1.860540] systemd[1]: Finished Load Kernel Modules.1937client # [ 1.839970] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1938lb # [ 1.870937] systemd[1]: Finished Load Kernel Modules.1939worker1 # [ 1.869363] systemd[1]: Starting Apply Kernel Variables...1940worker2 # [ 1.882058] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1941lb # [ 1.884261] systemd[1]: Starting Apply Kernel Variables...1942worker1 # [ 1.883477] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1943worker2 # [ 1.893046] systemd[1]: Starting Create Static Device Nodes in /dev...1944client # [ 1.867957] systemd[1]: Finished Load Kernel Modules.1945worker1 # [ 1.893381] systemd[1]: Starting Create Static Device Nodes in /dev...1946client # [ 1.876962] systemd[1]: Starting Apply Kernel Variables...1947worker2 # [ 1.906847] systemd[1]: Finished Apply Kernel Variables.1948lb # [ 1.909357] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1949worker1 # [ 1.917077] systemd[1]: Finished Apply Kernel Variables.1950worker2 # [ 1.925307] systemd[1]: Started Journal Service.1951lb # [ 1.921232] systemd[1]: Starting Create Static Device Nodes in /dev...1952client # [ 1.898947] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1953worker2 # [ 1.793220] systemd-modules-load[68]: Inserted module 'dm_mod'1954worker2 # [ 1.796460] systemd-modules-load[68]: Inserted module 'virtio_balloon'1955worker2 # [ 1.798340] systemd-modules-load[68]: Inserted module 'virtio_gpu'1956worker1 # [ 1.796422] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.932519] systemd[1]: Started Journal Service.1957worker2 # [ 1.805923] systemd[1]: Finished Create Static Device Nodes in /dev.1958client # [ 1.912970] systemd[1]: Starting Create Static Device Nodes in /dev...1959worker1 # 1960worker1 # [ 1.800327] systemd-modules-load[68]: Inserted module 'virtio_balloon'1961worker1 # [ 1.801449] systemd-modules-load[68]: Inserted module 'virtio_gpu'1962lb # [ 1.940314] systemd[1]: Finished Apply Kernel Variables.1963worker2 # [ 1.813145] systemd[1]: Reached target Preparation for Local File Systems.1964worker2 # [ 1.814191] systemd[1]: Reached target Local File Systems.1965worker1 # [ 1.806081] systemd[1]: Finished Create Static Device Nodes in /dev.1966worker2 # [ 1.816964] systemd[1]: Starting Create System Files and Directories...1967lb # [ 1.812573] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.948689] systemd[1]: Started Journal Service.1968lb # 1969lb # [ 1.817400] systemd-modules-load[68]: Inserted module 'virtio_balloon'1970worker1 # [ 1.814087] systemd[1]: Reached target Preparation for Local File Systems.1971lb # [ 1.818572] systemd-modules-load[68]: Inserted module 'virtio_gpu'1972worker1 # [ 1.815963] systemd[1]: Reached target Local File Systems.1973worker2 # [ 1.824075] systemd[1]: Starting Rule-based Manager for Device Events and Files...1974worker1 # [ 1.819068] systemd[1]: Starting Create System Files and Directories...1975client # [ 1.937001] systemd[1]: Finished Apply Kernel Variables.1976worker1 # [ 1.824075] systemd[1]: Starting Rule-based Manager for Device Events and Files...1977client # [ 1.802628] systemd-modules-load[68]: Inserted module 'dm_mod'1978client # [ 1.806191] systemd-modules-load[68]: Inserted module 'virtio_balloon'1979client # [ 1.943422] systemd[1]: Started Journal Service.1980client # [ 1.808577] systemd-modules-load[68]: Inserted module 'virtio_gpu'1981lb # [ 1.844338] systemd[1]: Finished Create Static Device Nodes in /dev.1982lb # [ 1.845932] systemd[1]: Reached target Preparation for Local File Systems.1983lb # [ 1.849197] systemd[1]: Reached target Local File Systems.1984worker2 # [ 1.855233] systemd[1]: Finished Create System Files and Directories.1985lb # [ 1.852176] systemd[1]: Starting Create System Files and Directories...1986client # [ 1.829970] systemd[1]: Finished Create Static Device Nodes in /dev.1987client # [ 1.832190] systemd[1]: Reached target Preparation for Local File Systems.1988worker1 # [ 1.854656] systemd[1]: Finished Create System Files and Directories.1989client # [ 1.834217] systemd[1]: Reached target Local File Systems.1990lb # [ 1.859314] systemd[1]: Starting Rule-based Manager for Device Events and Files...1991client # [ 1.837075] systemd[1]: Starting Create System Files and Directories...1992client # [ 1.842081] systemd[1]: Starting Rule-based Manager for Device Events and Files...1993worker2 # [ 1.878403] systemd-udevd[83]: Using default interface naming scheme 'v261'.1994worker1 # [ 1.878637] systemd-udevd[83]: Using default interface naming scheme 'v261'.1995worker2 # [ 1.904408] systemd[1]: Started Rule-based Manager for Device Events and Files.1996lb # [ 1.900647] systemd[1]: Finished Create System Files and Directories.1997client # [ 1.879226] systemd[1]: Finished Create System Files and Directories.1998worker1 # [ 1.906086] systemd[1]: Started Rule-based Manager for Device Events and Files.1999lb # [ 1.924469] systemd-udevd[83]: Using default interface naming scheme 'v261'.2000client # [ 1.909375] systemd-udevd[84]: Using default interface naming scheme 'v261'.
loading 2,009 hidden lines…
4010lb # [ 18.450809] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4011lb # [ 18.463420] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4012lb # [ 18.465239] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4013lb # [ 18.466946] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4014lb # [ 18.468633] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4015lb # [ 18.470974] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4016lb # [ 18.473118] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4017lb # [ 18.479833] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84018lb # [ 18.481472] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4019lb # [ 18.483110] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4020lb # [ 18.485935] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4021lb # [ 18.487576] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4022lb # [ 18.489535] envoy[982]: [2026-09-20 08:15:17.222][982][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4023lb # [ 18.491049] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4024lb # [ 18.492399] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4025lb # [ 18.495147] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4026lb # [ 18.497791] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4027lb # [ 18.500182] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4028lb # [ 18.503355] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4029lb # [ 18.505725] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4030lb # [ 18.508184] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4031lb # [ 18.512560] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4032lb # [ 18.514606] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24033lb # [ 18.516696] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4034lb # [ 18.518580] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4035lb # [ 18.520171] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4036lb # [ 18.524863] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4037lb # [ 18.526627] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4038lb # [ 18.528906] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4039lb # [ 18.530461] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4040lb # [ 18.532795] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4041lb # [ 18.535462] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4042lb # [ 18.537536] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4043lb # [ 18.539094] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4044lb # [ 18.542865] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4045lb # [ 18.551647] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4046lb # [ 18.556687] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4047lb # [ 18.558480] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4048lb # [ 18.563816] envoy[982]: [2026-09-20 08:15:17.234][982][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4049lb # [ 18.565470] envoy[982]: [2026-09-20 08:15:17.238][982][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4050lb # [ 18.568325] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4051lb # [ 18.570646] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4052lb # [ 18.572432] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4053lb # [ 18.573924] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4054lb # [ 18.576164] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4055lb # [ 18.582148] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4056lb # [ 18.583822] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4057lb # [ 18.585563] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4058lb # [ 18.587218] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4059lb # [ 18.589061] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4060lb # [ 18.591102] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4061lb # [ 18.592852] envoy[982]: [2026-09-20 08:15:17.244][982][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4062lb # [ 18.594798] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4063lb # [ 18.600911] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4064lb # [ 18.604829] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4065lb # [ 18.607276] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4066lb # [ 18.609412] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4067lb # [ 18.611691] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4068lb # [ 18.615767] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14069lb # [ 18.617805] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4070lb # [ 18.619516] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4071lb # [ 18.621480] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4072lb # [ 18.623226] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4073lb # [ 18.625194] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4074lb # [ 18.627074] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4075lb # [ 18.638155] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4076lb # [ 18.640503] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4077lb # [ 18.642261] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4078lb # [ 18.643727] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4079lb # [ 18.646058] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4080lb # [ 18.648414] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4081lb # [ 18.652851] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4082lb # [ 18.655432] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4083lb # [ 18.657429] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4084lb # [ 18.659170] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4085lb # [ 18.664243] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4086lb # [ 18.690500] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4087lb # [ 18.693145] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4088lb # [ 18.696097] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4089lb # [ 18.699211] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4090lb # [ 18.701544] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4091lb # [ 18.704206] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4092lb # [ 18.706420] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4093lb # [ 18.708467] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4094lb # [ 18.710228] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4095lb # [ 18.712867] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4096lb # [ 18.719260] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4097lb # [ 18.721706] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4098lb # [ 18.723703] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4099lb # [ 18.726175] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4100lb # [ 18.729913] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4101lb # [ 18.731534] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4102lb # [ 18.733347] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4103lb # [ 18.735149] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4104lb # [ 18.737682] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4105lb # [ 18.739650] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24106lb # [ 18.741175] envoy[982]: [2026-09-20 08:15:17.245][982][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4107lb # [ 18.744204] envoy[982]: [2026-09-20 08:15:17.364][982][info][main] [source/server/server.cc:531] HTTP header map info:4108lb # [ 18.745509] envoy[982]: [2026-09-20 08:15:17.409][982][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4109lb # [ 18.759331] envoy[982]: [2026-09-20 08:15:17.409][982][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4110lb # [ 18.761252] envoy[982]: [2026-09-20 08:15:17.409][982][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4111lb # [ 18.769473] envoy[982]: [2026-09-20 08:15:17.409][982][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4112lb # [ 18.804671] envoy[982]: [2026-09-20 08:15:17.592][982][info][main] [source/server/server.cc:968] runtime: {}4113lb # [ 18.811192] envoy[982]: [2026-09-20 08:15:17.599][982][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4114lb # [ 18.813496] envoy[982]: [2026-09-20 08:15:17.601][982][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014115lb # [ 18.816381] envoy[982]: [2026-09-20 08:15:17.604][982][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014116lb # [ 18.819341] envoy[982]: [2026-09-20 08:15:17.607][982][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4117lb # [ 18.821220] envoy[982]: [2026-09-20 08:15:17.609][982][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4118lb # [ 18.823210] envoy[982]: [2026-09-20 08:15:17.609][982][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4119worker1 # [ 18.871605] systemd[1]: Starting Nix worker-protocol over gRPC...4120lb # [ 18.877922] envoy[982]: [2026-09-20 08:15:17.665][982][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4121worker2 # [ 18.885978] systemd[1]: Starting Nix worker-protocol over gRPC...4122lb # [ 18.902244] envoy[982]: [2026-09-20 08:15:17.690][982][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4123lb # [ 18.905651] envoy[982]: [2026-09-20 08:15:17.693][982][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4124lb # [ 18.908986] envoy[982]: [2026-09-20 08:15:17.693][982][info][main] [source/server/server.cc:1077] starting main dispatch loop4125worker2 # [ 19.038210] nix-grpc-daemon[855]: ts=2026-09-20T08:15:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4126worker1 # [ 19.035552] nix-grpc-daemon[850]: ts=2026-09-20T08:15:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4127worker2 # [ 19.047109] nix-grpc-daemon[855]: ts=2026-09-20T08:15:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14128worker1 # [ 19.045634] nix-grpc-daemon[850]: ts=2026-09-20T08:15:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14129worker2 # [ 19.082972] nix-grpc-daemon[855]: ts=2026-09-20T08:15:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4130worker2 # [ 19.085949] systemd[1]: Started Nix worker-protocol over gRPC.4131worker1 # [ 19.080754] nix-grpc-daemon[850]: ts=2026-09-20T08:15:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4132worker1 # [ 19.084572] systemd[1]: Started Nix worker-protocol over gRPC.4133lb # [ 19.135608] envoy[982]: [2026-09-20 08:15:17.923][982][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4134lb # [ 19.140402] envoy[982]: [2026-09-20 08:15:17.927][982][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4135lb # [ 19.144757] envoy[982]: [2026-09-20 08:15:17.927][982][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4136worker2 # [ 19.151455] nix-grpc-daemon[855]: ts=2026-09-20T08:15:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4137lb # [ 19.148961] envoy[982]: [2026-09-20 08:15:17.932][982][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4138worker1 # [ 19.170495] nix-grpc-daemon[850]: ts=2026-09-20T08:15:17Z level=info event=scheduler_connected addr=lb:500514139worker1 # [ 19.191111] nix-grpc-daemon[850]: ts=2026-09-20T08:15:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker2 # [ 19.352393] nix-grpc-daemon[855]: ts=2026-09-20T08:15:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4141worker1 # [ 19.392119] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_connected addr=lb:500514142worker1 # [ 19.403649] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker1 # [ 19.604313] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_connected addr=lb:500514144worker1 # [ 19.607038] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4145worker2 # [ 19.753077] nix-grpc-daemon[855]: ts=2026-09-20T08:15:18Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4146worker1 # [ 19.807585] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_connected addr=lb:500514147worker1 # [ 19.809946] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 20.010778] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 20.013175] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker1 # [ 20.214211] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_connected addr=lb:500514151worker1 # [ 20.215909] nix-grpc-daemon[850]: ts=2026-09-20T08:15:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 20.416960] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 20.421915] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker2 # [ 20.556187] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514155worker2 # [ 20.559544] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 20.622710] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 20.626653] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 20.760426] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 20.763166] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 20.827441] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 20.829762] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker2 # [ 20.964131] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 20.968759] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 21.030810] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 21.036352] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker2 # [ 21.169476] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 21.172377] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 21.237556] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 21.240368] nix-grpc-daemon[850]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker2 # [ 21.373305] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 21.376243] nix-grpc-daemon[855]: ts=2026-09-20T08:15:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 21.441269] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 21.444366] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker2 # [ 21.578313] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 21.580412] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker1 # [ 21.645416] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 21.648586] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker2 # [ 21.780758] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 21.783380] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 21.849425] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514181worker1 # [ 21.852336] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker2 # [ 21.984637] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514183worker2 # [ 21.990100] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 22.053260] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 22.056145] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4186worker2 # [ 22.191069] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 22.196502] nix-grpc-daemon[855]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 22.257470] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 22.260396] nix-grpc-daemon[850]: ts=2026-09-20T08:15:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4190worker2 # [ 22.397237] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 22.400395] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 22.461408] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 22.465571] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4194worker2 # [ 22.602595] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 22.608066] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 22.666822] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 22.671328] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker2 # [ 22.809354] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 22.812208] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 22.872560] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 22.877296] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4202worker2 # [ 23.013343] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 23.018163] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 23.078185] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 23.082983] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4206worker2 # [ 23.218694] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 23.223497] nix-grpc-daemon[855]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 23.283772] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 23.285934] nix-grpc-daemon[850]: ts=2026-09-20T08:15:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4210worker2 # [ 23.424111] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514211worker2 # [ 23.427750] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker1 # [ 23.487098] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 23.491774] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4214worker2 # [ 23.628679] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514215worker2 # [ 23.631213] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker1 # [ 23.692832] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 23.697479] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218worker2 # [ 23.832082] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514219worker2 # [ 23.834562] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker1 # [ 23.898531] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514221worker1 # [ 23.903414] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4222worker2 # [ 24.035302] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514223worker2 # [ 24.037729] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker1 # [ 24.103901] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514225worker1 # [ 24.106197] nix-grpc-daemon[850]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4226worker2 # [ 24.238749] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_connected addr=lb:500514227worker2 # [ 24.243781] nix-grpc-daemon[855]: ts=2026-09-20T08:15:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 24.307113] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514229worker1 # [ 24.309525] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4230worker2 # [ 24.444805] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514231worker2 # [ 24.450426] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker1 # [ 24.510344] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 24.513316] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4234worker2 # [ 24.651387] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514235worker2 # [ 24.653789] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker1 # [ 24.713940] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514237worker1 # [ 24.716766] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4238worker2 # [ 24.854417] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514239worker2 # [ 24.857301] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker1 # [ 24.917629] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514241worker1 # [ 24.920662] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4242worker2 # [ 25.058085] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514243worker2 # [ 25.060656] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker1 # [ 25.121343] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514245worker1 # [ 25.125189] nix-grpc-daemon[850]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4246worker2 # [ 25.261355] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_connected addr=lb:500514247worker2 # [ 25.266307] nix-grpc-daemon[855]: ts=2026-09-20T08:15:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 25.326315] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514249worker1 # [ 25.329648] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4250worker2 # [ 25.466956] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514251worker2 # [ 25.469380] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker1 # [ 25.530828] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514253worker1 # [ 25.536633] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4254worker2 # [ 25.670659] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514255worker2 # [ 25.673520] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker1 # [ 25.737349] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514257worker1 # [ 25.739880] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4258worker2 # [ 25.874280] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514259worker2 # [ 25.876528] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker1 # [ 25.940973] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514261worker1 # [ 25.946360] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262worker2 # [ 26.077163] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514263worker2 # [ 26.079764] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker1 # [ 26.147603] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514265worker1 # [ 26.152595] nix-grpc-daemon[850]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4266worker2 # [ 26.280932] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_connected addr=lb:500514267worker2 # [ 26.286187] nix-grpc-daemon[855]: ts=2026-09-20T08:15:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker1 # [ 26.353805] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514269worker1 # [ 26.356648] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4270worker2 # [ 26.486551] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514271worker2 # [ 26.489575] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker1 # [ 26.557631] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514273worker1 # [ 26.560223] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4274worker2 # [ 26.690629] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514275worker2 # [ 26.692929] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker1 # [ 26.761418] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514277worker1 # [ 26.766267] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4278worker2 # [ 26.893769] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514279worker2 # [ 26.897234] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4280worker1 # [ 26.966916] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514281worker1 # [ 26.971752] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4282worker2 # [ 27.098522] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514283worker2 # [ 27.101462] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4284worker1 # [ 27.172156] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514285worker1 # [ 27.175529] nix-grpc-daemon[850]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4286worker2 # [ 27.302636] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_connected addr=lb:500514287worker2 # [ 27.307748] nix-grpc-daemon[855]: ts=2026-09-20T08:15:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4288worker1 # [ 27.376699] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514289worker1 # [ 27.380530] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4290worker2 # [ 27.508557] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514291worker2 # [ 27.511318] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4292worker1 # [ 27.581196] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514293worker1 # [ 27.584269] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4294worker2 # [ 27.712593] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514295worker2 # [ 27.715601] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4296worker1 # [ 27.785584] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514297worker1 # [ 27.789446] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4298worker2 # [ 27.916385] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514299worker2 # [ 27.919194] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4300worker1 # [ 27.990574] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514301worker1 # [ 27.995824] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4302worker2 # [ 28.120109] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514303worker2 # [ 28.123157] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304worker1 # [ 28.197592] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514305worker1 # [ 28.201772] nix-grpc-daemon[850]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4306worker2 # [ 28.324273] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_connected addr=lb:500514307worker2 # [ 28.327222] nix-grpc-daemon[855]: ts=2026-09-20T08:15:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4308worker1 # [ 28.400361] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514309worker1 # [ 28.405503] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4310worker2 # [ 28.528130] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514311worker2 # [ 28.531155] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4312worker1 # [ 28.606783] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514313worker1 # [ 28.612097] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4314worker2 # [ 28.732647] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514315worker2 # [ 28.735564] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4316worker1 # [ 28.813171] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514317worker1 # [ 28.817989] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4318worker2 # [ 28.936401] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514319worker2 # [ 28.939446] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4320worker1 # [ 29.018708] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514321worker1 # [ 29.022577] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4322worker2 # [ 29.140289] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514323worker2 # [ 29.144244] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4324worker1 # [ 29.223556] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514325worker1 # [ 29.228835] nix-grpc-daemon[850]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4326worker2 # [ 29.345165] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_connected addr=lb:500514327worker2 # [ 29.348275] nix-grpc-daemon[855]: ts=2026-09-20T08:15:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4328worker1 # [ 29.432453] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514329worker1 # [ 29.435638] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4330worker2 # [ 29.548991] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514331worker2 # [ 29.552778] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4332worker1 # [ 29.632547] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514333worker1 # [ 29.635142] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4334worker2 # [ 29.754273] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514335worker2 # [ 29.757332] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4336worker1 # [ 29.836472] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514337worker1 # [ 29.841507] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4338worker2 # [ 29.958226] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514339worker2 # [ 29.961444] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4340worker1 # [ 30.042603] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514341worker1 # [ 30.047962] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4342worker2 # [ 30.162055] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514343worker2 # [ 30.165418] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4344worker1 # [ 30.248935] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514345worker1 # [ 30.251920] nix-grpc-daemon[850]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4346worker2 # [ 30.366557] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_connected addr=lb:500514347worker2 # [ 30.369528] nix-grpc-daemon[855]: ts=2026-09-20T08:15:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4348worker1 # [ 30.453275] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514349worker1 # [ 30.455886] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4350worker2 # [ 30.570607] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514351worker2 # [ 30.574105] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4352worker1 # [ 30.656546] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514353worker1 # [ 30.660566] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4354worker2 # [ 30.777622] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514355worker2 # [ 30.780479] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4356worker1 # [ 30.861426] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514357worker1 # [ 30.864210] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4358worker2 # [ 30.981576] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514359worker2 # [ 30.984587] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4360worker1 # [ 31.065554] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514361worker1 # [ 31.070898] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4362worker2 # [ 31.185487] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514363worker2 # [ 31.188525] nix-grpc-daemon[855]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4364worker1 # [ 31.271594] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_connected addr=lb:500514365worker1 # [ 31.276845] nix-grpc-daemon[850]: ts=2026-09-20T08:15:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4366worker2 # [ 31.389221] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514367worker2 # [ 31.392250] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4368worker1 # [ 31.478196] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514369worker1 # [ 31.480876] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4370worker2 # [ 31.593428] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514371worker2 # [ 31.596491] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4372worker1 # [ 31.681630] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514373worker1 # [ 31.684319] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4374worker2 # [ 31.798806] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514375worker2 # [ 31.800911] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4376worker1 # [ 31.885664] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514377worker1 # [ 31.891332] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4378worker2 # [ 32.001684] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514379worker2 # [ 32.005074] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4380worker1 # [ 32.092350] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514381worker1 # [ 32.097685] nix-grpc-daemon[850]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4382worker2 # [ 32.206217] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_connected addr=lb:500514383worker2 # [ 32.211458] nix-grpc-daemon[855]: ts=2026-09-20T08:15:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4384worker1 # [ 32.298980] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514385worker1 # [ 32.303980] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4386worker2 # [ 32.412568] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514387worker2 # [ 32.418256] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4388worker1 # [ 32.505787] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514389worker1 # [ 32.511221] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4390worker2 # [ 32.619457] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514391worker2 # [ 32.625322] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4392worker1 # [ 32.712805] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514393worker1 # [ 32.718683] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4394worker2 # [ 32.826966] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514395worker2 # [ 32.829697] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4396worker1 # [ 32.919851] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514397worker1 # [ 32.925709] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4398worker2 # [ 33.031095] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514399worker2 # [ 33.037142] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4400worker1 # [ 33.127270] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514401worker1 # [ 33.133766] nix-grpc-daemon[850]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4402worker2 # [ 33.238253] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_connected addr=lb:500514403worker2 # [ 33.244801] nix-grpc-daemon[855]: ts=2026-09-20T08:15:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4404worker1 # [ 33.334754] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514405worker1 # [ 33.340994] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4406worker2 # [ 33.445874] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514407worker2 # [ 33.451622] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4408worker1 # [ 33.544314] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514409worker1 # [ 33.548898] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4410worker2 # [ 33.652588] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514411worker2 # [ 33.657354] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4412worker1 # [ 33.749893] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514413worker1 # [ 33.755061] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4414worker2 # [ 33.861847] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514415worker2 # [ 33.865619] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4416worker1 # [ 33.955614] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514417worker1 # [ 33.958149] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4418worker2 # [ 34.062565] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514419worker2 # [ 34.065418] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4420worker1 # [ 34.159341] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514421worker1 # [ 34.164592] nix-grpc-daemon[850]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4422worker2 # [ 34.266640] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_connected addr=lb:500514423worker2 # [ 34.271741] nix-grpc-daemon[855]: ts=2026-09-20T08:15:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4424worker1 # [ 34.365321] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514425worker1 # [ 34.368250] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4426worker2 # [ 34.472945] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514427worker2 # [ 34.477861] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4428worker1 # [ 34.570419] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514429worker1 # [ 34.576264] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4430worker2 # [ 34.678713] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514431worker2 # [ 34.684157] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4432worker1 # [ 34.777631] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514433worker1 # [ 34.783342] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4434worker2 # [ 34.885367] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514435worker2 # [ 34.890527] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4436worker1 # [ 34.984480] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514437worker1 # [ 34.990071] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4438worker2 # [ 35.091594] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514439worker2 # [ 35.095158] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4440worker1 # [ 35.190548] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514441worker1 # [ 35.193157] nix-grpc-daemon[850]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4442worker2 # [ 35.296057] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_connected addr=lb:500514443worker2 # [ 35.298696] nix-grpc-daemon[855]: ts=2026-09-20T08:15:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4444worker1 # [ 35.394266] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514445worker1 # [ 35.399595] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4446worker2 # [ 35.499611] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514447worker2 # [ 35.502417] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4448worker1 # [ 35.600794] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514449worker1 # [ 35.603489] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4450worker2 # [ 35.703262] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514451worker2 # [ 35.706087] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4452worker1 # [ 35.803975] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514453worker1 # [ 35.806473] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4454worker2 # [ 35.907638] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514455worker2 # [ 35.911131] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4456worker1 # [ 36.007670] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514457worker1 # [ 36.012503] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4458worker2 # [ 36.111614] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514459worker2 # [ 36.114282] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4460worker1 # [ 36.212966] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514461worker1 # [ 36.215353] nix-grpc-daemon[850]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4462worker2 # [ 36.314974] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_connected addr=lb:500514463worker2 # [ 36.317357] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4464worker2 # [ 36.325131] nix-grpc-daemon[855]: ts=2026-09-20T08:15:34Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"4465worker1 # [ 36.328243] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"4466worker1 # [ 36.415975] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514467worker1 # [ 36.418275] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4468worker2 # [ 36.518026] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514469worker2 # [ 36.520734] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4470worker1 # [ 36.621911] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514471worker1 # [ 36.625295] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4472worker2 # [ 36.721721] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514473worker2 # [ 36.726665] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4474worker1 # [ 36.822464] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514475worker1 # [ 36.825284] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4476worker2 # [ 36.927914] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514477worker2 # [ 36.930323] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4478worker1 # [ 37.026621] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514479worker1 # [ 37.031455] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4480worker2 # [ 37.131413] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514481worker2 # [ 37.136516] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4482worker1 # [ 37.231928] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514483worker1 # [ 37.234098] nix-grpc-daemon[850]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4484worker2 # [ 37.337184] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_connected addr=lb:500514485worker2 # [ 37.340039] nix-grpc-daemon[855]: ts=2026-09-20T08:15:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4486worker1 # [ 37.434817] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514487worker1 # [ 37.437133] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4488worker2 # [ 37.540980] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514489worker2 # [ 37.546254] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4490worker1 # [ 37.638327] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514491worker1 # [ 37.640295] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4492worker2 # [ 37.746878] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514493worker2 # [ 37.752136] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4494worker1 # [ 37.840962] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514495worker1 # [ 37.843540] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4496worker2 # [ 37.953883] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514497worker2 # [ 37.958621] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4498worker1 # [ 38.044237] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514499worker1 # [ 38.046644] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4500worker2 # [ 38.159620] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514501worker2 # [ 38.165607] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4502worker1 # [ 38.247300] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514503worker1 # [ 38.249799] nix-grpc-daemon[850]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4504worker2 # [ 38.366741] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_connected addr=lb:500514505worker2 # [ 38.372263] nix-grpc-daemon[855]: ts=2026-09-20T08:15:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4506worker1 # [ 38.450452] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514507worker1 # [ 38.453271] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4508worker2 # [ 38.573363] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514509worker2 # [ 38.578540] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4510worker1 # [ 38.657336] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514511worker1 # [ 38.660426] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4512worker2 # [ 38.779549] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514513worker2 # [ 38.784895] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4514worker1 # [ 38.857939] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514515worker1 # [ 38.860824] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4516worker2 # [ 38.986634] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514517worker2 # [ 38.991721] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4518worker1 # [ 39.061957] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514519worker1 # [ 39.066607] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4520worker2 # [ 39.192211] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514521worker2 # [ 39.194473] nix-grpc-daemon[855]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4522worker1 # [ 39.267203] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_connected addr=lb:500514523worker1 # [ 39.269660] nix-grpc-daemon[850]: ts=2026-09-20T08:15:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4524worker2 # [ 39.395375] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514525worker2 # [ 39.398234] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4526worker1 # [ 39.470348] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514527worker1 # [ 39.472834] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4528worker2 # [ 39.599382] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514529worker2 # [ 39.604175] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4530worker1 # [ 39.673891] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514531worker1 # [ 39.676566] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4532worker2 # [ 39.808679] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514533worker2 # [ 39.811282] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4534worker1 # [ 39.877290] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514535worker1 # [ 39.882204] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4536worker2 # [ 40.012587] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514537worker2 # [ 40.015399] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4538worker1 # [ 40.083122] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514539worker1 # [ 40.087746] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4540worker2 # [ 40.216474] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514541worker2 # [ 40.221694] nix-grpc-daemon[855]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4542worker1 # [ 40.289054] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_connected addr=lb:500514543worker1 # [ 40.293395] nix-grpc-daemon[850]: ts=2026-09-20T08:15:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4544worker2 # [ 40.422756] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514545worker2 # [ 40.428174] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4546worker1 # [ 40.494305] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514547worker1 # [ 40.499070] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4548worker2 # [ 40.633386] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514549worker2 # [ 40.638794] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4550worker1 # [ 40.702267] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514551worker1 # [ 40.705356] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4552lb # [ 40.737639] rustfs-bucket-start[1196]: mb s3://farm4553lb # [ 40.744594] systemd[1]: Finished rustfs-bucket.service.4554lb # [ 40.752634] systemd[1]: Starting niks3 server...4555worker2 # [ 40.839851] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514556worker2 # [ 40.845635] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4557worker1 # [ 40.902605] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514558worker1 # [ 40.904967] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4559lb # [ 40.985275] postgres[1215]: [1215] ERROR: relation "goose_db_version" does not exist at character 364560lb # [ 40.987183] postgres[1215]: [1215] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4561lb # [ 41.022546] niks3-server[1206]: 2026/09/20 08:15:39 OK 20241026095416_initial_model.sql (15.63ms)4562lb # [ 41.026564] niks3-server[1206]: 2026/09/20 08:15:39 OK 20251210153512_drop_unused_gin_index.sql (2.16ms)4563lb # [ 41.031508] niks3-server[1206]: 2026/09/20 08:15:39 OK 20251218171726_add_pins.sql (5.03ms)4564lb # [ 41.036201] niks3-server[1206]: 2026/09/20 08:15:39 OK 20260628120000_add_object_size_and_stats.sql (3.53ms)4565lb # [ 41.040228] niks3-server[1206]: 2026/09/20 08:15:39 OK 20260905000000_add_claims.sql (2.63ms)4566lb # [ 41.044699] niks3-server[1206]: 2026/09/20 08:15:39 OK 20260920000000_drop_claims.sql (4.37ms)4567worker2 # [ 41.047608] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514568lb # [ 41.045830] niks3-server[1206]: 2026/09/20 08:15:39 goose: successfully migrated database to version: 202609200000004569worker2 # [ 41.052334] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4570lb # [ 41.052087] niks3-server[1206]: 2026/09/20 08:15:39 OK 1_commit_pending_closure.sql (7.32ms)4571lb # [ 41.054350] niks3-server[1206]: 2026/09/20 08:15:39 OK 2_object_stats_trigger.sql (2.3ms)4572lb # [ 41.055585] niks3-server[1206]: 2026/09/20 08:15:39 goose: up to current file version: 24573lb # [ 41.061066] niks3-server[1206]: 2026/09/20 08:15:39 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4574worker1 # [ 41.106864] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514575worker1 # [ 41.110546] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4576lb # [ 41.128612] niks3-server[1206]: 2026/09/20 08:15:39 INFO Read proxy enabled — serving cache objects from S34577lb # [ 41.130587] niks3-server[1206]: 2026/09/20 08:15:39 INFO Using socket-activated listener address=0.0.0.0:57514578lb # [ 41.136977] systemd[1]: Started niks3 server.4579lb # [ 41.137681] niks3-server[1206]: 2026/09/20 08:15:39 INFO systemd watchdog enabled interval=15s4580lb # [ 41.138771] systemd[1]: Reached target Multi-User System.4581lb # [ 41.140558] systemd[1]: Startup finished in 876ms (kernel) + 5.111s (initrd) + 35.152s (userspace) = 41.139s.4582lb # [ 41.142268] niks3-server[1206]: 2026/09/20 08:15:39 INFO Starting HTTP server address=0.0.0.0:57514583lb # [ 41.150177] niks3-server[1206]: 2026/09/20 08:15:39 INFO lead: acquired remote=192.168.1.3:421464584worker1 # [ 41.155752] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=scheduler_take_over4585worker2 # [ 41.252923] nix-grpc-daemon[855]: ts=2026-09-20T08:15:39Z level=info event=scheduler_connected addr=lb:500514586worker1 # [ 41.248839] nix-grpc-daemon[850]: ts=2026-09-20T08:15:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04587worker1 # [ 41.311203] nix-grpc-daemon[850]: ts=2026-09-20T08:15:40Z level=info event=scheduler_connected addr=lb:500514588worker1 # [ 41.315061] nix-grpc-daemon[850]: ts=2026-09-20T08:15:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04589lb: (finished: waiting for unit niks3.service, in 30.18 seconds)4590lb: waiting for TCP port 5751 on localhost4591lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4592lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds)4593lb: waiting for unit envoy.service4594lb: (finished: waiting for unit envoy.service, in 0.04 seconds)4595lb: waiting for TCP port 50051 on localhost4596lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4597lb # [ 41.998273] envoy[982]: conn peer=[::1]:44710 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=44598lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4599lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4600??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4601 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284602lb: must succeed: curl -sf localhost:9901/clusters4603lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4604lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)4605subtest: one node schedules and both builders hold a WorkerSession on it4606lb: must succeed: curl -sf localhost:9901/clusters4607lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4608worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4609worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4610(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.12 seconds)4611subtest: balancer auth: client cert, bearer token, nothing, unknown CN4612worker2 # [ 42.590511] nix-grpc-daemon[855]: ts=2026-09-20T08:15:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592624613worker2 # [ 42.602481] systemd[1]: Started Nix Daemon.4614worker2 # [ 42.773646] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4615worker2 # [ 42.813919] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)4616worker2 # [ 42.827245] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 2/5)4617worker2 # [ 42.888868] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 147 ms (attempt 3/5)4618worker2 # [ 43.041726] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 4/5)4619worker2 # [ 43.131943] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4620worker1 # [ 43.162780] nix-grpc-daemon[850]: ts=2026-09-20T08:15:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:379784621worker1 # [ 43.175543] systemd[1]: Started Nix Daemon.4622worker1 # [ 43.374341] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4623worker1 # [ 43.404566] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)4624worker1 # [ 43.461059] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 2/5)4625worker1 # [ 43.526278] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 3/5)4626worker1 # [ 43.564805] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 708 ms (attempt 4/5)4627worker1 # [ 44.282623] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4628worker1 # [ 44.301142] nix-grpc-daemon[850]: ts=2026-09-20T08:15:43Z level=debug event=path_info_miss path=iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test error="error: path '/nix/store/iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test' is required, but there is no substituter that can build it"4629worker2 # [ 44.326281] nix-grpc-daemon[855]: ts=2026-09-20T08:15:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592624630worker2 # [ 44.336195] nix-grpc-daemon[855]: ts=2026-09-20T08:15:42Z level=debug event=path_info_miss path=iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test error="error: path '/nix/store/iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test' is required, but there is no substituter that can build it"4631client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4632client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.07 seconds)4633client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4634client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4635worker2 # [ 44.680952] nix-grpc-daemon[855]: ts=2026-09-20T08:15:43Z level=info event=oidc_jwks provider=mock keys=14636worker2 # [ 44.685565] nix-grpc-daemon[855]: ts=2026-09-20T08:15:43Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:592624637worker2 # [ 44.697078] nix-grpc-daemon[855]: ts=2026-09-20T08:15:43Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:592624638worker2 # [ 44.704844] nix-grpc-daemon[855]: ts=2026-09-20T08:15:43Z level=debug event=path_info_miss path=iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test error="error: path '/nix/store/iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test' is required, but there is no substituter that can build it"4639worker1 # [ 44.712295] nix-grpc-daemon[850]: ts=2026-09-20T08:15:43Z level=info event=oidc_jwks provider=mock keys=14640worker1 # [ 44.717287] nix-grpc-daemon[850]: ts=2026-09-20T08:15:43Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:379784641worker1 # [ 44.725466] nix-grpc-daemon[850]: ts=2026-09-20T08:15:43Z level=debug event=path_info_miss path=iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test error="error: path '/nix/store/iva1lb444f70cpyri3mp2irfim9pmaz9-nixos-system-client-test' is required, but there is no substituter that can build it"4642client: must succeed: rm -r /var/lib/nix-grpc-store4643client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds)4644worker2 # [ 44.968872] nix-grpc-daemon[855]: ts=2026-09-20T08:15:43Z level=info event=denied method=QueryMissing cn=- role=none4645worker1 # [ 45.162341] nix-grpc-daemon[850]: ts=2026-09-20T08:15:43Z level=info event=denied method=QueryMissing cn=stranger role=none4646(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.90 seconds)4647subtest: DAG build is scheduled across workers and lands in the cache4648client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24649worker1 # [ 45.367172] nix-grpc-daemon[850]: ts=2026-09-20T08:15:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379784650client # don't know how to build these paths:4651client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4652worker1 # [ 45.396375] nix-grpc-daemon[850]: ts=2026-09-20T08:15:44Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04653worker1 # [ 45.400763] nix-grpc-daemon[850]: ts=2026-09-20T08:15:44Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14654worker2 # [ 45.455758] nix-grpc-daemon[855]: ts=2026-09-20T08:15:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624655worker2 # [ 45.478882] nix-grpc-daemon[855]: ts=2026-09-20T08:15:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592624656client # copying 1 paths to 'lb:50051'...4657worker2 # [ 45.490298] nix-grpc-daemon[855]: ts=2026-09-20T08:15:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592624658client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4659worker2 # [ 45.504956] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4660worker2 # [ 45.529542] nix-grpc-daemon[855]: ts=2026-09-20T08:15:44Z level=info event=niks3_push_started pid=9284661worker2 # [ 45.942865] nix-daemon[919]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4662worker2 # [ 45.958602] nix-daemon[919]: reaped child process 943, status = succeeded4663worker2 # [ 46.096232] nix-daemon[919]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4664worker2 # [ 46.109411] nix-daemon[919]: reaped child process 948, status = succeeded4665lb # [ 46.111692] niks3-server[1206]: 2026/09/20 08:15:44 INFO Received uploads request method=POST path=/api/pending_closures4666worker2 # [ 46.134261] nix-grpc-daemon[928]: time=2026-09-20T08:15:44.747Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4667worker2 # [ 46.137171] nix-grpc-daemon[928]: time=2026-09-20T08:15:44.750Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4668lb # [ 46.179135] niks3-server[1206]: 2026/09/20 08:15:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4669lb # [ 46.181258] niks3-server[1206]: 2026/09/20 08:15:44 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4670lb # [ 46.188342] niks3-server[1206]: 2026/09/20 08:15:44 INFO Signed narinfos id=1 count=14671worker2 # [ 46.194496] nix-grpc-daemon[928]: time=2026-09-20T08:15:44.808Z level=INFO msg="Uploading 1 narinfos"4672lb # [ 46.190228] niks3-server[1206]: 2026/09/20 08:15:44 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4673lb # [ 46.200231] niks3-server[1206]: 2026/09/20 08:15:44 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4674lb # [ 46.209761] niks3-server[1206]: 2026/09/20 08:15:44 INFO Completed upload id=14675worker2 # [ 46.214626] nix-grpc-daemon[928]: time=2026-09-20T08:15:44.828Z level=INFO msg="Upload complete. (437ms)"4676lb # [ 46.216338] niks3-server[1206]: 2026/09/20 08:15:45 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4677worker2 # [ 46.219146] nix-grpc-daemon[855]: ts=2026-09-20T08:15:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_in=5044678worker2 # [ 46.225289] nix-grpc-daemon[855]: ts=2026-09-20T08:15:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624679worker2 # [ 46.233954] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4680worker2 # [ 46.242489] nix-daemon[919]: reaped child process 926, status = succeeded4681client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4682worker2 # [ 46.247100] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4683client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4684client # farm-a> LOG-farm-a-t14685worker2 # [ 47.059840] nix-daemon[919]: reaped child process 952, status = succeeded4686worker2 # [ 47.180895] nix-daemon[919]: accepted connection from pid 967, user nix-grpc-daemon (trusted)4687worker2 # [ 47.192782] nix-daemon[919]: reaped child process 970, status = succeeded4688lb # [ 47.202904] niks3-server[1206]: 2026/09/20 08:15:45 INFO Received uploads request method=POST path=/api/pending_closures4689worker2 # [ 47.220717] nix-grpc-daemon[928]: time=2026-09-20T08:15:45.834Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4690worker2 # [ 47.222295] nix-grpc-daemon[928]: time=2026-09-20T08:15:45.835Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4691lb # [ 47.246137] niks3-server[1206]: 2026/09/20 08:15:46 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4692lb # [ 47.259118] niks3-server[1206]: 2026/09/20 08:15:46 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4693lb # [ 47.268296] niks3-server[1206]: 2026/09/20 08:15:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4694lb # [ 47.272114] niks3-server[1206]: 2026/09/20 08:15:46 INFO Signed narinfos id=2 count=14695worker2 # [ 47.277291] nix-grpc-daemon[928]: time=2026-09-20T08:15:45.890Z level=INFO msg="Uploading 1 narinfos"4696lb # [ 47.276958] niks3-server[1206]: 2026/09/20 08:15:46 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4697lb # [ 47.284060] niks3-server[1206]: 2026/09/20 08:15:46 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4698lb # [ 47.289413] niks3-server[1206]: 2026/09/20 08:15:46 INFO Completed upload id=24699worker2 # [ 47.293977] nix-grpc-daemon[928]: time=2026-09-20T08:15:45.907Z level=INFO msg="Upload complete. (239ms)"4700lb # [ 47.291051] niks3-server[1206]: 2026/09/20 08:15:46 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4701worker2 # [ 47.296644] nix-grpc-daemon[855]: ts=2026-09-20T08:15:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14702worker2 # [ 47.303243] nix-daemon[919]: reaped child process 950, status = succeeded4703worker1 # [ 47.300183] nix-grpc-daemon[850]: ts=2026-09-20T08:15:46Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04704worker1 # [ 47.302093] nix-grpc-daemon[850]: ts=2026-09-20T08:15:46Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14705worker2 # [ 47.312433] nix-grpc-daemon[855]: ts=2026-09-20T08:15:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624706worker2 # [ 47.318576] nix-grpc-daemon[855]: ts=2026-09-20T08:15:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592624707worker2 # [ 47.324267] nix-grpc-daemon[928]: time=2026-09-20T08:15:45.937Z level=INFO msg="All 1 paths already cached"4708client # copying 1 paths to 'lb:50051'...4709worker2 # [ 47.328949] nix-grpc-daemon[855]: ts=2026-09-20T08:15:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592624710client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4711worker2 # [ 47.347499] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4712worker2 # [ 47.491603] nix-daemon[919]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4713worker2 # [ 47.504663] nix-daemon[919]: reaped child process 977, status = succeeded4714worker2 # [ 47.649935] nix-daemon[919]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4715worker2 # [ 47.661658] nix-daemon[919]: reaped child process 983, status = succeeded4716lb # [ 47.670204] niks3-server[1206]: 2026/09/20 08:15:46 INFO Received uploads request method=POST path=/api/pending_closures4717worker2 # [ 47.685987] nix-grpc-daemon[928]: time=2026-09-20T08:15:46.299Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4718worker2 # [ 47.687366] nix-grpc-daemon[928]: time=2026-09-20T08:15:46.299Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4719lb # [ 47.702838] niks3-server[1206]: 2026/09/20 08:15:46 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4720lb # [ 47.709838] niks3-server[1206]: 2026/09/20 08:15:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4721worker2 # [ 47.721712] nix-grpc-daemon[928]: time=2026-09-20T08:15:46.335Z level=INFO msg="Uploading 1 narinfos"4722lb # [ 47.717182] niks3-server[1206]: 2026/09/20 08:15:46 INFO Signed narinfos id=3 count=14723lb # [ 47.722065] niks3-server[1206]: 2026/09/20 08:15:46 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4724lb # [ 47.733376] niks3-server[1206]: 2026/09/20 08:15:46 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4725lb # [ 47.739188] niks3-server[1206]: 2026/09/20 08:15:46 INFO Completed upload id=34726worker2 # [ 47.743968] nix-grpc-daemon[928]: time=2026-09-20T08:15:46.357Z level=INFO msg="Upload complete. (389ms)"4727lb # [ 47.744437] niks3-server[1206]: 2026/09/20 08:15:46 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4728worker2 # [ 47.748133] nix-grpc-daemon[855]: ts=2026-09-20T08:15:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_in=6244729worker2 # [ 47.753154] nix-grpc-daemon[855]: ts=2026-09-20T08:15:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624730worker2 # [ 47.763103] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4731worker2 # [ 47.767419] nix-daemon[919]: reaped child process 972, status = succeeded4732client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4733client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4734worker2 # [ 47.772041] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4735client # farm-b> LOG-farm-b-t14736lb # [ 48.888397] envoy[982]: conn peer=[2001:db8:1::1]:53070 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=17974737lb # [ 48.892427] envoy[982]: conn peer=[2001:db8:1::1]:41832 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=363 ms=764738lb # [ 48.895817] envoy[982]: conn peer=[2001:db8:1::1]:41836 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=84739lb # [ 48.899142] envoy[982]: conn peer=[2001:db8:1::1]:41842 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84740worker2 # [ 48.987627] nix-daemon[919]: reaped child process 987, status = succeeded4741worker2 # [ 49.102890] nix-daemon[919]: accepted connection from pid 1002, user nix-grpc-daemon (trusted)4742worker2 # [ 49.115525] nix-daemon[919]: reaped child process 1005, status = succeeded4743lb # [ 49.120813] niks3-server[1206]: 2026/09/20 08:15:47 INFO Received uploads request method=POST path=/api/pending_closures4744worker2 # [ 49.133902] nix-grpc-daemon[928]: time=2026-09-20T08:15:47.747Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4745worker2 # [ 49.135700] nix-grpc-daemon[928]: time=2026-09-20T08:15:47.749Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4746lb # [ 49.168610] niks3-server[1206]: 2026/09/20 08:15:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4747worker2 # [ 49.180064] nix-grpc-daemon[928]: time=2026-09-20T08:15:47.793Z level=INFO msg="Uploading 1 narinfos"4748lb # [ 49.175724] niks3-server[1206]: 2026/09/20 08:15:47 INFO Signed narinfos id=4 count=14749lb # [ 49.190689] niks3-server[1206]: 2026/09/20 08:15:47 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4750lb # [ 49.194794] niks3-server[1206]: 2026/09/20 08:15:47 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4751lb # [ 49.196953] niks3-server[1206]: 2026/09/20 08:15:47 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4752lb # [ 49.201805] niks3-server[1206]: 2026/09/20 08:15:47 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4753lb # [ 49.204493] niks3-server[1206]: 2026/09/20 08:15:47 INFO Completed upload id=44754worker2 # [ 49.209164] nix-grpc-daemon[928]: time=2026-09-20T08:15:47.822Z level=INFO msg="Upload complete. (228ms)"4755lb # [ 49.206527] niks3-server[1206]: 2026/09/20 08:15:47 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4756worker2 # [ 49.211778] nix-grpc-daemon[855]: ts=2026-09-20T08:15:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14757worker2 # [ 49.218518] nix-daemon[919]: reaped child process 985, status = succeeded4758worker1 # [ 49.211205] nix-grpc-daemon[850]: ts=2026-09-20T08:15:47Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04759worker1 # [ 49.213098] nix-grpc-daemon[850]: ts=2026-09-20T08:15:47Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14760worker2 # [ 49.263063] nix-grpc-daemon[855]: ts=2026-09-20T08:15:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624761worker2 # [ 49.272742] nix-grpc-daemon[855]: ts=2026-09-20T08:15:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592624762worker2 # [ 49.282170] nix-grpc-daemon[928]: time=2026-09-20T08:15:47.895Z level=INFO msg="All 2 paths already cached"4763client # copying 1 paths to 'lb:50051'...4764worker2 # [ 49.289292] nix-grpc-daemon[855]: ts=2026-09-20T08:15:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592624765client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4766worker2 # [ 49.306188] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4767worker2 # [ 49.468723] nix-daemon[919]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4768worker2 # [ 49.482425] nix-daemon[919]: reaped child process 1012, status = succeeded4769worker2 # [ 49.610430] nix-daemon[919]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4770worker2 # [ 49.623809] nix-daemon[919]: reaped child process 1017, status = succeeded4771lb # [ 49.626325] niks3-server[1206]: 2026/09/20 08:15:48 INFO Received uploads request method=POST path=/api/pending_closures4772worker2 # [ 49.635182] nix-grpc-daemon[928]: time=2026-09-20T08:15:48.248Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4773worker2 # [ 49.636527] nix-grpc-daemon[928]: time=2026-09-20T08:15:48.248Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4774lb # [ 49.637790] niks3-server[1206]: 2026/09/20 08:15:48 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4775lb # [ 49.645201] niks3-server[1206]: 2026/09/20 08:15:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4776worker2 # [ 49.655178] nix-grpc-daemon[928]: time=2026-09-20T08:15:48.268Z level=INFO msg="Uploading 1 narinfos"4777lb # [ 49.650717] niks3-server[1206]: 2026/09/20 08:15:48 INFO Signed narinfos id=5 count=14778lb # [ 49.655686] niks3-server[1206]: 2026/09/20 08:15:48 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4779lb # [ 49.664531] niks3-server[1206]: 2026/09/20 08:15:48 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4780lb # [ 49.668045] niks3-server[1206]: 2026/09/20 08:15:48 INFO Completed upload id=54781worker2 # [ 49.672562] nix-grpc-daemon[928]: time=2026-09-20T08:15:48.286Z level=INFO msg="Upload complete. (352ms)"4782lb # [ 49.669502] niks3-server[1206]: 2026/09/20 08:15:48 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4783worker2 # [ 49.675916] nix-grpc-daemon[855]: ts=2026-09-20T08:15:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_in=7524784worker2 # [ 49.678365] nix-grpc-daemon[855]: ts=2026-09-20T08:15:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624785worker2 # [ 49.682562] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4786worker2 # [ 49.687299] nix-daemon[919]: reaped child process 1007, status = succeeded4787client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4788client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4789worker2 # [ 49.693212] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4790client # farm-top> LOG-farm-top-t14791worker2 # [ 51.106602] nix-daemon[919]: reaped child process 1021, status = succeeded4792worker2 # [ 51.234283] nix-daemon[919]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4793worker2 # [ 51.246295] nix-daemon[919]: reaped child process 1039, status = succeeded4794lb # [ 51.254565] niks3-server[1206]: 2026/09/20 08:15:50 INFO Received uploads request method=POST path=/api/pending_closures4795worker2 # [ 51.266493] nix-grpc-daemon[928]: time=2026-09-20T08:15:49.880Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4796worker2 # [ 51.267969] nix-grpc-daemon[928]: time=2026-09-20T08:15:49.881Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4797lb # [ 51.297701] niks3-server[1206]: 2026/09/20 08:15:50 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4798lb # [ 51.303756] niks3-server[1206]: 2026/09/20 08:15:50 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4799lb # [ 51.313237] niks3-server[1206]: 2026/09/20 08:15:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4800worker2 # [ 51.321806] nix-grpc-daemon[928]: time=2026-09-20T08:15:49.935Z level=INFO msg="Uploading 1 narinfos"4801lb # [ 51.317099] niks3-server[1206]: 2026/09/20 08:15:50 INFO Signed narinfos id=6 count=14802lb # [ 51.325109] niks3-server[1206]: 2026/09/20 08:15:50 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4803lb # [ 51.329386] niks3-server[1206]: 2026/09/20 08:15:50 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4804lb # [ 51.333695] niks3-server[1206]: 2026/09/20 08:15:50 INFO Completed upload id=64805worker2 # [ 51.338151] nix-grpc-daemon[928]: time=2026-09-20T08:15:49.951Z level=INFO msg="Upload complete. (238ms)"4806lb # [ 51.334874] niks3-server[1206]: 2026/09/20 08:15:50 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4807worker2 # [ 51.340713] nix-grpc-daemon[855]: ts=2026-09-20T08:15:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14808worker2 # [ 51.347145] nix-daemon[919]: reaped child process 1019, status = succeeded4809client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.19 seconds)4810client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4811client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.20 seconds)4812client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4813client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4814client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4815client # copying 3 paths...4816client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4817client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4818client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4819client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.48 seconds)4820(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.95 seconds)4821subtest: repeat is answered Cached by the scheduler without building4822worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4823worker1 # finding garbage collector roots...4824worker1 # deleting specified paths...4825worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4826worker1 # deleting unused links...4827worker1 # note: hard linking is currently saving 0.0 KiB4828worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4829worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4830worker2 # finding garbage collector roots...4831worker2 # deleting specified paths...4832worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4833worker2 # deleting unused links...4834worker2 # note: hard linking is currently saving 0.0 KiB4835worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4836client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24837worker2 # [ 52.783801] nix-grpc-daemon[855]: ts=2026-09-20T08:15:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592624838client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4839client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4840worker1 # [ 52.918964] nix-grpc-daemon[850]: ts=2026-09-20T08:15:51Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14841worker1 # [ 52.936162] nix-grpc-daemon[850]: ts=2026-09-20T08:15:51Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14842worker1 # [ 52.949520] nix-grpc-daemon[850]: ts=2026-09-20T08:15:51Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14843client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.38 seconds)4844client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4845client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4846lb: must succeed: curl -sf localhost:9901/clusters4847lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4848lb: must succeed: curl -sf localhost:9901/clusters4849lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4850worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4851worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.04 seconds)4852(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.23 seconds)4853subtest: two clients wanting the same drv build it once4854client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4855client # [ 53.400909] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4856client # Running as unit: dedup1.service; invocation ID: f1c03f557e944dcc8b9b8bb675432fa24857client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4858client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4859worker1 # [ 53.623103] nix-grpc-daemon[850]: ts=2026-09-20T08:15:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379784860client # [ 53.605365] nix[865]: don't know how to build these paths:4861client # [ 53.606243] nix[865]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4862worker1 # [ 53.633868] nix-grpc-daemon[850]: ts=2026-09-20T08:15:52Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04863worker1 # [ 53.639470] nix-grpc-daemon[850]: ts=2026-09-20T08:15:52Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14864worker1 # [ 53.645072] nix-grpc-daemon[850]: ts=2026-09-20T08:15:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379784865worker1 # [ 53.658714] nix-grpc-daemon[850]: ts=2026-09-20T08:15:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379784866client # [ 53.647094] nix[865]: copying 1 paths to 'lb:50051'...4867client # [ 53.647961] nix[865]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4868worker1 # [ 53.669667] nix-grpc-daemon[850]: ts=2026-09-20T08:15:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379784869worker1 # [ 53.681278] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4870worker1 # [ 53.717418] nix-grpc-daemon[850]: ts=2026-09-20T08:15:52Z level=info event=niks3_push_started pid=9604871worker1 # [ 54.095487] nix-daemon[918]: accepted connection from pid 971, user nix-grpc-daemon (trusted)4872worker1 # [ 54.110217] nix-daemon[918]: reaped child process 975, status = succeeded4873worker1 # [ 54.248799] nix-daemon[918]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4874worker1 # [ 54.261408] nix-daemon[918]: reaped child process 980, status = succeeded4875lb # [ 54.274715] niks3-server[1206]: 2026/09/20 08:15:53 INFO Received uploads request method=POST path=/api/pending_closures4876worker1 # [ 54.307616] nix-grpc-daemon[960]: time=2026-09-20T08:15:53.011Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4877worker1 # [ 54.310112] nix-grpc-daemon[960]: time=2026-09-20T08:15:53.014Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4878lb # [ 54.339809] niks3-server[1206]: 2026/09/20 08:15:53 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4879lb # [ 54.346987] niks3-server[1206]: 2026/09/20 08:15:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4880lb # [ 54.354083] niks3-server[1206]: 2026/09/20 08:15:53 INFO Signed narinfos id=7 count=14881worker1 # [ 54.353698] nix-grpc-daemon[960]: time=2026-09-20T08:15:53.058Z level=INFO msg="Uploading 1 narinfos"4882lb # [ 54.362507] niks3-server[1206]: 2026/09/20 08:15:53 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4883lb # [ 54.373350] niks3-server[1206]: 2026/09/20 08:15:53 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4884lb # [ 54.379040] niks3-server[1206]: 2026/09/20 08:15:53 INFO Completed upload id=74885worker1 # [ 54.375674] nix-grpc-daemon[960]: time=2026-09-20T08:15:53.080Z level=INFO msg="Upload complete. (430ms)"4886lb # [ 54.383784] niks3-server[1206]: 2026/09/20 08:15:53 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4887worker1 # [ 54.379941] nix-grpc-daemon[850]: ts=2026-09-20T08:15:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=1 nar_bytes_in=4324888worker1 # [ 54.386288] nix-grpc-daemon[850]: ts=2026-09-20T08:15:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379784889worker1 # [ 54.396353] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4890worker1 # [ 54.399640] nix-daemon[918]: reaped child process 958, status = succeeded4891client # [ 54.382871] nix[865]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4892worker1 # [ 54.406055] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4893client # [ 54.468861] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4894client # Running as unit: dedup2.service; invocation ID: d09e73e41f814f13ab0ffd4455cc304c4895client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.06 seconds)4896worker2 # [ 54.751158] nix-grpc-daemon[855]: ts=2026-09-20T08:15:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592624897client # [ 54.727565] nix[880]: don't know how to build these paths:4898client # [ 54.729283] nix[880]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4899worker1 # [ 54.757648] nix-grpc-daemon[850]: ts=2026-09-20T08:15:53Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04900worker1 # [ 54.767597] nix-grpc-daemon[850]: ts=2026-09-20T08:15:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379784901client # [ 54.751247] nix[880]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4902client: must succeed: sleep 24903client: (finished: must succeed: sleep 2, in 2.03 seconds)4904lb # [ 58.888796] envoy[982]: conn peer=[2001:db8:1::1]:41858 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9368 tx=3799 ms=60064905lb # [ 58.892686] envoy[982]: conn peer=[2001:db8:1::1]:41872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1201 tx=498 ms=1894906??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4907 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394908client: waiting for success: ! systemctl is-active dedup1 dedup24909??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4910 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394911worker1 # [ 59.022737] nix-daemon[918]: reaped child process 984, status = succeeded4912worker1 # [ 59.173271] nix-daemon[918]: accepted connection from pid 1019, user nix-grpc-daemon (trusted)4913worker1 # [ 59.186867] nix-daemon[918]: reaped child process 1022, status = succeeded4914lb # [ 59.204266] niks3-server[1206]: 2026/09/20 08:15:57 INFO Received uploads request method=POST path=/api/pending_closures4915worker1 # [ 59.208804] nix-grpc-daemon[960]: time=2026-09-20T08:15:57.913Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4916worker1 # [ 59.210801] nix-grpc-daemon[960]: time=2026-09-20T08:15:57.913Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4917lb # [ 59.253399] niks3-server[1206]: 2026/09/20 08:15:58 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4918lb # [ 59.259217] niks3-server[1206]: 2026/09/20 08:15:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4919lb # [ 59.262897] niks3-server[1206]: 2026/09/20 08:15:58 INFO Signed narinfos id=8 count=14920worker1 # [ 59.263086] nix-grpc-daemon[960]: time=2026-09-20T08:15:57.967Z level=INFO msg="Uploading 1 narinfos"4921lb # [ 59.268685] niks3-server[1206]: 2026/09/20 08:15:58 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4922lb # [ 59.280113] niks3-server[1206]: 2026/09/20 08:15:58 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4923lb # [ 59.283184] niks3-server[1206]: 2026/09/20 08:15:58 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4924lb # [ 59.286155] niks3-server[1206]: 2026/09/20 08:15:58 INFO Completed upload id=84925lb # [ 59.287781] niks3-server[1206]: 2026/09/20 08:15:58 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4926worker1 # [ 59.284614] nix-grpc-daemon[960]: time=2026-09-20T08:15:57.989Z level=INFO msg="Upload complete. (266ms)"4927worker1 # [ 59.292258] nix-grpc-daemon[850]: ts=2026-09-20T08:15:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14928worker1 # [ 59.297245] nix-grpc-daemon[850]: ts=2026-09-20T08:15:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14929worker1 # [ 59.306190] nix-daemon[918]: reaped child process 982, status = succeeded4930client # [ 59.300936] systemd[1]: dedup1.service: Deactivated successfully.4931client # [ 59.302591] systemd[1]: dedup1.service: Consumed 119ms CPU time over 5.901s wall clock time, 39.3M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.4932client # [ 59.333837] systemd[1]: dedup2.service: Deactivated successfully.4933client # [ 59.334853] systemd[1]: dedup2.service: Consumed 129ms CPU time over 4.864s wall clock time, 31.1M memory peak, 7.6K incoming IP traffic, 6.5K outgoing IP traffic.4934client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4935client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4936client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds)4937worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4938worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4939worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4940worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4941worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4942worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4943worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4944worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4945(finished: subtest: two clients wanting the same drv build it once, in 6.95 seconds)4946subtest: build hook: nix-daemon with builders = grpc://lb4947client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4948client # [ 60.487975] systemd[1]: Started Nix Daemon.4949client # [ 60.652595] nix-daemon[921]: accepted connection from pid 918, user root (trusted)4950worker1 # [ 60.852261] nix-grpc-daemon[850]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:379784951worker2 # [ 60.867227] nix-grpc-daemon[855]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592624952worker1 # [ 60.868968] nix-grpc-daemon[850]: ts=2026-09-20T08:15:59Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04953worker1 # [ 60.873498] nix-grpc-daemon[850]: ts=2026-09-20T08:15:59Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14954worker2 # [ 60.883892] nix-grpc-daemon[855]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624955worker2 # [ 60.895113] nix-grpc-daemon[855]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592624956worker2 # [ 60.905893] nix-grpc-daemon[855]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592624957worker2 # [ 60.916583] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4958worker2 # [ 61.070532] nix-daemon[919]: accepted connection from pid 1083, user nix-grpc-daemon (trusted)4959worker2 # [ 61.083113] nix-daemon[919]: reaped child process 1086, status = succeeded4960worker2 # [ 61.242581] nix-daemon[919]: accepted connection from pid 1088, user nix-grpc-daemon (trusted)4961worker2 # [ 61.254327] nix-daemon[919]: reaped child process 1091, status = succeeded4962lb # [ 61.263126] niks3-server[1206]: 2026/09/20 08:16:00 INFO Received uploads request method=POST path=/api/pending_closures4963worker2 # [ 61.271891] nix-grpc-daemon[928]: time=2026-09-20T08:15:59.885Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4964worker2 # [ 61.274092] nix-grpc-daemon[928]: time=2026-09-20T08:15:59.887Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4965lb # [ 61.283354] niks3-server[1206]: 2026/09/20 08:16:00 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4966lb # [ 61.295835] niks3-server[1206]: 2026/09/20 08:16:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4967lb # [ 61.301825] niks3-server[1206]: 2026/09/20 08:16:00 INFO Signed narinfos id=9 count=14968worker2 # [ 61.309496] nix-grpc-daemon[928]: time=2026-09-20T08:15:59.923Z level=INFO msg="Uploading 1 narinfos"4969lb # [ 61.314514] niks3-server[1206]: 2026/09/20 08:16:00 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4970lb # [ 61.360976] niks3-server[1206]: 2026/09/20 08:16:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4971lb # [ 61.366627] niks3-server[1206]: 2026/09/20 08:16:00 INFO Completed upload id=94972worker2 # [ 61.371424] nix-grpc-daemon[928]: time=2026-09-20T08:15:59.985Z level=INFO msg="Upload complete. (443ms)"4973lb # [ 61.370760] niks3-server[1206]: 2026/09/20 08:16:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4974worker2 # [ 61.377280] nix-grpc-daemon[855]: ts=2026-09-20T08:15:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_in=5124975worker2 # [ 61.383619] nix-grpc-daemon[855]: ts=2026-09-20T08:15:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592624976worker2 # [ 61.395615] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4977worker2 # [ 61.403326] nix-daemon[919]: reaped child process 1081, status = succeeded4978worker2 # [ 61.408222] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4979worker2 # [ 62.421744] nix-daemon[919]: reaped child process 1095, status = succeeded4980worker2 # [ 62.533948] nix-daemon[919]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4981worker2 # [ 62.545805] nix-daemon[919]: reaped child process 1113, status = succeeded4982lb # [ 62.554916] niks3-server[1206]: 2026/09/20 08:16:01 INFO Received uploads request method=POST path=/api/pending_closures4983worker2 # [ 62.570298] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.183Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4984worker2 # [ 62.571600] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.183Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4985lb # [ 62.583676] niks3-server[1206]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4986lb # [ 62.586400] niks3-server[1206]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4987lb # [ 62.589062] niks3-server[1206]: 2026/09/20 08:16:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4988lb # [ 62.590824] niks3-server[1206]: 2026/09/20 08:16:01 INFO Signed narinfos id=10 count=14989worker2 # [ 62.596785] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.210Z level=INFO msg="Uploading 1 narinfos"4990lb # [ 62.594675] niks3-server[1206]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4991lb # [ 62.599057] niks3-server[1206]: 2026/09/20 08:16:01 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4992lb # [ 62.602505] niks3-server[1206]: 2026/09/20 08:16:01 INFO Completed upload id=104993worker2 # [ 62.606977] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.220Z level=INFO msg="Upload complete. (192ms)"4994lb # [ 62.603902] niks3-server[1206]: 2026/09/20 08:16:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4995worker2 # [ 62.609398] nix-grpc-daemon[855]: ts=2026-09-20T08:16:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14996worker2 # [ 62.616123] nix-grpc-daemon[855]: ts=2026-09-20T08:16:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592624997worker2 # [ 62.618245] nix-daemon[919]: reaped child process 1093, status = succeeded4998worker1 # [ 62.626609] nix-grpc-daemon[850]: ts=2026-09-20T08:16:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:379784999worker1 # [ 62.633575] nix-grpc-daemon[850]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...5000worker1 # [ 62.642144] nix-grpc-daemon[850]: ts=2026-09-20T08:16:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=1 nar_bytes_out=1285001worker2 # [ 62.926698] nix-grpc-daemon[855]: ts=2026-09-20T08:16:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:592625002worker2 # [ 62.933557] nix-grpc-daemon[855]: ts=2026-09-20T08:16:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592625003worker2 # [ 62.941647] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.555Z level=INFO msg="All 1 paths already cached"5004worker1 # [ 62.945184] nix-grpc-daemon[850]: ts=2026-09-20T08:16:01Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=05005worker1 # [ 62.947267] nix-grpc-daemon[850]: ts=2026-09-20T08:16:01Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=15006worker2 # [ 62.957439] nix-grpc-daemon[855]: ts=2026-09-20T08:16:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592625007worker2 # [ 62.968784] nix-grpc-daemon[855]: ts=2026-09-20T08:16:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592625008worker2 # [ 62.980640] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.594Z level=INFO msg="All 1 paths already cached"5009worker2 # [ 62.988062] nix-grpc-daemon[855]: ts=2026-09-20T08:16:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592625010worker2 # [ 62.997168] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5011worker2 # [ 63.150969] nix-daemon[919]: accepted connection from pid 1117, user nix-grpc-daemon (trusted)5012worker2 # [ 63.164211] nix-daemon[919]: reaped child process 1120, status = succeeded5013worker2 # [ 63.307236] nix-daemon[919]: accepted connection from pid 1122, user nix-grpc-daemon (trusted)5014worker2 # [ 63.319323] nix-daemon[919]: reaped child process 1125, status = succeeded5015lb # [ 63.328816] niks3-server[1206]: 2026/09/20 08:16:02 INFO Received uploads request method=POST path=/api/pending_closures5016worker2 # [ 63.341281] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.954Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5017worker2 # [ 63.342640] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.954Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"5018lb # [ 63.352568] niks3-server[1206]: 2026/09/20 08:16:02 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst5019lb # [ 63.365123] niks3-server[1206]: 2026/09/20 08:16:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign5020lb # [ 63.369584] niks3-server[1206]: 2026/09/20 08:16:02 INFO Signed narinfos id=11 count=15021worker2 # [ 63.377107] nix-grpc-daemon[928]: time=2026-09-20T08:16:01.990Z level=INFO msg="Uploading 1 narinfos"5022lb # [ 63.382668] niks3-server[1206]: 2026/09/20 08:16:02 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete5023lb # [ 63.387802] niks3-server[1206]: 2026/09/20 08:16:02 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls5024lb # [ 63.391238] niks3-server[1206]: 2026/09/20 08:16:02 INFO Completed upload id=115025worker2 # [ 63.395837] nix-grpc-daemon[928]: time=2026-09-20T08:16:02.009Z level=INFO msg="Upload complete. (385ms)"5026lb # [ 63.394267] niks3-server[1206]: 2026/09/20 08:16:02 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo5027worker2 # [ 63.399706] nix-grpc-daemon[855]: ts=2026-09-20T08:16:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_in=6245028worker2 # [ 63.405411] nix-grpc-daemon[855]: ts=2026-09-20T08:16:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592625029worker2 # [ 63.414994] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5030worker2 # [ 63.416887] nix-daemon[919]: reaped child process 1115, status = succeeded5031worker2 # [ 63.422071] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5032worker2 # [ 64.448419] nix-daemon[919]: reaped child process 1129, status = succeeded5033worker2 # [ 64.596209] nix-daemon[919]: accepted connection from pid 1144, user nix-grpc-daemon (trusted)5034worker2 # [ 64.606741] nix-daemon[919]: reaped child process 1147, status = succeeded5035lb # [ 64.617410] niks3-server[1206]: 2026/09/20 08:16:03 INFO Received uploads request method=POST path=/api/pending_closures5036worker2 # [ 64.627327] nix-grpc-daemon[928]: time=2026-09-20T08:16:03.240Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5037worker2 # [ 64.628772] nix-grpc-daemon[928]: time=2026-09-20T08:16:03.242Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"5038lb # [ 64.638270] niks3-server[1206]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv5039lb # [ 64.643299] niks3-server[1206]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst5040lb # [ 64.646291] niks3-server[1206]: 2026/09/20 08:16:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign5041worker2 # [ 64.654327] nix-grpc-daemon[928]: time=2026-09-20T08:16:03.267Z level=INFO msg="Uploading 1 narinfos"5042lb # [ 64.649943] niks3-server[1206]: 2026/09/20 08:16:03 INFO Signed narinfos id=12 count=15043lb # [ 64.652430] niks3-server[1206]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls5044lb # [ 64.658046] niks3-server[1206]: 2026/09/20 08:16:03 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete5045lb # [ 64.661148] niks3-server[1206]: 2026/09/20 08:16:03 INFO Completed upload id=125046worker2 # [ 64.667315] nix-grpc-daemon[928]: time=2026-09-20T08:16:03.281Z level=INFO msg="Upload complete. (238ms)"5047lb # [ 64.664290] niks3-server[1206]: 2026/09/20 08:16:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo5048worker2 # [ 64.669844] nix-grpc-daemon[855]: ts=2026-09-20T08:16:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=15049worker2 # [ 64.676233] nix-daemon[919]: reaped child process 1127, status = succeeded5050worker1 # [ 64.709486] nix-grpc-daemon[850]: ts=2026-09-20T08:16:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:379785051worker1 # [ 64.714896] nix-grpc-daemon[850]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...5052worker1 # [ 64.734203] nix-grpc-daemon[850]: ts=2026-09-20T08:16:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:379785053worker1 # [ 64.736247] nix-grpc-daemon[850]: ts=2026-09-20T08:16:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=1 nar_bytes_out=1765054worker2 # [ 65.013199] nix-grpc-daemon[855]: ts=2026-09-20T08:16:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:592625055worker2 # [ 65.019213] nix-grpc-daemon[855]: ts=2026-09-20T08:16:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592625056worker2 # [ 65.024089] nix-grpc-daemon[928]: time=2026-09-20T08:16:03.636Z level=INFO msg="All 2 paths already cached"5057worker1 # [ 65.027438] nix-grpc-daemon[850]: ts=2026-09-20T08:16:03Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=05058worker1 # [ 65.032304] nix-grpc-daemon[850]: ts=2026-09-20T08:16:03Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=15059worker2 # [ 65.042719] nix-grpc-daemon[855]: ts=2026-09-20T08:16:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592625060worker2 # [ 65.051577] nix-grpc-daemon[855]: ts=2026-09-20T08:16:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592625061worker2 # [ 65.063616] nix-grpc-daemon[928]: time=2026-09-20T08:16:03.677Z level=INFO msg="All 2 paths already cached"5062worker2 # [ 65.071281] nix-grpc-daemon[855]: ts=2026-09-20T08:16:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592625063worker2 # [ 65.079477] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5064worker2 # [ 65.219347] nix-daemon[919]: accepted connection from pid 1151, user nix-grpc-daemon (trusted)5065worker2 # [ 65.231857] nix-daemon[919]: reaped child process 1154, status = succeeded5066worker2 # [ 65.357950] nix-daemon[919]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)5067worker2 # [ 65.369866] nix-daemon[919]: reaped child process 1159, status = succeeded5068lb # [ 65.378485] niks3-server[1206]: 2026/09/20 08:16:04 INFO Received uploads request method=POST path=/api/pending_closures5069worker2 # [ 65.390515] nix-grpc-daemon[928]: time=2026-09-20T08:16:04.004Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5070worker2 # [ 65.391967] nix-grpc-daemon[928]: time=2026-09-20T08:16:04.005Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"5071lb # [ 65.406062] niks3-server[1206]: 2026/09/20 08:16:04 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst5072lb # [ 65.417925] niks3-server[1206]: 2026/09/20 08:16:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign5073worker2 # [ 65.427374] nix-grpc-daemon[928]: time=2026-09-20T08:16:04.041Z level=INFO msg="Uploading 1 narinfos"5074lb # [ 65.422837] niks3-server[1206]: 2026/09/20 08:16:04 INFO Signed narinfos id=13 count=15075lb # [ 65.428609] niks3-server[1206]: 2026/09/20 08:16:04 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls5076lb # [ 65.441463] niks3-server[1206]: 2026/09/20 08:16:04 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete5077worker2 # [ 65.450249] nix-grpc-daemon[928]: time=2026-09-20T08:16:04.063Z level=INFO msg="Upload complete. (357ms)"5078lb # [ 65.445876] niks3-server[1206]: 2026/09/20 08:16:04 INFO Completed upload id=135079worker2 # [ 65.452192] nix-grpc-daemon[855]: ts=2026-09-20T08:16:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_in=7525080lb # [ 65.449610] niks3-server[1206]: 2026/09/20 08:16:04 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo5081worker2 # [ 65.458418] nix-grpc-daemon[855]: ts=2026-09-20T08:16:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592625082worker2 # [ 65.462508] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5083worker2 # [ 65.464763] nix-daemon[919]: reaped child process 1149, status = succeeded5084worker2 # [ 65.470067] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5085worker2 # [ 66.884411] nix-daemon[919]: reaped child process 1163, status = succeeded5086worker2 # [ 67.022110] nix-daemon[919]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5087worker2 # [ 67.034322] nix-daemon[919]: reaped child process 1181, status = succeeded5088lb # [ 67.039713] niks3-server[1206]: 2026/09/20 08:16:05 INFO Received uploads request method=POST path=/api/pending_closures5089worker2 # [ 67.049130] nix-grpc-daemon[928]: time=2026-09-20T08:16:05.661Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5090worker2 # [ 67.050484] nix-grpc-daemon[928]: time=2026-09-20T08:16:05.662Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"5091lb # [ 67.051152] niks3-server[1206]: 2026/09/20 08:16:05 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv5092lb # [ 67.058771] niks3-server[1206]: 2026/09/20 08:16:05 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst5093lb # [ 67.060814] niks3-server[1206]: 2026/09/20 08:16:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign5094lb # [ 67.062825] niks3-server[1206]: 2026/09/20 08:16:05 INFO Signed narinfos id=14 count=15095worker2 # [ 67.067448] nix-grpc-daemon[928]: time=2026-09-20T08:16:05.681Z level=INFO msg="Uploading 1 narinfos"5096lb # [ 67.066441] niks3-server[1206]: 2026/09/20 08:16:05 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls5097lb # [ 67.070772] niks3-server[1206]: 2026/09/20 08:16:05 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete5098lb # [ 67.073600] niks3-server[1206]: 2026/09/20 08:16:05 INFO Completed upload id=145099worker2 # [ 67.079398] nix-grpc-daemon[928]: time=2026-09-20T08:16:05.693Z level=INFO msg="Upload complete. (201ms)"5100lb # [ 67.075226] niks3-server[1206]: 2026/09/20 08:16:05 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo5101worker2 # [ 67.081987] nix-grpc-daemon[855]: ts=2026-09-20T08:16:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=15102worker2 # [ 67.088304] nix-grpc-daemon[855]: ts=2026-09-20T08:16:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592625103worker2 # [ 67.090352] nix-daemon[919]: reaped child process 1161, status = succeeded5104worker1 # [ 67.094343] nix-grpc-daemon[850]: ts=2026-09-20T08:16:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:379785105worker1 # [ 67.103711] nix-grpc-daemon[850]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...5106worker1 # [ 67.118199] nix-grpc-daemon[850]: ts=2026-09-20T08:16:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=1 nar_bytes_out=2325107client # [ 67.193550] nix-daemon[921]: reaped child process 923, status = succeeded5108client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.91 seconds)5109client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5110client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)5111client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5112client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)5113client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5114client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)5115(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.00 seconds)5116subtest: an input only one worker has still reaches the builder5117client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only5118client # this derivation will be built:5119client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5120client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5121client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.43 seconds)5122client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5123client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.18 seconds)5124worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5125worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)5126worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5127worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.01 seconds)5128client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&25129client # [ 68.282200] nix-daemon[921]: accepted connection from pid 1001, user root (trusted)5130client # this derivation will be built:5131client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5132worker2 # [ 68.501035] nix-grpc-daemon[855]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:592625133worker2 # [ 68.505530] nix-grpc-daemon[855]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592625134client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5135client # copying 1 paths...5136client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...5137worker2 # [ 68.515514] nix-grpc-daemon[855]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592625138worker2 # [ 68.521270] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5139worker2 # [ 68.676917] nix-daemon[919]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5140worker2 # [ 68.690673] nix-daemon[919]: reaped child process 1191, status = succeeded5141lb # [ 68.697596] niks3-server[1206]: 2026/09/20 08:16:07 INFO Received uploads request method=POST path=/api/pending_closures5142worker2 # [ 68.708689] nix-grpc-daemon[928]: time=2026-09-20T08:16:07.322Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5143worker2 # [ 68.710593] nix-grpc-daemon[928]: time=2026-09-20T08:16:07.324Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5144lb # [ 68.717737] niks3-server[1206]: 2026/09/20 08:16:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign5145lb # [ 68.720405] niks3-server[1206]: 2026/09/20 08:16:07 INFO Signed narinfos id=15 count=15146worker2 # [ 68.726488] nix-grpc-daemon[928]: time=2026-09-20T08:16:07.340Z level=INFO msg="Uploading 1 narinfos"5147lb # [ 68.728080] niks3-server[1206]: 2026/09/20 08:16:07 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete5148lb # [ 68.735439] niks3-server[1206]: 2026/09/20 08:16:07 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5149lb # [ 68.740066] niks3-server[1206]: 2026/09/20 08:16:07 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5150lb # [ 68.742744] niks3-server[1206]: 2026/09/20 08:16:07 INFO Completed upload id=155151worker2 # [ 68.748890] nix-grpc-daemon[928]: time=2026-09-20T08:16:07.362Z level=INFO msg="Upload complete. (222ms)"5152lb # [ 68.744265] niks3-server[1206]: 2026/09/20 08:16:07 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5153worker2 # [ 68.751111] nix-grpc-daemon[855]: ts=2026-09-20T08:16:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_in=1205154worker2 # [ 68.756950] nix-daemon[919]: reaped child process 1186, status = succeeded5155worker1 # [ 68.759680] nix-grpc-daemon[850]: ts=2026-09-20T08:16:07Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05156worker1 # [ 68.765896] nix-grpc-daemon[850]: ts=2026-09-20T08:16:07Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=15157worker1 # [ 68.770548] nix-grpc-daemon[850]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379785158worker1 # [ 68.782828] nix-grpc-daemon[850]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379785159client # copying 2 paths to 'lb:50051'...5160client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5161worker1 # [ 68.798873] nix-grpc-daemon[850]: ts=2026-09-20T08:16:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379785162client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5163worker1 # [ 68.815148] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)5164lb # [ 68.888374] envoy[982]: conn peer=[2001:db8:1::1]:60142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1329 ms=56785165lb # [ 68.889985] envoy[982]: conn peer=[2001:db8:1::1]:60150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=46085166lb # [ 68.891494] envoy[982]: conn peer=[2001:db8:1::1]:60172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=685167lb # [ 68.893152] envoy[982]: conn peer=[2001:db8:1::1]:60166 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3380 tx=1618 ms=18445168lb # [ 68.895156] envoy[982]: conn peer=[2001:db8:1::1]:44006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=1965 ms=18685169lb # [ 68.896766] envoy[982]: conn peer=[2001:db8:1::1]:44008 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=535170lb # [ 68.898166] envoy[982]: conn peer=[2001:db8:1::1]:44014 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2109 ms=21655171lb # [ 68.899629] envoy[982]: conn peer=[2001:db8:1::1]:44022 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=755172worker1 # [ 68.987346] nix-daemon[918]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)5173worker1 # [ 69.001069] nix-daemon[918]: reaped child process 1056, status = succeeded5174worker1 # [ 69.160879] nix-daemon[918]: accepted connection from pid 1059, user nix-grpc-daemon (trusted)5175worker1 # [ 69.173354] nix-daemon[918]: reaped child process 1062, status = succeeded5176lb # [ 69.186929] niks3-server[1206]: 2026/09/20 08:16:07 INFO Received uploads request method=POST path=/api/pending_closures5177lb # [ 69.196933] niks3-server[1206]: 2026/09/20 08:16:07 INFO Received uploads request method=POST path=/api/pending_closures5178worker1 # [ 69.204052] nix-grpc-daemon[960]: time=2026-09-20T08:16:07.909Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5179worker1 # [ 69.206335] nix-grpc-daemon[960]: time=2026-09-20T08:16:07.911Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5180worker1 # [ 69.207969] nix-grpc-daemon[960]: time=2026-09-20T08:16:07.911Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5181lb # [ 69.247894] niks3-server[1206]: 2026/09/20 08:16:08 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5182lb # [ 69.250622] niks3-server[1206]: 2026/09/20 08:16:08 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5183lb # [ 69.255710] niks3-server[1206]: 2026/09/20 08:16:08 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5184lb # [ 69.259103] niks3-server[1206]: 2026/09/20 08:16:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5185lb # [ 69.260792] niks3-server[1206]: 2026/09/20 08:16:08 INFO Signed narinfos id=16 count=15186lb # [ 69.263342] niks3-server[1206]: 2026/09/20 08:16:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5187lb # [ 69.265738] niks3-server[1206]: 2026/09/20 08:16:08 INFO Signed narinfos id=17 count=25188lb # [ 69.267638] niks3-server[1206]: 2026/09/20 08:16:08 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5189worker1 # [ 69.263126] nix-grpc-daemon[960]: time=2026-09-20T08:16:07.967Z level=INFO msg="Uploading 3 narinfos"5190lb # [ 69.282068] niks3-server[1206]: 2026/09/20 08:16:08 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5191lb # [ 69.296071] niks3-server[1206]: 2026/09/20 08:16:08 INFO Completed upload id=165192lb # [ 69.297841] niks3-server[1206]: 2026/09/20 08:16:08 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5193lb # [ 69.303931] niks3-server[1206]: 2026/09/20 08:16:08 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5194lb # [ 69.311937] niks3-server[1206]: 2026/09/20 08:16:08 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5195lb # [ 69.315339] niks3-server[1206]: 2026/09/20 08:16:08 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5196lb # [ 69.317304] niks3-server[1206]: 2026/09/20 08:16:08 INFO Completed upload id=175197worker1 # [ 69.315032] nix-grpc-daemon[960]: time=2026-09-20T08:16:08.020Z level=INFO msg="Upload complete. (483ms)"5198worker1 # [ 69.317183] nix-grpc-daemon[850]: ts=2026-09-20T08:16:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=2 nar_bytes_in=9765199worker1 # [ 69.320186] nix-grpc-daemon[850]: ts=2026-09-20T08:16:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379785200worker1 # [ 69.329172] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)5201worker1 # [ 69.341627] nix-daemon[918]: reaped child process 1051, status = succeeded5202client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5203worker1 # [ 69.348707] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)5204client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5205worker1 # [ 70.970669] nix-daemon[918]: reaped child process 1066, status = succeeded5206worker1 # [ 71.106569] nix-daemon[918]: accepted connection from pid 1081, user nix-grpc-daemon (trusted)5207worker1 # [ 71.119182] nix-daemon[918]: reaped child process 1084, status = succeeded5208lb # [ 71.140522] niks3-server[1206]: 2026/09/20 08:16:09 INFO Received uploads request method=POST path=/api/pending_closures5209worker1 # [ 71.146221] nix-grpc-daemon[960]: time=2026-09-20T08:16:09.851Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5210lb # [ 71.181904] niks3-server[1206]: 2026/09/20 08:16:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5211lb # [ 71.185750] niks3-server[1206]: 2026/09/20 08:16:09 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5212lb # [ 71.193116] niks3-server[1206]: 2026/09/20 08:16:09 INFO Signed narinfos id=18 count=15213worker1 # [ 71.192669] nix-grpc-daemon[960]: time=2026-09-20T08:16:09.897Z level=INFO msg="Uploading 1 narinfos"5214lb # [ 71.197654] niks3-server[1206]: 2026/09/20 08:16:09 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5215lb # [ 71.208175] niks3-server[1206]: 2026/09/20 08:16:09 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5216lb # [ 71.214737] niks3-server[1206]: 2026/09/20 08:16:10 INFO Completed upload id=185217worker1 # [ 71.211476] nix-grpc-daemon[960]: time=2026-09-20T08:16:09.916Z level=INFO msg="Upload complete. (252ms)"5218lb # [ 71.217102] niks3-server[1206]: 2026/09/20 08:16:10 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5219worker1 # [ 71.219345] nix-grpc-daemon[850]: ts=2026-09-20T08:16:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=15220worker1 # [ 71.230378] nix-daemon[918]: reaped child process 1064, status = succeeded5221client # copying 1 paths...5222worker1 # [ 71.263882] nix-grpc-daemon[850]: ts=2026-09-20T08:16:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:379785223client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5224worker2 # [ 71.292400] nix-grpc-daemon[855]: ts=2026-09-20T08:16:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:592625225worker2 # [ 71.308364] nix-grpc-daemon[855]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5226worker2 # [ 71.330910] nix-grpc-daemon[855]: ts=2026-09-20T08:16:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=0 paths=1 nar_bytes_out=1205227client # [ 71.402571] nix-daemon[921]: reaped child process 1004, status = succeeded5228client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.30 seconds)5229client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25230client # [ 71.581095] nix-daemon[921]: accepted connection from pid 1022, user root (trusted)5231client # this derivation will be built:5232client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5233worker1 # [ 71.779068] nix-grpc-daemon[850]: ts=2026-09-20T08:16:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:379785234client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5235worker1 # [ 71.787724] nix-grpc-daemon[850]: ts=2026-09-20T08:16:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379785236worker1 # [ 71.799642] nix-grpc-daemon[960]: time=2026-09-20T08:16:10.504Z level=INFO msg="All 1 paths already cached"5237worker1 # [ 71.817191] nix-grpc-daemon[850]: ts=2026-09-20T08:16:10Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05238worker1 # [ 71.822807] nix-grpc-daemon[850]: ts=2026-09-20T08:16:10Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15239worker2 # [ 71.833899] nix-grpc-daemon[855]: ts=2026-09-20T08:16:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592625240worker2 # [ 71.849713] nix-grpc-daemon[855]: ts=2026-09-20T08:16:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592625241client # copying 1 paths to 'lb:50051'...5242client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5243worker2 # [ 71.870397] nix-grpc-daemon[855]: ts=2026-09-20T08:16:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592625244worker2 # [ 71.884897] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5245worker2 # [ 71.904338] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)5246worker2 # [ 71.988454] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 2/5)5247worker2 # [ 72.105718] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 3/5)5248worker2 # [ 72.275896] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 629 ms (attempt 4/5)5249worker2 # [ 72.908455] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5250worker2 # [ 72.910953] nix-grpc-daemon[855]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5251worker2 # [ 73.089423] nix-daemon[919]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5252worker2 # [ 73.104328] nix-daemon[919]: reaped child process 1203, status = succeeded5253worker2 # [ 73.254190] nix-daemon[919]: accepted connection from pid 1205, user nix-grpc-daemon (trusted)5254worker2 # [ 73.268548] nix-daemon[919]: reaped child process 1208, status = succeeded5255lb # [ 73.272237] niks3-server[1206]: 2026/09/20 08:16:12 INFO Received uploads request method=POST path=/api/pending_closures5256worker2 # [ 73.282055] nix-grpc-daemon[928]: time=2026-09-20T08:16:11.895Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5257worker2 # [ 73.284309] nix-grpc-daemon[928]: time=2026-09-20T08:16:11.897Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5258lb # [ 73.288899] niks3-server[1206]: 2026/09/20 08:16:12 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5259lb # [ 73.293572] niks3-server[1206]: 2026/09/20 08:16:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5260lb # [ 73.295322] niks3-server[1206]: 2026/09/20 08:16:12 INFO Signed narinfos id=19 count=15261worker2 # [ 73.301474] nix-grpc-daemon[928]: time=2026-09-20T08:16:11.914Z level=INFO msg="Uploading 1 narinfos"5262lb # [ 73.300611] niks3-server[1206]: 2026/09/20 08:16:12 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5263lb # [ 73.304498] niks3-server[1206]: 2026/09/20 08:16:12 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5264lb # [ 73.308097] niks3-server[1206]: 2026/09/20 08:16:12 INFO Completed upload id=195265worker2 # [ 73.312667] nix-grpc-daemon[928]: time=2026-09-20T08:16:11.926Z level=INFO msg="Upload complete. (387ms)"5266worker2 # [ 73.315159] nix-grpc-daemon[855]: ts=2026-09-20T08:16:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 paths=1 nar_bytes_in=5605267lb # [ 73.311253] niks3-server[1206]: 2026/09/20 08:16:12 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5268worker2 # [ 73.318932] nix-grpc-daemon[855]: ts=2026-09-20T08:16:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592625269worker2 # [ 73.324053] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5270worker2 # [ 73.331128] nix-daemon[919]: reaped child process 1194, status = succeeded5271client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5272worker2 # [ 73.335629] nix-daemon[919]: accepted connection from pid 855, user nix-grpc-daemon (trusted)5273client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5274worker2 # [ 74.166333] nix-daemon[919]: reaped child process 1212, status = succeeded5275worker2 # [ 74.326100] nix-daemon[919]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5276worker2 # [ 74.338628] nix-daemon[919]: reaped child process 1230, status = succeeded5277lb # [ 74.349873] niks3-server[1206]: 2026/09/20 08:16:13 INFO Received uploads request method=POST path=/api/pending_closures5278worker2 # [ 74.365302] nix-grpc-daemon[928]: time=2026-09-20T08:16:12.978Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5279lb # [ 74.387148] niks3-server[1206]: 2026/09/20 08:16:13 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5280lb # [ 74.392593] niks3-server[1206]: 2026/09/20 08:16:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5281lb # [ 74.396196] niks3-server[1206]: 2026/09/20 08:16:13 INFO Signed narinfos id=20 count=15282worker2 # [ 74.403589] nix-grpc-daemon[928]: time=2026-09-20T08:16:13.017Z level=INFO msg="Uploading 1 narinfos"5283lb # [ 74.409895] niks3-server[1206]: 2026/09/20 08:16:13 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5284lb # [ 74.413234] niks3-server[1206]: 2026/09/20 08:16:13 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5285lb # [ 74.416747] niks3-server[1206]: 2026/09/20 08:16:13 INFO Completed upload id=205286worker2 # [ 74.421664] nix-grpc-daemon[928]: time=2026-09-20T08:16:13.035Z level=INFO msg="Upload complete. (278ms)"5287lb # [ 74.419242] niks3-server[1206]: 2026/09/20 08:16:13 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5288client # copying 1 paths...5289worker2 # [ 74.427559] nix-grpc-daemon[855]: ts=2026-09-20T08:16:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59262 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15290worker2 # [ 74.434323] nix-grpc-daemon[855]: ts=2026-09-20T08:16:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592625291client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5292worker2 # [ 74.440094] nix-daemon[919]: reaped child process 1210, status = succeeded5293worker1 # [ 74.447417] nix-grpc-daemon[850]: ts=2026-09-20T08:16:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:379785294worker1 # [ 74.457277] nix-grpc-daemon[850]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5295worker1 # [ 74.469457] nix-grpc-daemon[850]: ts=2026-09-20T08:16:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=1 nar_bytes_out=1205296client # [ 74.542264] nix-daemon[921]: reaped child process 1025, status = succeeded5297client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.14 seconds)5298client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25299client # [ 74.715711] nix-daemon[921]: accepted connection from pid 1043, user root (trusted)5300client # this derivation will be built:5301client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5302client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5303worker2 # [ 75.417221] nix-grpc-daemon[855]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:592625304worker2 # [ 75.425065] nix-grpc-daemon[855]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592625305worker2 # [ 75.430725] nix-grpc-daemon[928]: time=2026-09-20T08:16:14.042Z level=INFO msg="All 1 paths already cached"5306worker1 # [ 75.432122] nix-grpc-daemon[850]: ts=2026-09-20T08:16:14Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05307worker1 # [ 75.434521] nix-grpc-daemon[850]: ts=2026-09-20T08:16:14Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15308worker1 # [ 75.476254] nix-grpc-daemon[850]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379785309worker1 # [ 75.485363] nix-grpc-daemon[850]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379785310worker1 # [ 75.495516] nix-grpc-daemon[960]: time=2026-09-20T08:16:14.200Z level=INFO msg="All 1 paths already cached"5311client # copying 1 paths to 'lb:50051'...5312client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5313worker1 # [ 75.500548] nix-grpc-daemon[850]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379785314worker1 # [ 75.506933] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)5315worker1 # [ 75.677915] nix-daemon[918]: accepted connection from pid 1093, user nix-grpc-daemon (trusted)5316worker1 # [ 75.694478] nix-daemon[918]: reaped child process 1096, status = succeeded5317worker1 # [ 75.834092] nix-daemon[918]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)5318worker1 # [ 75.845827] nix-daemon[918]: reaped child process 1101, status = succeeded5319lb # [ 75.867476] niks3-server[1206]: 2026/09/20 08:16:14 INFO Received uploads request method=POST path=/api/pending_closures5320worker1 # [ 75.870642] nix-grpc-daemon[960]: time=2026-09-20T08:16:14.575Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5321worker1 # [ 75.872266] nix-grpc-daemon[960]: time=2026-09-20T08:16:14.577Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5322lb # [ 75.905079] niks3-server[1206]: 2026/09/20 08:16:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5323worker1 # [ 75.911787] nix-grpc-daemon[960]: time=2026-09-20T08:16:14.616Z level=INFO msg="Uploading 1 narinfos"5324lb # [ 75.914860] niks3-server[1206]: 2026/09/20 08:16:14 INFO Signed narinfos id=21 count=15325lb # [ 75.927270] niks3-server[1206]: 2026/09/20 08:16:14 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5326lb # [ 75.941983] niks3-server[1206]: 2026/09/20 08:16:14 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5327lb # [ 75.949519] niks3-server[1206]: 2026/09/20 08:16:14 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5328lb # [ 75.954681] niks3-server[1206]: 2026/09/20 08:16:14 INFO Completed upload id=215329lb # [ 75.957332] niks3-server[1206]: 2026/09/20 08:16:14 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5330worker1 # [ 75.953882] nix-grpc-daemon[960]: time=2026-09-20T08:16:14.658Z level=INFO msg="Upload complete. (430ms)"5331worker1 # [ 75.960167] nix-grpc-daemon[850]: ts=2026-09-20T08:16:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=1 nar_bytes_in=5605332worker1 # [ 75.966194] nix-grpc-daemon[850]: ts=2026-09-20T08:16:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379785333worker1 # [ 75.977499] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)5334worker1 # [ 75.987853] nix-daemon[918]: reaped child process 1091, status = succeeded5335client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5336client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5337worker1 # [ 75.996763] nix-daemon[918]: accepted connection from pid 850, user nix-grpc-daemon (trusted)5338worker1 # [ 77.210769] nix-daemon[918]: reaped child process 1105, status = succeeded5339worker1 # [ 77.354474] nix-daemon[918]: accepted connection from pid 1120, user nix-grpc-daemon (trusted)5340worker1 # [ 77.366370] nix-daemon[918]: reaped child process 1123, status = succeeded5341lb # [ 77.384463] niks3-server[1206]: 2026/09/20 08:16:16 INFO Received uploads request method=POST path=/api/pending_closures5342worker1 # [ 77.686615] nix-grpc-daemon[960]: time=2026-09-20T08:16:16.390Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5343lb # [ 77.703914] niks3-server[1206]: 2026/09/20 08:16:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5344lb # [ 77.706787] niks3-server[1206]: 2026/09/20 08:16:16 INFO Signed narinfos id=22 count=15345worker1 # [ 77.703693] nix-grpc-daemon[960]: time=2026-09-20T08:16:16.408Z level=INFO msg="Uploading 1 narinfos"5346lb # [ 77.711310] niks3-server[1206]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5347lb # [ 77.714118] niks3-server[1206]: 2026/09/20 08:16:16 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5348lb # [ 77.722663] niks3-server[1206]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5349lb # [ 77.732448] niks3-server[1206]: 2026/09/20 08:16:16 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5350lb # [ 77.741120] niks3-server[1206]: 2026/09/20 08:16:16 INFO Completed upload id=225351worker1 # [ 77.737835] nix-grpc-daemon[960]: time=2026-09-20T08:16:16.443Z level=INFO msg="Upload complete. (533ms)"5352worker1 # [ 77.743642] nix-grpc-daemon[850]: ts=2026-09-20T08:16:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15353worker1 # [ 77.757994] nix-daemon[918]: reaped child process 1103, status = succeeded5354client # copying 1 paths...5355worker1 # [ 77.786999] nix-grpc-daemon[850]: ts=2026-09-20T08:16:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:379785356client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5357worker1 # [ 77.811172] nix-grpc-daemon[850]: ts=2026-09-20T08:16:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:379785358worker1 # [ 77.816349] nix-grpc-daemon[850]: ts=2026-09-20T08:16:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37978 duration_s=0 paths=1 nar_bytes_out=1205359client # [ 77.902156] nix-daemon[921]: reaped child process 1046, status = succeeded5360client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.36 seconds)5361(finished: subtest: an input only one worker has still reaches the builder, in 10.62 seconds)5362subtest: upload whose reference the worker lacks is completed from the cache5363client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5364client # this derivation will be built:5365client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5366client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5367client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.36 seconds)5368client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5369client # this derivation will be built:5370client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5371client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5372client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.39 seconds)5373client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5374client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5375worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5376lb # [ 78.889524] envoy[982]: conn peer=[2001:db8:1::1]:44032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4203 tx=1727 ms=28835377lb # [ 78.891079] envoy[982]: conn peer=[2001:db8:1::1]:44034 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=945378lb # [ 78.892482] envoy[982]: conn peer=[2001:db8:1::1]:44040 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1806 ms=27425379lb # [ 78.893865] envoy[982]: conn peer=[2001:db8:1::1]:41984 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=785380lb # [ 78.895202] envoy[982]: conn peer=[2001:db8:1::1]:42006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=585381lb # [ 78.896559] envoy[982]: conn peer=[2001:db8:1::1]:41992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3699 tx=1802 ms=24635382worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds)5383worker2 # [ 79.119233] systemd[1]: Stopping Nix worker-protocol over gRPC...5384worker2 # [ 80.113431] nix-grpc-daemon[855]: ts=2026-09-20T08:16:18Z level=info event=signal_exit5385worker2 # [ 81.583911] nix-grpc-daemon[855]: ts=2026-09-20T08:16:20Z level=info event=scheduler_restarting5386worker1 # [ 81.583238] nix-grpc-daemon[850]: ts=2026-09-20T08:16:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:464865387worker1 # [ 81.584689] nix-grpc-daemon[850]: ts=2026-09-20T08:16:20Z level=info event=worker_gone addr=192.168.1.4:500515388worker2 # [ 81.608152] nix-grpc-daemon[855]: ts=2026-09-20T08:16:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5389worker2 # [ 81.629803] nix-daemon[919]: reaped child process 921, status = succeeded5390worker2 # [ 82.238355] nix-grpc-daemon[855]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5391worker2 # [ 82.242181] nix-grpc-daemon[855]: E0000 00:00:1789892180.851365 898 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5392worker2 # [ 82.246948] nix-grpc-daemon[855]: E0000 00:00:1789892180.855541 898 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5393worker2 # [ 82.377443] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5394worker2 # [ 82.382298] systemd[1]: Stopped Nix worker-protocol over gRPC.5395worker2 # [ 82.385413] systemd[1]: nix-grpc-daemon.service: Consumed 2.463s CPU time over 1min 3.490s wall clock time, 54.1M memory peak, 89.7K incoming IP traffic, 168K outgoing IP traffic.5396worker2 # [ 82.396878] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5397worker2 # [ 82.401399] systemd[1]: Closed Nix worker-protocol over gRPC.5398worker2 # [ 82.404861] systemd[1]: nix-grpc-daemon.socket: Consumed 404us CPU time over 1min 13.216s wall clock time, 256K memory peak, 124.7K incoming IP traffic, 96.4K outgoing IP traffic.5399lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5400lb: must succeed: curl -sf localhost:9901/clusters5401lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5402lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5403client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25404worker1 # [ 82.652379] nix-grpc-daemon[850]: ts=2026-09-20T08:16:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379785405worker1 # [ 82.658710] nix-grpc-daemon[850]: ts=2026-09-20T08:16:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:379785406client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5407client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.23 seconds)5408worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5409worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5410worker2 # [ 82.765762] systemd[1]: Listening on Nix worker-protocol over gRPC.5411worker1 # [ 82.811546] systemd[1]: Stopping Nix worker-protocol over gRPC...5412worker1 # [ 83.108292] nix-grpc-daemon[850]: ts=2026-09-20T08:16:21Z level=info event=signal_exit5413worker2 # [ 83.367398] systemd[1]: Starting Nix worker-protocol over gRPC...5414worker2 # [ 83.509070] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5415worker2 # [ 83.511445] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15416worker2 # [ 83.517946] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5417worker2 # [ 83.519661] systemd[1]: Started Nix worker-protocol over gRPC.5418worker2 # [ 83.549929] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515419worker2 # [ 83.553584] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5420worker1 # [ 83.582538] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_yield5421worker1 # [ 83.586598] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_restarting addr=lb:500515422lb # [ 83.588829] niks3-server[1206]: 2026/09/20 08:16:22 INFO lead: released remote=192.168.1.3:421465423worker1 # [ 83.592173] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:464865424worker1 # [ 83.595905] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=worker_gone addr=192.168.1.3:500515425worker2 # [ 83.754634] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515426worker2 # [ 83.766592] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5427worker1 # [ 83.787932] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515428worker1 # [ 83.791804] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5429worker2 # [ 83.967502] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515430worker2 # [ 83.971846] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5431worker1 # [ 83.992550] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515432worker1 # [ 83.996779] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5433worker2 # [ 84.172609] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515434worker2 # [ 84.176958] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5435worker1 # [ 84.197386] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515436worker1 # [ 84.201701] nix-grpc-daemon[850]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5437worker2 # [ 84.377646] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500515438worker2 # [ 84.381592] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5439worker1 # [ 84.401964] nix-grpc-daemon[850]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500515440worker1 # [ 84.403899] nix-grpc-daemon[850]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5441worker2 # [ 84.582366] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500515442worker2 # [ 84.584109] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5443worker1 # [ 84.586117] nix-grpc-daemon[850]: ts=2026-09-20T08:16:23Z level=info event=scheduler_restarting5444worker1 # [ 84.600771] nix-daemon[918]: reaped child process 920, status = succeeded5445worker1 # [ 84.618269] nix-grpc-daemon[850]: ts=2026-09-20T08:16:23Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5446worker2 # [ 84.784629] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500515447worker2 # [ 84.789768] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5448worker2 # [ 84.990488] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500515449worker1 # [ 84.985795] nix-grpc-daemon[850]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5450worker1 # [ 84.989251] nix-grpc-daemon[850]: E0000 00:00:1789892183.689954 893 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5451worker1 # [ 85.269476] nix-grpc-daemon[850]: E0000 00:00:1789892183.974263 893 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5452worker1 # [ 85.274289] nix-grpc-daemon[850]: E0000 00:00:1789892183.974796 893 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5453worker2 # [ 86.305627] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5454worker1 # [ 86.308504] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5455worker1 # [ 86.310310] systemd[1]: Stopped Nix worker-protocol over gRPC.5456worker1 # [ 86.312300] systemd[1]: nix-grpc-daemon.service: Consumed 1.577s CPU time over 1min 7.437s wall clock time, 52.9M memory peak, 62.3K incoming IP traffic, 121.4K outgoing IP traffic.5457worker1 # [ 86.316955] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5458worker1 # [ 86.318758] systemd[1]: Closed Nix worker-protocol over gRPC.5459worker1 # [ 86.319959] systemd[1]: nix-grpc-daemon.socket: Consumed 301us CPU time over 1min 15.597s wall clock time, 256K memory peak, 130.4K incoming IP traffic, 102.3K outgoing IP traffic.5460lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5461lb: must succeed: curl -sf localhost:9901/clusters5462lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5463lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5464client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25465worker2 # [ 86.505518] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500515466worker2 # [ 86.508489] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5467worker2 # [ 86.610248] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359365468worker2 # [ 86.622088] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5469worker2 # [ 86.640616] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5)5470worker2 # [ 86.666240] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 2/5)5471worker2 # [ 86.709583] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500515472worker2 # [ 86.713536] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5473worker2 # [ 86.761733] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 164 ms (attempt 3/5)5474worker2 # [ 86.914299] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500515475worker2 # [ 86.919062] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5476worker2 # [ 86.926188] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 678 ms (attempt 4/5)5477worker2 # [ 87.119589] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500515478worker2 # [ 87.121425] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5479worker2 # [ 87.323053] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500515480worker2 # [ 87.324623] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5481worker2 # [ 87.525099] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500515482worker2 # [ 87.527116] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5483worker2 # [ 87.610196] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5484client # copying 2 paths...5485worker2 # [ 87.623413] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359365486client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5487client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5488worker2 # [ 87.635086] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5489worker2 # [ 87.648370] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=niks3_push_started pid=13075490worker2 # [ 87.727697] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500515491worker2 # [ 87.730552] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5492worker2 # [ 87.919994] nix-daemon[919]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)5493worker2 # [ 87.930865] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500515494worker2 # [ 87.933076] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5495worker2 # [ 87.936931] nix-daemon[919]: reaped child process 1323, status = succeeded5496lb # [ 87.943354] niks3-server[1206]: 2026/09/20 08:16:26 INFO Received uploads request method=POST path=/api/pending_closures5497lb # [ 87.952099] niks3-server[1206]: 2026/09/20 08:16:26 INFO Received uploads request method=POST path=/api/pending_closures5498worker2 # [ 87.964304] nix-grpc-daemon[1307]: time=2026-09-20T08:16:26.577Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5499worker2 # [ 87.966076] nix-grpc-daemon[1307]: time=2026-09-20T08:16:26.579Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5500worker2 # [ 87.969094] nix-grpc-daemon[1307]: time=2026-09-20T08:16:26.579Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5501lb # [ 87.999665] niks3-server[1206]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5502lb # [ 88.005727] niks3-server[1206]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5503lb # [ 88.015591] niks3-server[1206]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5504lb # [ 88.021771] niks3-server[1206]: 2026/09/20 08:16:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5505lb # [ 88.026048] niks3-server[1206]: 2026/09/20 08:16:26 INFO Signed narinfos id=23 count=15506lb # [ 88.027835] niks3-server[1206]: 2026/09/20 08:16:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5507lb # [ 88.029481] niks3-server[1206]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5508lb # [ 88.031239] niks3-server[1206]: 2026/09/20 08:16:26 INFO Signed narinfos id=24 count=25509worker2 # [ 88.038176] nix-grpc-daemon[1307]: time=2026-09-20T08:16:26.650Z level=INFO msg="Uploading 3 narinfos"5510lb # [ 88.044373] niks3-server[1206]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5511lb # [ 88.046508] niks3-server[1206]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5512lb # [ 88.051162] niks3-server[1206]: 2026/09/20 08:16:26 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5513lb # [ 88.054055] niks3-server[1206]: 2026/09/20 08:16:26 INFO Completed upload id=235514lb # [ 88.056473] niks3-server[1206]: 2026/09/20 08:16:26 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5515lb # [ 88.058160] niks3-server[1206]: 2026/09/20 08:16:26 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5516lb # [ 88.060402] niks3-server[1206]: 2026/09/20 08:16:26 INFO Completed upload id=245517worker2 # [ 88.065320] nix-grpc-daemon[1307]: time=2026-09-20T08:16:26.678Z level=INFO msg="Upload complete. (268ms)"5518worker2 # [ 88.070127] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=0 paths=2 nar_bytes_in=3125519worker2 # [ 88.082283] nix-daemon[919]: reaped child process 1305, status = succeeded5520client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.70 seconds)5521worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5522worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5523worker2 # [ 88.133686] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500515524worker2 # [ 88.137447] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5525worker1 # [ 88.159844] systemd[1]: Listening on Nix worker-protocol over gRPC.5526worker1 # [ 88.164203] systemd[1]: Starting Nix worker-protocol over gRPC...5527worker1 # [ 88.309909] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5528worker1 # [ 88.313403] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15529worker1 # [ 88.323072] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5530worker1 # [ 88.324669] systemd[1]: Started Nix worker-protocol over gRPC.5531worker2 # [ 88.338598] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500515532lb # [ 88.336344] niks3-server[1206]: 2026/09/20 08:16:27 INFO lead: acquired remote=192.168.1.3:355725533lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5534lb: must succeed: curl -sf localhost:9901/clusters5535worker1 # [ 88.337095] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:27Z level=info event=scheduler_take_over5536worker1 # [ 88.348545] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05537worker1 # [ 88.362761] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500515538worker1 # [ 88.364486] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05539lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5540lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5541(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.46 seconds)5542subtest: scheduler down: the other node takes the lock and keeps it5543lb: must succeed: curl -sf localhost:9901/clusters5544lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5545lb: must succeed: curl -sf localhost:9901/clusters5546lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5547lb: must succeed: curl -sf localhost:9901/clusters5548lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5549lb: must succeed: curl -sf localhost:9901/clusters5550lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5551worker1 # [ 88.555535] systemd[1]: Stopping Nix worker-protocol over gRPC...5552lb # [ 88.889288] envoy[982]: conn peer=[2001:db8:1::4]:43032 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=21467 tx=4093 ms=615075553lb # [ 88.893159] envoy[982]: conn peer=[2001:db8:1::1]:42022 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=205554lb # [ 88.896624] envoy[982]: conn peer=192.168.1.3:40338 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=23468 tx=4189 ms=654525555lb # [ 88.900201] envoy[982]: conn peer=[2001:db8:1::1]:43086 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=282 ms=14725556worker1 # [ 89.323417] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=signal_exit5557worker1 # [ 89.530704] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_yield5558lb # [ 89.536787] niks3-server[1206]: 2026/09/20 08:16:28 INFO lead: released remote=192.168.1.3:355725559worker1 # [ 89.534780] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_restarting addr=lb:500515560worker2 # [ 89.548436] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_restarting addr=lb:500515561worker1 # [ 89.539601] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:372185562worker1 # [ 89.544300] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=worker_gone addr=192.168.1.3:500515563worker1 # [ 89.547359] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:372185564worker1 # [ 89.550596] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=worker_gone addr=192.168.1.4:500515565worker1 # [ 89.735675] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500515566worker2 # [ 89.748519] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500515567worker1 # [ 89.739698] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5568worker2 # [ 89.755287] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5569worker1 # [ 89.940435] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500515570worker1 # [ 89.944274] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5571worker2 # [ 89.956128] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500515572worker2 # [ 89.960134] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5573worker1 # [ 90.145224] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500515574worker1 # [ 90.149134] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5575worker2 # [ 90.160522] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500515576worker2 # [ 90.164580] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5577worker1 # [ 90.349956] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:29Z level=info event=scheduler_connected addr=lb:500515578worker1 # [ 90.355133] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5579worker2 # [ 90.364873] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500515580worker2 # [ 90.366522] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5581worker1 # [ 90.534623] nix-grpc-daemon[1146]: ts=2026-09-20T08:16:29Z level=info event=scheduler_restarting5582worker2 # [ 90.567512] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:29Z level=info event=scheduler_connected addr=lb:500515583worker2 # [ 90.569125] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5584worker2 # [ 90.769611] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:29Z level=info event=scheduler_connected addr=lb:500515585worker1 # [ 90.763380] nix-grpc-daemon[1146]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5586worker1 # [ 90.764861] nix-grpc-daemon[1146]: E0000 00:00:1789892189.468651 1189 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5587worker1 # [ 91.348268] nix-grpc-daemon[1146]: E0000 00:00:1789892190.053345 1189 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5588worker1 # [ 91.354094] nix-grpc-daemon[1146]: E0000 00:00:1789892190.053868 1189 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5589worker2 # [ 92.330399] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5590worker1 # [ 92.332421] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5591worker1 # [ 92.333949] systemd[1]: Stopped Nix worker-protocol over gRPC.5592worker1 # [ 92.336380] systemd[1]: nix-grpc-daemon.service: Consumed 126ms CPU time over 4.167s wall clock time, 12.3M memory peak, 7.3K incoming IP traffic, 7.4K outgoing IP traffic.5593worker1 # [ 92.343352] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5594worker1 # [ 92.346539] systemd[1]: Closed Nix worker-protocol over gRPC.5595worker1 # [ 92.348601] systemd[1]: nix-grpc-daemon.socket: Consumed 294us CPU time over 4.189s wall clock time, 256K memory peak, 19.6K incoming IP traffic, 15.6K outgoing IP traffic.5596worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5597worker2 # [ 92.530680] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_connected addr=lb:500515598worker2 # [ 92.535854] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5599worker2 # [ 92.736266] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_connected addr=lb:500515600worker2 # [ 92.738170] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5601worker2 # [ 92.938771] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_connected addr=lb:500515602worker2 # [ 92.941445] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5603worker2 # [ 93.142161] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_connected addr=lb:500515604worker2 # [ 93.144549] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5605worker2 # [ 93.345548] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_connected addr=lb:500515606worker2 # [ 93.348159] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5607worker2 # [ 93.530862] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:32Z level=info event=scheduler_take_over5608lb # [ 93.526549] niks3-server[1206]: 2026/09/20 08:16:32 INFO lead: acquired remote=192.168.1.4:339925609worker2 # [ 93.549190] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:32Z level=info event=scheduler_connected addr=lb:500515610worker2 # [ 93.555417] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5611worker2 # [ 93.756098] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:32Z level=info event=scheduler_connected addr=lb:500515612worker2 # [ 93.758478] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05613worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.15 seconds)5614worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5615worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.03 seconds)5616client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25617worker2 # [ 94.726703] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:359365618client # don't know how to build these paths:5619client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5620worker2 # [ 94.741231] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05621worker2 # [ 94.745293] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=15622worker2 # [ 94.794866] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365623worker2 # [ 94.808733] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359365624client # copying 1 paths to 'lb:50051'...5625client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5626worker2 # [ 94.821326] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359365627worker2 # [ 94.833095] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5628worker2 # [ 94.994690] nix-daemon[919]: accepted connection from pid 1355, user nix-grpc-daemon (trusted)5629worker2 # [ 95.007789] nix-daemon[919]: reaped child process 1358, status = succeeded5630worker2 # [ 95.145697] nix-daemon[919]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5631worker2 # [ 95.157865] nix-daemon[919]: reaped child process 1363, status = succeeded5632lb # [ 95.164350] niks3-server[1206]: 2026/09/20 08:16:33 INFO Received uploads request method=POST path=/api/pending_closures5633worker2 # [ 95.178620] nix-grpc-daemon[1307]: time=2026-09-20T08:16:33.791Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5634worker2 # [ 95.180160] nix-grpc-daemon[1307]: time=2026-09-20T08:16:33.791Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5635lb # [ 95.192668] niks3-server[1206]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5636lb # [ 95.202494] niks3-server[1206]: 2026/09/20 08:16:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5637worker2 # [ 95.211607] nix-grpc-daemon[1307]: time=2026-09-20T08:16:33.825Z level=INFO msg="Uploading 1 narinfos"5638lb # [ 95.208330] niks3-server[1206]: 2026/09/20 08:16:33 INFO Signed narinfos id=25 count=15639lb # [ 95.213226] niks3-server[1206]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5640lb # [ 95.224617] niks3-server[1206]: 2026/09/20 08:16:34 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5641worker2 # [ 95.234795] nix-grpc-daemon[1307]: time=2026-09-20T08:16:33.848Z level=INFO msg="Upload complete. (389ms)"5642lb # [ 95.230059] niks3-server[1206]: 2026/09/20 08:16:34 INFO Completed upload id=255643worker2 # [ 95.237300] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=0 paths=1 nar_bytes_in=5205644worker2 # [ 95.242568] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365645worker2 # [ 95.246471] nix-grpc-daemon[1307]: time=2026-09-20T08:16:33.859Z level=WARN msg="Failed to register uploaded object" key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo error="server returned 404: object is not pending upload\n"5646worker2 # [ 95.255358] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5647worker2 # [ 95.258514] nix-daemon[919]: reaped child process 1353, status = succeeded5648worker2 # [ 95.263291] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5649client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5650client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5651client # farm-a> LOG-farm-a-on-standby5652worker2 # [ 96.476741] nix-daemon[919]: reaped child process 1367, status = succeeded5653worker2 # [ 96.596135] nix-daemon[919]: accepted connection from pid 1382, user nix-grpc-daemon (trusted)5654worker2 # [ 96.608578] nix-daemon[919]: reaped child process 1385, status = succeeded5655lb # [ 96.614164] niks3-server[1206]: 2026/09/20 08:16:35 INFO Received uploads request method=POST path=/api/pending_closures5656worker2 # [ 96.630306] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.243Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5657worker2 # [ 96.631941] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.245Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5658lb # [ 96.666098] niks3-server[1206]: 2026/09/20 08:16:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5659worker2 # [ 96.679393] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.292Z level=INFO msg="Uploading 1 narinfos"5660lb # [ 96.674482] niks3-server[1206]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5661lb # [ 96.677096] niks3-server[1206]: 2026/09/20 08:16:35 INFO Signed narinfos id=26 count=15662lb # [ 96.680168] niks3-server[1206]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5663lb # [ 96.690768] niks3-server[1206]: 2026/09/20 08:16:35 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5664lb # [ 96.700137] niks3-server[1206]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5665lb # [ 96.702952] niks3-server[1206]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5666lb # [ 96.706560] niks3-server[1206]: 2026/09/20 08:16:35 INFO Completed upload id=265667worker2 # [ 96.711373] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.325Z level=INFO msg="Upload complete. (240ms)"5668worker2 # [ 96.718724] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15669worker2 # [ 96.737406] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05670worker2 # [ 96.740602] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=15671worker2 # [ 96.745395] nix-daemon[919]: reaped child process 1365, status = succeeded5672worker2 # [ 96.781601] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365673worker2 # [ 96.791288] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359365674worker2 # [ 96.804426] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.418Z level=INFO msg="All 1 paths already cached"5675client # copying 1 paths to 'lb:50051'...5676client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5677worker2 # [ 96.812073] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359365678worker2 # [ 96.820237] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5679worker2 # [ 96.965764] nix-daemon[919]: accepted connection from pid 1391, user nix-grpc-daemon (trusted)5680worker2 # [ 96.979869] nix-daemon[919]: reaped child process 1394, status = succeeded5681worker2 # [ 97.124142] nix-daemon[919]: accepted connection from pid 1396, user nix-grpc-daemon (trusted)5682worker2 # [ 97.136169] nix-daemon[919]: reaped child process 1399, status = succeeded5683lb # [ 97.144455] niks3-server[1206]: 2026/09/20 08:16:35 INFO Received uploads request method=POST path=/api/pending_closures5684worker2 # [ 97.154048] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.767Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5685worker2 # [ 97.155561] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.769Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5686lb # [ 97.165957] niks3-server[1206]: 2026/09/20 08:16:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5687lb # [ 97.169728] niks3-server[1206]: 2026/09/20 08:16:35 INFO Signed narinfos id=27 count=15688worker2 # [ 97.175887] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.789Z level=INFO msg="Uploading 1 narinfos"5689lb # [ 97.175613] niks3-server[1206]: 2026/09/20 08:16:35 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5690lb # [ 97.178556] niks3-server[1206]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5691lb # [ 97.188152] niks3-server[1206]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5692worker2 # [ 97.198945] nix-grpc-daemon[1307]: time=2026-09-20T08:16:35.812Z level=INFO msg="Upload complete. (367ms)"5693lb # [ 97.194579] niks3-server[1206]: 2026/09/20 08:16:35 INFO Completed upload id=275694worker2 # [ 97.200887] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=0 paths=1 nar_bytes_in=6405695lb # [ 97.197685] niks3-server[1206]: 2026/09/20 08:16:35 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5696worker2 # [ 97.205545] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365697worker2 # [ 97.211139] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5698worker2 # [ 97.213457] nix-daemon[919]: reaped child process 1389, status = succeeded5699worker2 # [ 97.218789] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5700client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5701client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5702client # farm-b> LOG-farm-b-on-standby5703worker2 # [ 98.240282] nix-daemon[919]: reaped child process 1403, status = succeeded5704worker2 # [ 98.379797] nix-daemon[919]: accepted connection from pid 1418, user nix-grpc-daemon (trusted)5705worker2 # [ 98.392630] nix-daemon[919]: reaped child process 1421, status = succeeded5706lb # [ 98.400195] niks3-server[1206]: 2026/09/20 08:16:37 INFO Received uploads request method=POST path=/api/pending_closures5707worker2 # [ 98.557839] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.170Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5708worker2 # [ 98.564484] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.175Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5709lb # [ 98.571212] niks3-server[1206]: 2026/09/20 08:16:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5710lb # [ 98.573704] niks3-server[1206]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5711lb # [ 98.575690] niks3-server[1206]: 2026/09/20 08:16:37 INFO Signed narinfos id=28 count=15712worker2 # [ 98.582108] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.195Z level=INFO msg="Uploading 1 narinfos"5713lb # [ 98.581964] niks3-server[1206]: 2026/09/20 08:16:37 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5714lb # [ 98.584040] niks3-server[1206]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5715lb # [ 98.592837] niks3-server[1206]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5716lb # [ 98.600892] niks3-server[1206]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5717lb # [ 98.607674] niks3-server[1206]: 2026/09/20 08:16:37 INFO Completed upload id=285718worker2 # [ 98.612472] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.226Z level=INFO msg="Upload complete. (386ms)"5719worker2 # [ 98.618673] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15720worker2 # [ 98.629476] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05721worker2 # [ 98.635251] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=15722worker2 # [ 98.645306] nix-daemon[919]: reaped child process 1401, status = succeeded5723worker2 # [ 98.674810] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365724worker2 # [ 98.685179] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359365725worker2 # [ 98.695327] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.309Z level=INFO msg="All 2 paths already cached"5726client # copying 1 paths to 'lb:50051'...5727client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5728worker2 # [ 98.703303] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359365729worker2 # [ 98.711426] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5730worker2 # [ 98.854311] nix-daemon[919]: accepted connection from pid 1427, user nix-grpc-daemon (trusted)5731worker2 # [ 98.866835] nix-daemon[919]: reaped child process 1430, status = succeeded5732lb # [ 98.890997] envoy[982]: conn peer=[2001:db8:1::3]:34756 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1348 tx=339 ms=22005733worker2 # [ 99.000595] nix-daemon[919]: accepted connection from pid 1432, user nix-grpc-daemon (trusted)5734worker2 # [ 99.012977] nix-daemon[919]: reaped child process 1435, status = succeeded5735lb # [ 99.018465] niks3-server[1206]: 2026/09/20 08:16:37 INFO Received uploads request method=POST path=/api/pending_closures5736worker2 # [ 99.027799] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.641Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5737worker2 # [ 99.029306] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.643Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5738lb # [ 99.034336] niks3-server[1206]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5739lb # [ 99.038886] niks3-server[1206]: 2026/09/20 08:16:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5740lb # [ 99.041382] niks3-server[1206]: 2026/09/20 08:16:37 INFO Signed narinfos id=29 count=15741worker2 # [ 99.046033] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.659Z level=INFO msg="Uploading 1 narinfos"5742lb # [ 99.045120] niks3-server[1206]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5743lb # [ 99.050381] niks3-server[1206]: 2026/09/20 08:16:37 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5744lb # [ 99.053557] niks3-server[1206]: 2026/09/20 08:16:37 INFO Completed upload id=295745worker2 # [ 99.059418] nix-grpc-daemon[1307]: time=2026-09-20T08:16:37.673Z level=INFO msg="Upload complete. (336ms)"5746lb # [ 99.055200] niks3-server[1206]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5747worker2 # [ 99.061328] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=0 paths=1 nar_bytes_in=7685748worker2 # [ 99.064180] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365749worker2 # [ 99.069366] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5750worker2 # [ 99.073421] nix-daemon[919]: reaped child process 1425, status = succeeded5751worker2 # [ 99.078205] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5752client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5753client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5754client # farm-top> LOG-farm-top-on-standby5755worker2 # [ 100.293666] nix-daemon[919]: reaped child process 1439, status = succeeded5756worker2 # [ 100.418612] nix-daemon[919]: accepted connection from pid 1454, user nix-grpc-daemon (trusted)5757worker2 # [ 100.430639] nix-daemon[919]: reaped child process 1457, status = succeeded5758lb # [ 100.440635] niks3-server[1206]: 2026/09/20 08:16:39 INFO Received uploads request method=POST path=/api/pending_closures5759worker2 # [ 100.453254] nix-grpc-daemon[1307]: time=2026-09-20T08:16:39.066Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5760worker2 # [ 100.454693] nix-grpc-daemon[1307]: time=2026-09-20T08:16:39.068Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5761lb # [ 100.483944] niks3-server[1206]: 2026/09/20 08:16:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5762lb # [ 100.490512] niks3-server[1206]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5763lb # [ 100.496873] niks3-server[1206]: 2026/09/20 08:16:39 INFO Signed narinfos id=30 count=15764worker2 # [ 100.504487] nix-grpc-daemon[1307]: time=2026-09-20T08:16:39.118Z level=INFO msg="Uploading 1 narinfos"5765lb # [ 100.501727] niks3-server[1206]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5766lb # [ 100.511784] niks3-server[1206]: 2026/09/20 08:16:39 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5767lb # [ 100.517831] niks3-server[1206]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5768lb # [ 100.526924] niks3-server[1206]: 2026/09/20 08:16:39 INFO Completed upload id=305769worker2 # [ 100.533374] nix-grpc-daemon[1307]: time=2026-09-20T08:16:39.147Z level=INFO msg="Upload complete. (248ms)"5770lb # [ 100.535065] niks3-server[1206]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5771worker2 # [ 100.541342] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15772worker2 # [ 100.553439] nix-daemon[919]: reaped child process 1437, status = succeeded5773client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 6.03 seconds)5774client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5775client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.18 seconds)5776worker1 # [ 100.808724] systemd[1]: Listening on Nix worker-protocol over gRPC.5777worker1 # [ 100.816502] systemd[1]: Starting Nix worker-protocol over gRPC...5778worker1 # [ 100.944581] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5779worker1 # [ 100.946993] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15780worker1 # [ 100.952796] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5781worker1 # [ 100.956359] systemd[1]: Started Nix worker-protocol over gRPC.5782lb: must succeed: curl -sf localhost:9901/clusters5783worker1 # [ 100.988871] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:39Z level=info event=scheduler_connected addr=lb:500515784worker2 # [ 100.999091] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05785lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5786worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5787worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5788lb: must succeed: curl -sf localhost:9901/clusters5789lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5790lb: must succeed: curl -sf localhost:9901/clusters5791lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5792worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5793worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5794(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.87 seconds)5795subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5796client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5797client # [ 101.300718] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5798client # Running as unit: rs.service; invocation ID: 15e6e449332e4d028b3f082a1a88ac5f5799client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5800worker1 # [ 101.525581] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:450165801worker1 # [ 101.536373] nix-daemon[918]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)5802client # [ 101.527362] nix[1144]: don't know how to build these paths:5803client # [ 101.528392] nix[1144]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5804worker2 # [ 101.566661] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:40Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05805worker2 # [ 101.572209] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:40Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=15806worker2 # [ 101.608986] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365807worker2 # [ 101.617069] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359365808client # [ 101.594464] nix[1144]: copying 1 paths to 'lb:50051'...5809worker2 # [ 101.624399] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359365810client # [ 101.597143] nix[1144]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5811worker2 # [ 101.632986] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5812worker2 # [ 101.795986] nix-daemon[919]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5813worker2 # [ 101.808339] nix-daemon[919]: reaped child process 1475, status = succeeded5814worker2 # [ 101.938506] nix-daemon[919]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5815worker2 # [ 101.950601] nix-daemon[919]: reaped child process 1480, status = succeeded5816lb # [ 101.954436] niks3-server[1206]: 2026/09/20 08:16:40 INFO Received uploads request method=POST path=/api/pending_closures5817worker2 # [ 101.962880] nix-grpc-daemon[1307]: time=2026-09-20T08:16:40.576Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5818worker2 # [ 101.964329] nix-grpc-daemon[1307]: time=2026-09-20T08:16:40.578Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5819lb # [ 101.971318] niks3-server[1206]: 2026/09/20 08:16:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5820lb # [ 101.973353] niks3-server[1206]: 2026/09/20 08:16:40 INFO Signed narinfos id=31 count=15821worker2 # [ 101.979360] nix-grpc-daemon[1307]: time=2026-09-20T08:16:40.592Z level=INFO msg="Uploading 1 narinfos"5822lb # [ 101.977564] niks3-server[1206]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5823lb # [ 101.980091] niks3-server[1206]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5824lb # [ 101.984055] niks3-server[1206]: 2026/09/20 08:16:40 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5825lb # [ 101.987154] niks3-server[1206]: 2026/09/20 08:16:40 INFO Completed upload id=315826worker2 # [ 101.991790] nix-grpc-daemon[1307]: time=2026-09-20T08:16:40.605Z level=INFO msg="Upload complete. (351ms)"5827worker2 # [ 101.993673] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=0 paths=1 nar_bytes_in=4165828lb # [ 101.989618] niks3-server[1206]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5829worker2 # [ 101.996552] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359365830worker2 # [ 102.003737] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5831worker2 # [ 102.005290] nix-daemon[919]: reaped child process 1470, status = succeeded5832worker2 # [ 102.009949] nix-daemon[919]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5833client # [ 101.980129] nix[1144]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5834lb: must succeed: curl -sf localhost:9901/clusters5835lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5836lb: must succeed: curl -sf localhost:9901/clusters5837lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5838lb: must succeed: curl -sf localhost:9901/clusters5839lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5840lb: must succeed: curl -sf localhost:9901/clusters5841lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5842worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5843worker1 # [ 104.118233] systemd-journald[288]: Received client request to rotate journal, rotating.5844worker1 # [ 104.136204] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/5c43e1e5feca4965931094c065291677.5845worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)5846worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5847worker2 # [ 104.053634] systemd[1]: Stopping Nix worker-protocol over gRPC...5848worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5849??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5850 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735851client: must succeed: sleep 5.05852worker2 # [ 104.525264] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:43Z level=info event=draining5853lb # [ 108.890947] envoy[982]: conn peer=[2001:db8:1::1]:36068 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9438 tx=3751 ms=58295854client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5855worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5856worker2 # [ 109.430367] nix-daemon[919]: reaped child process 1484, status = succeeded5857worker2 # [ 109.571376] nix-daemon[919]: accepted connection from pid 1524, user nix-grpc-daemon (trusted)5858worker2 # [ 109.583937] nix-daemon[919]: reaped child process 1527, status = succeeded5859lb # [ 109.593550] niks3-server[1206]: 2026/09/20 08:16:48 INFO Received uploads request method=POST path=/api/pending_closures5860worker2 # [ 109.604896] nix-grpc-daemon[1307]: time=2026-09-20T08:16:48.218Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5861worker2 # [ 109.607285] nix-grpc-daemon[1307]: time=2026-09-20T08:16:48.220Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5862lb # [ 109.620757] niks3-server[1206]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5863lb # [ 109.624862] niks3-server[1206]: 2026/09/20 08:16:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5864lb # [ 109.626459] niks3-server[1206]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5865lb # [ 109.630238] niks3-server[1206]: 2026/09/20 08:16:48 INFO Signed narinfos id=32 count=15866worker2 # [ 109.636251] nix-grpc-daemon[1307]: time=2026-09-20T08:16:48.249Z level=INFO msg="Uploading 1 narinfos"5867lb # [ 109.633844] niks3-server[1206]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5868lb # [ 109.638355] niks3-server[1206]: 2026/09/20 08:16:48 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5869lb # [ 109.642400] niks3-server[1206]: 2026/09/20 08:16:48 INFO Completed upload id=325870worker2 # [ 109.647032] nix-grpc-daemon[1307]: time=2026-09-20T08:16:48.260Z level=INFO msg="Upload complete. (223ms)"5871lb # [ 109.643873] niks3-server[1206]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5872worker2 # [ 109.649381] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35936 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15873worker2 # [ 109.657182] nix-daemon[919]: reaped child process 1482, status = succeeded5874client # [ 109.661118] systemd[1]: rs.service: Deactivated successfully.5875client # [ 109.665369] systemd[1]: rs.service: Consumed 117ms CPU time over 8.363s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.5876worker2 # [ 110.527179] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=signal_exit5877worker2 # [ 110.756575] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=scheduler_yield5878lb # [ 110.753542] niks3-server[1206]: 2026/09/20 08:16:49 INFO lead: released remote=192.168.1.4:339925879worker2 # [ 110.758433] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=scheduler_restarting addr=lb:500515880worker2 # [ 110.760764] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:359265881worker1 # [ 110.750970] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:49Z level=info event=scheduler_restarting addr=lb:500515882worker2 # [ 110.762189] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=worker_gone addr=192.168.1.4:500515883worker2 # [ 110.763456] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:359265884worker2 # [ 110.764747] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=worker_gone addr=192.168.1.3:500515885worker2 # [ 110.959292] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500515886worker1 # [ 110.951324] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500515887lb # [ 110.964809] niks3-server[1206]: 2026/09/20 08:16:49 INFO lead: acquired remote=192.168.1.3:575745888worker1 # [ 110.959698] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5889worker1 # [ 110.964530] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:49Z level=info event=scheduler_take_over5890worker2 # [ 110.971603] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5891worker1 # [ 111.160648] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500515892worker2 # [ 111.172330] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500515893worker1 # [ 111.165699] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5894worker1 # [ 111.170166] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05895worker1 # [ 111.365125] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515896worker1 # [ 111.369155] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5897worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.17 seconds)5898client: waiting for success: ! systemctl is-active rs5899client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5900client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5901worker1 # [ 111.569752] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500515902worker1 # [ 111.574520] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05903client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5904client: must fail: journalctl -u rs | grep -q 'reconnecting'5905client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5906lb: must succeed: curl -sf localhost:9901/clusters5907lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5908worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5909worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5910(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.46 seconds)5911subtest: scheduler restart mid-build: build finishes, no double build5912client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5913worker1 # [ 111.755187] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432545914worker1 # [ 111.757969] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:50Z level=info event=worker_gone addr=192.168.1.4:500515915worker2 # [ 111.759936] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:50Z level=info event=scheduler_restarting5916worker2 # [ 111.778370] nix-grpc-daemon[1251]: ts=2026-09-20T08:16:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5917worker2 # [ 111.795690] nix-daemon[919]: reaped child process 1300, status = succeeded5918client # [ 111.763406] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5919client # Running as unit: mid.service; invocation ID: b19aa2a859a2465aa2c20d1cda604a005920client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.06 seconds)5921worker1 # [ 111.977241] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:450165922client # [ 111.962166] nix[1179]: don't know how to build these paths:5923client # [ 111.963251] nix[1179]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5924worker2 # [ 111.992660] nix-grpc-daemon[1251]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5925worker2 # [ 111.996115] nix-grpc-daemon[1251]: E0000 00:00:1789892210.606215 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5926worker2 # [ 112.586908] nix-grpc-daemon[1251]: E0000 00:00:1789892211.200461 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5927worker2 # [ 112.592203] nix-grpc-daemon[1251]: E0000 00:00:1789892211.205584 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5928client # [ 113.112346] nix[1179]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5929worker2 # [ 113.154927] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5930worker2 # [ 113.158754] systemd[1]: Stopped Nix worker-protocol over gRPC.5931worker2 # [ 113.161075] systemd[1]: nix-grpc-daemon.service: Consumed 1.375s CPU time over 29.786s wall clock time, 35.6M memory peak, 57.7K incoming IP traffic, 111.5K outgoing IP traffic.5932worker2 # [ 113.176093] systemd[1]: Starting Nix worker-protocol over gRPC...5933worker2 # [ 113.311995] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5934worker2 # [ 113.313733] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15935worker2 # [ 113.319057] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5936worker2 # [ 113.321847] systemd[1]: Started Nix worker-protocol over gRPC.5937worker2 # [ 113.346429] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500515938worker1 # [ 113.340636] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05939worker1 # [ 113.641610] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:52Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05940worker1 # [ 113.646509] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:52Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15941worker1 # [ 113.687144] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450165942worker1 # [ 113.703536] nix-grpc-daemon[1210]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5)5943worker1 # [ 113.754901] nix-grpc-daemon[1210]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 2/5)5944worker1 # [ 113.783680] nix-grpc-daemon[1210]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 110 ms (attempt 3/5)5945worker1 # [ 113.899648] nix-grpc-daemon[1210]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 419 ms (attempt 4/5)5946worker1 # [ 114.324547] nix-grpc-daemon[1210]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5947worker1 # [ 114.337111] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450165948client # [ 114.322743] nix[1179]: copying 1 paths to 'lb:50051'...5949worker1 # [ 114.347859] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450165950client # [ 114.326965] nix[1179]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5951worker1 # [ 114.353186] nix-daemon[918]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)5952worker1 # [ 114.373495] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:53Z level=info event=niks3_push_started pid=13375953worker1 # [ 114.693279] nix-daemon[918]: accepted connection from pid 1350, user nix-grpc-daemon (trusted)5954worker1 # [ 114.705391] nix-daemon[918]: reaped child process 1353, status = succeeded5955worker1 # [ 114.859369] nix-daemon[918]: accepted connection from pid 1355, user nix-grpc-daemon (trusted)5956worker1 # [ 114.869678] nix-daemon[918]: reaped child process 1358, status = succeeded5957lb # [ 114.888857] niks3-server[1206]: 2026/09/20 08:16:53 INFO Received uploads request method=POST path=/api/pending_closures5958worker1 # [ 114.896905] nix-grpc-daemon[1337]: time=2026-09-20T08:16:53.601Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5959worker1 # [ 114.898715] nix-grpc-daemon[1337]: time=2026-09-20T08:16:53.603Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5960lb # [ 114.927121] niks3-server[1206]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5961lb # [ 114.935339] niks3-server[1206]: 2026/09/20 08:16:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5962lb # [ 114.939946] niks3-server[1206]: 2026/09/20 08:16:53 INFO Signed narinfos id=33 count=15963worker1 # [ 114.939477] nix-grpc-daemon[1337]: time=2026-09-20T08:16:53.644Z level=INFO msg="Uploading 1 narinfos"5964lb # [ 114.954463] niks3-server[1206]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5965lb # [ 114.967590] niks3-server[1206]: 2026/09/20 08:16:53 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5966lb # [ 114.970145] niks3-server[1206]: 2026/09/20 08:16:53 INFO Completed upload id=335967worker1 # [ 114.966769] nix-grpc-daemon[1337]: time=2026-09-20T08:16:53.672Z level=INFO msg="Upload complete. (421ms)"5968lb # [ 114.972098] niks3-server[1206]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5969worker1 # [ 114.969107] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45016 duration_s=0 paths=1 nar_bytes_in=4245970worker1 # [ 114.972750] nix-grpc-daemon[1210]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450165971worker1 # [ 114.978949] nix-daemon[918]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)5972worker1 # [ 114.981362] nix-daemon[918]: reaped child process 1335, status = succeeded5973worker1 # [ 114.986573] nix-daemon[918]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)5974client # [ 114.964708] nix[1179]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5975lb: must succeed: curl -sf localhost:9901/clusters5976lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5977lb: must succeed: curl -sf localhost:9901/clusters5978lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5979worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5980worker1 # [ 116.600392] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1210 (nix-grpc-daemon) on client request.5981worker1 # [ 116.603349] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5982worker2 # [ 116.617082] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5983lb # [ 116.613642] niks3-server[1206]: 2026/09/20 08:16:55 INFO lead: released remote=192.168.1.3:575745984client # [ 116.589278] nix[1179]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5985client # [ 116.593734] nix[1179]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5986worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5987client: must succeed: sleep 5.05988worker1 # [ 116.633128] nix-daemon[918]: reaped child process 1268, status = succeeded5989worker1 # [ 116.636293] nix-daemon[918]: reaped child process 1360, status = succeeded5990worker1 # [ 116.637631] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5991worker1 # [ 116.639742] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5992worker1 # [ 116.641067] systemd[1]: nix-grpc-daemon.service: Consumed 406ms CPU time over 15.819s wall clock time, 32.9M memory peak, 13.1K incoming IP traffic, 18.6K outgoing IP traffic.5993worker1 # [ 116.650243] nix-daemon[1362]: unexpected Nix daemon error: error: interrupted by the user5994worker1 # [ 116.653372] nix-daemon[918]: reaped child process 1362, status = failed with exit code 15995worker1 # [ 116.782401] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5996worker1 # [ 116.791209] systemd[1]: Starting Nix worker-protocol over gRPC...5997worker2 # [ 116.817316] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500515998worker1 # [ 116.976684] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5999worker1 # [ 116.978487] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16000worker1 # [ 116.985067] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6001worker1 # [ 116.988194] systemd[1]: Started Nix worker-protocol over gRPC.6002worker1 # [ 116.997411] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=info event=scheduler_take_over6003worker2 # [ 117.006499] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6004lb # [ 117.001582] niks3-server[1206]: 2026/09/20 08:16:55 INFO lead: acquired remote=192.168.1.3:487886005worker1 # [ 117.016534] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500516006worker1 # [ 117.018343] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06007worker1 # [ 117.119798] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06008worker1 # [ 117.125206] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=16009worker1 # [ 117.173152] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382226010worker1 # [ 117.183173] nix-daemon[918]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)6011worker1 # [ 117.196811] nix-daemon[918]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)6012worker2 # [ 117.207024] nix-grpc-daemon[1542]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500516013worker1 # [ 117.200346] nix-grpc-daemon[1398]: ts=2026-09-20T08:16:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06014client # [ 117.193273] nix[1179]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6015worker1 # [ 117.216199] nix-daemon[918]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)6016lb # [ 118.891598] envoy[982]: conn peer=[2001:db8:1::1]:36074 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1309 ms=81316017lb # [ 118.893173] envoy[982]: conn peer=[2001:db8:1::4]:57176 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7652 tx=1851 ms=282296018lb # [ 118.894640] envoy[982]: conn peer=[2001:db8:1::3]:39812 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1391 tx=445 ms=156286019client: (finished: must succeed: sleep 5.0, in 5.04 seconds)6020client: waiting for success: ! systemctl is-active mid6021worker1 # [ 122.035064] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:00Z level=info event=niks3_push_started pid=14776022worker1 # [ 122.065201] nix-daemon[918]: reaped child process 1453, status = succeeded6023worker1 # [ 122.336116] nix-daemon[918]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)6024worker1 # [ 122.347688] nix-daemon[918]: reaped child process 1493, status = succeeded6025lb # [ 122.364466] niks3-server[1206]: 2026/09/20 08:17:01 INFO Received uploads request method=POST path=/api/pending_closures6026worker1 # [ 122.369460] nix-grpc-daemon[1477]: time=2026-09-20T08:17:01.074Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6027worker1 # [ 122.371235] nix-grpc-daemon[1477]: time=2026-09-20T08:17:01.076Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"6028lb # [ 122.413929] niks3-server[1206]: 2026/09/20 08:17:01 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6029lb # [ 122.421845] niks3-server[1206]: 2026/09/20 08:17:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign6030lb # [ 122.426119] niks3-server[1206]: 2026/09/20 08:17:01 INFO Signed narinfos id=34 count=16031worker1 # [ 122.426086] nix-grpc-daemon[1477]: time=2026-09-20T08:17:01.130Z level=INFO msg="Uploading 1 narinfos"6032lb # [ 122.435769] niks3-server[1206]: 2026/09/20 08:17:01 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6033lb # [ 122.449726] niks3-server[1206]: 2026/09/20 08:17:01 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete6034lb # [ 122.453176] niks3-server[1206]: 2026/09/20 08:17:01 INFO Completed upload id=346035worker1 # [ 122.449757] nix-grpc-daemon[1477]: time=2026-09-20T08:17:01.155Z level=INFO msg="Upload complete. (244ms)"6036worker1 # [ 122.453276] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38222 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=16037worker1 # [ 122.457164] nix-grpc-daemon[1477]: time=2026-09-20T08:17:01.161Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo error="server returned 404: object is not pending upload\n"6038worker1 # [ 122.459454] nix-grpc-daemon[1477]: time=2026-09-20T08:17:01.161Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls error="server returned 404: object is not pending upload\n"6039worker1 # [ 122.464898] nix-daemon[918]: reaped child process 1451, status = succeeded6040client # [ 122.472916] systemd[1]: mid.service: Deactivated successfully.6041client # [ 122.476854] systemd[1]: mid.service: Consumed 131ms CPU time over 10.712s wall clock time, 37.3M memory peak, 10K incoming IP traffic, 11K outgoing IP traffic.6042client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds)6043client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6044client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)6045(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.29 seconds)6046subtest: interrupting the client stops the build on the worker6047client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr6048client # [ 123.033803] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.6049client # Running as unit: intr.service; invocation ID: 8c65cbaab9ea4c408b016699e824a0966050client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)6051worker1 # [ 123.244532] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:382226052client # [ 123.229433] nix[1214]: don't know how to build these paths:6053client # [ 123.230391] nix[1214]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6054worker1 # [ 123.260229] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:01Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06055worker1 # [ 123.264620] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:01Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=16056worker2 # [ 123.321524] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346057worker2 # [ 123.333169] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6058worker2 # [ 123.349960] nix-grpc-daemon[1542]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)6059worker2 # [ 123.397906] nix-grpc-daemon[1542]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5)6060worker2 # [ 123.548939] nix-grpc-daemon[1542]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 3/5)6061worker2 # [ 123.849664] nix-grpc-daemon[1542]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 522 ms (attempt 4/5)6062worker2 # [ 124.377917] nix-grpc-daemon[1542]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6063worker2 # [ 124.389571] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354346064worker2 # [ 124.397194] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354346065client # [ 124.367786] nix[1214]: copying 1 paths to 'lb:50051'...6066client # [ 124.371133] nix[1214]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6067worker2 # [ 124.404537] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6068worker2 # [ 124.414411] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:03Z level=info event=niks3_push_started pid=16306069worker2 # [ 124.722896] nix-daemon[919]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6070worker2 # [ 124.734653] nix-daemon[919]: reaped child process 1646, status = succeeded6071worker2 # [ 124.887868] nix-daemon[919]: accepted connection from pid 1648, user nix-grpc-daemon (trusted)6072worker2 # [ 124.899435] nix-daemon[919]: reaped child process 1651, status = succeeded6073lb # [ 124.909428] niks3-server[1206]: 2026/09/20 08:17:03 INFO Received uploads request method=POST path=/api/pending_closures6074worker2 # [ 124.925517] nix-grpc-daemon[1630]: time=2026-09-20T08:17:03.538Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6075worker2 # [ 124.928551] nix-grpc-daemon[1630]: time=2026-09-20T08:17:03.540Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6076lb # [ 124.952054] niks3-server[1206]: 2026/09/20 08:17:03 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6077lb # [ 124.957642] niks3-server[1206]: 2026/09/20 08:17:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign6078lb # [ 124.962716] niks3-server[1206]: 2026/09/20 08:17:03 INFO Signed narinfos id=35 count=16079worker2 # [ 124.970584] nix-grpc-daemon[1630]: time=2026-09-20T08:17:03.584Z level=INFO msg="Uploading 1 narinfos"6080lb # [ 124.974181] niks3-server[1206]: 2026/09/20 08:17:03 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6081lb # [ 124.980815] niks3-server[1206]: 2026/09/20 08:17:03 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete6082lb # [ 124.990732] niks3-server[1206]: 2026/09/20 08:17:03 INFO Completed upload id=356083worker2 # [ 124.995481] nix-grpc-daemon[1630]: time=2026-09-20T08:17:03.609Z level=INFO msg="Upload complete. (417ms)"6084worker2 # [ 124.998072] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=0 paths=1 nar_bytes_in=4246085lb # [ 124.995854] niks3-server[1206]: 2026/09/20 08:17:03 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6086worker2 # [ 125.000707] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346087worker2 # [ 125.007069] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6088worker2 # [ 125.010314] nix-daemon[919]: reaped child process 1628, status = succeeded6089worker2 # [ 125.014957] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6090client # [ 124.984994] nix[1214]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6091client: must succeed: systemctl kill -s INT intr6092client # [ 126.545648] systemd[1]: intr.service: Sent signal SIGINT to main process 1214 (nix) on client request.6093client # [ 126.554399] nix[1214]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6094client: (finished: must succeed: systemctl kill -s INT intr, in 0.06 seconds)6095client # [ 126.560250] nix[1214]: error: interrupted by the user6096client # [ 126.587483] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6097client # [ 126.588776] systemd[1]: intr.service: Failed with result 'exit-code'.6098client # [ 126.590521] systemd[1]: intr.service: Consumed 106ms CPU time over 3.553s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.6099worker2 # [ 126.632254] nix-daemon[919]: reaped child process 1653, status = succeeded6100worker2 # [ 126.635233] nix-daemon[1655]: unexpected Nix daemon error: error: interrupted by the user6101worker2 # [ 126.639254] nix-daemon[919]: reaped child process 1655, status = failed with exit code 16102(finished: subtest: interrupting the client stops the build on the worker, in 3.65 seconds)6103subtest: a deploy mid-build drains: the build finishes, the new generation takes over6104client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw6105client # [ 126.701602] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.6106client # Running as unit: sw.service; invocation ID: 6e99fa8a9ef6495393cb9ad4b7c136046107client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.05 seconds)6108worker1 # [ 126.921356] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:382226109client # [ 126.906352] nix[1233]: don't know how to build these paths:6110client # [ 126.907435] nix[1233]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6111worker1 # [ 126.935628] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:05Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06112worker1 # [ 126.940984] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:05Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=16113worker1 # [ 126.979880] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382226114worker1 # [ 126.990648] nix-grpc-daemon[1398]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 1/5)6115worker1 # [ 127.092713] nix-grpc-daemon[1398]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 135 ms (attempt 2/5)6116worker1 # [ 127.233472] nix-grpc-daemon[1398]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 3/5)6117worker1 # [ 127.279247] nix-grpc-daemon[1398]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 4/5)6118worker1 # [ 127.286152] nix-grpc-daemon[1398]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6119worker1 # [ 127.302921] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:382226120client # [ 127.291183] nix[1233]: copying 1 paths to 'lb:50051'...6121client # [ 127.295177] nix[1233]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6122worker1 # [ 127.316630] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:382226123worker1 # [ 127.327884] nix-daemon[918]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)6124worker1 # [ 127.495373] nix-daemon[918]: accepted connection from pid 1528, user nix-grpc-daemon (trusted)6125worker1 # [ 127.507610] nix-daemon[918]: reaped child process 1531, status = succeeded6126worker1 # [ 127.668504] nix-daemon[918]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6127worker1 # [ 127.680623] nix-daemon[918]: reaped child process 1536, status = succeeded6128lb # [ 127.700614] niks3-server[1206]: 2026/09/20 08:17:06 INFO Received uploads request method=POST path=/api/pending_closures6129worker1 # [ 127.708913] nix-grpc-daemon[1477]: time=2026-09-20T08:17:06.413Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6130worker1 # [ 127.710413] nix-grpc-daemon[1477]: time=2026-09-20T08:17:06.413Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6131lb # [ 127.730498] niks3-server[1206]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6132lb # [ 127.742104] niks3-server[1206]: 2026/09/20 08:17:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign6133lb # [ 127.749376] niks3-server[1206]: 2026/09/20 08:17:06 INFO Signed narinfos id=36 count=16134worker1 # [ 127.749544] nix-grpc-daemon[1477]: time=2026-09-20T08:17:06.454Z level=INFO msg="Uploading 1 narinfos"6135lb # [ 127.755725] niks3-server[1206]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6136lb # [ 127.764898] niks3-server[1206]: 2026/09/20 08:17:06 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete6137lb # [ 127.771706] niks3-server[1206]: 2026/09/20 08:17:06 INFO Completed upload id=366138worker1 # [ 127.768086] nix-grpc-daemon[1477]: time=2026-09-20T08:17:06.473Z level=INFO msg="Upload complete. (428ms)"6139lb # [ 127.774518] niks3-server[1206]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6140worker1 # [ 127.771639] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38222 duration_s=0 paths=1 nar_bytes_in=4166141worker1 # [ 127.777348] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382226142worker1 # [ 127.785118] nix-daemon[918]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)6143worker1 # [ 127.789973] nix-daemon[918]: reaped child process 1526, status = succeeded6144worker1 # [ 127.794919] nix-daemon[918]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)6145client # [ 127.772913] nix[1233]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6146lb # [ 128.892338] envoy[982]: conn peer=[2001:db8:1::1]:54032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4033 tx=1781 ms=104906147lb # [ 128.896133] envoy[982]: conn peer=[2001:db8:1::1]:39036 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=756 ms=33476148worker1: must succeed: systemctl reload nix-grpc-daemon.service6149worker1 # [ 130.331527] systemd[1]: Reloading Nix worker-protocol over gRPC...6150worker1 # [ 130.370510] systemd[1]: Reloaded Nix worker-protocol over gRPC.6151worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds)6152worker1: must succeed: pgrep -f 'read -t [9]0 x'6153worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds)6154client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&26155worker1 # [ 130.648385] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:382226156client # don't know how to build these paths:6157client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6158worker1 # [ 130.657418] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:09Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06159worker1 # [ 130.659132] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:09Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16160worker2 # [ 130.712612] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346161worker2 # [ 130.723937] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354346162client # copying 1 paths to 'lb:50051'...6163worker2 # [ 130.734365] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354346164client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6165worker2 # [ 130.752374] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6166worker2 # [ 130.897378] nix-daemon[919]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)6167worker2 # [ 130.911893] nix-daemon[919]: reaped child process 1708, status = succeeded6168worker1 # [ 130.997488] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:09Z level=info event=draining6169worker2 # [ 131.045402] nix-daemon[919]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)6170worker2 # [ 131.058139] nix-daemon[919]: reaped child process 1713, status = succeeded6171lb # [ 131.063195] niks3-server[1206]: 2026/09/20 08:17:09 INFO Received uploads request method=POST path=/api/pending_closures6172worker2 # [ 131.072177] nix-grpc-daemon[1630]: time=2026-09-20T08:17:09.685Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6173worker2 # [ 131.073650] nix-grpc-daemon[1630]: time=2026-09-20T08:17:09.685Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6174lb # [ 131.075974] niks3-server[1206]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6175lb # [ 131.080579] niks3-server[1206]: 2026/09/20 08:17:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6176lb # [ 131.083240] niks3-server[1206]: 2026/09/20 08:17:09 INFO Signed narinfos id=37 count=16177worker2 # [ 131.088058] nix-grpc-daemon[1630]: time=2026-09-20T08:17:09.701Z level=INFO msg="Uploading 1 narinfos"6178lb # [ 131.086403] niks3-server[1206]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6179lb # [ 131.090369] niks3-server[1206]: 2026/09/20 08:17:09 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6180lb # [ 131.094239] niks3-server[1206]: 2026/09/20 08:17:09 INFO Completed upload id=376181worker2 # [ 131.099977] nix-grpc-daemon[1630]: time=2026-09-20T08:17:09.713Z level=INFO msg="Upload complete. (335ms)"6182lb # [ 131.095921] niks3-server[1206]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6183worker2 # [ 131.102317] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=0 paths=1 nar_bytes_in=5286184worker2 # [ 131.105152] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346185worker2 # [ 131.111612] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6186worker2 # [ 131.120299] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6187client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6188worker2 # [ 131.122743] nix-daemon[919]: reaped child process 1703, status = succeeded6189client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6190client # farm-a> LOG-farm-a-during-drain6191worker2 # [ 132.336318] nix-daemon[919]: reaped child process 1717, status = succeeded6192worker2 # [ 132.462398] nix-daemon[919]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6193worker2 # [ 132.474181] nix-daemon[919]: reaped child process 1735, status = succeeded6194lb # [ 132.485179] niks3-server[1206]: 2026/09/20 08:17:11 INFO Received uploads request method=POST path=/api/pending_closures6195worker2 # [ 132.499279] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.111Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6196worker2 # [ 132.500635] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.111Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6197lb # [ 132.523504] niks3-server[1206]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6198lb # [ 132.533159] niks3-server[1206]: 2026/09/20 08:17:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6199lb # [ 132.539765] niks3-server[1206]: 2026/09/20 08:17:11 INFO Signed narinfos id=38 count=16200worker2 # [ 132.547664] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.160Z level=INFO msg="Uploading 1 narinfos"6201lb # [ 132.548272] niks3-server[1206]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6202lb # [ 132.557997] niks3-server[1206]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6203lb # [ 132.561770] niks3-server[1206]: 2026/09/20 08:17:11 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6204lb # [ 132.567948] niks3-server[1206]: 2026/09/20 08:17:11 INFO Completed upload id=386205lb # [ 132.569333] niks3-server[1206]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6206worker2 # [ 132.573751] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.187Z level=INFO msg="Upload complete. (244ms)"6207worker2 # [ 132.578484] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16208worker1 # [ 132.574811] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:11Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06209worker1 # [ 132.576858] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:11Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16210worker2 # [ 132.590758] nix-daemon[919]: reaped child process 1715, status = succeeded6211worker2 # [ 132.633479] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346212worker2 # [ 132.645399] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354346213worker2 # [ 132.658575] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.272Z level=INFO msg="All 1 paths already cached"6214client # copying 1 paths to 'lb:50051'...6215worker2 # [ 132.666313] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354346216client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6217worker2 # [ 132.685357] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6218worker2 # [ 132.858785] nix-daemon[919]: accepted connection from pid 1739, user nix-grpc-daemon (trusted)6219worker2 # [ 132.871463] nix-daemon[919]: reaped child process 1742, status = succeeded6220worker2 # [ 133.015366] nix-daemon[919]: accepted connection from pid 1744, user nix-grpc-daemon (trusted)6221worker2 # [ 133.027835] nix-daemon[919]: reaped child process 1747, status = succeeded6222lb # [ 133.032274] niks3-server[1206]: 2026/09/20 08:17:11 INFO Received uploads request method=POST path=/api/pending_closures6223worker2 # [ 133.044771] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.658Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6224worker2 # [ 133.046214] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.658Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6225lb # [ 133.063291] niks3-server[1206]: 2026/09/20 08:17:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6226lb # [ 133.068273] niks3-server[1206]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6227lb # [ 133.074576] niks3-server[1206]: 2026/09/20 08:17:11 INFO Signed narinfos id=39 count=16228worker2 # [ 133.082352] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.695Z level=INFO msg="Uploading 1 narinfos"6229lb # [ 133.079630] niks3-server[1206]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6230lb # [ 133.091459] niks3-server[1206]: 2026/09/20 08:17:11 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6231lb # [ 133.097953] niks3-server[1206]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6232lb # [ 133.107311] niks3-server[1206]: 2026/09/20 08:17:11 INFO Completed upload id=396233worker2 # [ 133.114358] nix-grpc-daemon[1630]: time=2026-09-20T08:17:11.727Z level=INFO msg="Upload complete. (415ms)"6234worker2 # [ 133.118330] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=0 paths=1 nar_bytes_in=6406235worker2 # [ 133.124303] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346236worker2 # [ 133.136112] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6237worker2 # [ 133.145149] nix-daemon[919]: reaped child process 1737, status = succeeded6238worker2 # [ 133.148494] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6239client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6240client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6241client # farm-b> LOG-farm-b-during-drain6242worker2 # [ 134.370413] nix-daemon[919]: reaped child process 1751, status = succeeded6243worker2 # [ 134.519419] nix-daemon[919]: accepted connection from pid 1766, user nix-grpc-daemon (trusted)6244worker2 # [ 134.531108] nix-daemon[919]: reaped child process 1769, status = succeeded6245lb # [ 134.542306] niks3-server[1206]: 2026/09/20 08:17:13 INFO Received uploads request method=POST path=/api/pending_closures6246worker2 # [ 134.556737] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.170Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6247worker2 # [ 134.558193] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.171Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6248lb # [ 134.580883] niks3-server[1206]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6249lb # [ 134.587168] niks3-server[1206]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6250lb # [ 134.600828] niks3-server[1206]: 2026/09/20 08:17:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6251lb # [ 134.606250] niks3-server[1206]: 2026/09/20 08:17:13 INFO Signed narinfos id=40 count=16252worker2 # [ 134.613457] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.227Z level=INFO msg="Uploading 1 narinfos"6253lb # [ 134.608804] niks3-server[1206]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6254lb # [ 134.620152] niks3-server[1206]: 2026/09/20 08:17:13 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6255lb # [ 134.623038] niks3-server[1206]: 2026/09/20 08:17:13 INFO Completed upload id=406256lb # [ 134.624465] niks3-server[1206]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6257worker2 # [ 134.628965] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.242Z level=INFO msg="Upload complete. (273ms)"6258worker2 # [ 134.634760] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16259worker1 # [ 134.630578] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:13Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06260worker1 # [ 134.633258] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:13Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16261worker2 # [ 134.648980] nix-daemon[919]: reaped child process 1749, status = succeeded6262worker2 # [ 134.681682] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346263worker2 # [ 134.691941] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354346264worker2 # [ 134.702443] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.316Z level=INFO msg="All 2 paths already cached"6265client # copying 1 paths to 'lb:50051'...6266worker2 # [ 134.709844] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354346267client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6268worker2 # [ 134.728764] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6269worker2 # [ 134.901062] nix-daemon[919]: accepted connection from pid 1773, user nix-grpc-daemon (trusted)6270worker2 # [ 134.913528] nix-daemon[919]: reaped child process 1776, status = succeeded6271worker2 # [ 135.070354] nix-daemon[919]: accepted connection from pid 1778, user nix-grpc-daemon (trusted)6272worker2 # [ 135.082278] nix-daemon[919]: reaped child process 1781, status = succeeded6273lb # [ 135.088328] niks3-server[1206]: 2026/09/20 08:17:13 INFO Received uploads request method=POST path=/api/pending_closures6274worker2 # [ 135.096647] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.710Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6275worker2 # [ 135.098586] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.711Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6276lb # [ 135.102628] niks3-server[1206]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6277lb # [ 135.104905] niks3-server[1206]: 2026/09/20 08:17:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6278lb # [ 135.107411] niks3-server[1206]: 2026/09/20 08:17:13 INFO Signed narinfos id=41 count=16279worker2 # [ 135.112194] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.725Z level=INFO msg="Uploading 1 narinfos"6280lb # [ 135.110423] niks3-server[1206]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6281lb # [ 135.115164] niks3-server[1206]: 2026/09/20 08:17:13 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6282lb # [ 135.117642] niks3-server[1206]: 2026/09/20 08:17:13 INFO Completed upload id=416283worker2 # [ 135.123603] nix-grpc-daemon[1630]: time=2026-09-20T08:17:13.737Z level=INFO msg="Upload complete. (381ms)"6284lb # [ 135.119561] niks3-server[1206]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6285worker2 # [ 135.125799] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=0 paths=1 nar_bytes_in=7686286worker2 # [ 135.129222] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346287worker2 # [ 135.134519] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6288worker2 # [ 135.137390] nix-daemon[919]: reaped child process 1771, status = succeeded6289client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6290client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6291worker2 # [ 135.142628] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6292worker2 # [ 136.556388] nix-daemon[919]: reaped child process 1785, status = succeeded6293client # farm-top> LOG-farm-top-during-drain6294worker2 # [ 136.692854] nix-daemon[919]: accepted connection from pid 1800, user nix-grpc-daemon (trusted)6295worker2 # [ 136.705077] nix-daemon[919]: reaped child process 1803, status = succeeded6296lb # [ 136.715071] niks3-server[1206]: 2026/09/20 08:17:15 INFO Received uploads request method=POST path=/api/pending_closures6297worker2 # [ 136.729344] nix-grpc-daemon[1630]: time=2026-09-20T08:17:15.342Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6298worker2 # [ 136.731336] nix-grpc-daemon[1630]: time=2026-09-20T08:17:15.344Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6299lb # [ 136.758470] niks3-server[1206]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6300lb # [ 136.764116] niks3-server[1206]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6301lb # [ 136.771180] niks3-server[1206]: 2026/09/20 08:17:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6302lb # [ 136.774479] niks3-server[1206]: 2026/09/20 08:17:15 INFO Signed narinfos id=42 count=16303worker2 # [ 136.781604] nix-grpc-daemon[1630]: time=2026-09-20T08:17:15.395Z level=INFO msg="Uploading 1 narinfos"6304lb # [ 136.782898] niks3-server[1206]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6305lb # [ 136.787251] niks3-server[1206]: 2026/09/20 08:17:15 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6306lb # [ 136.789753] niks3-server[1206]: 2026/09/20 08:17:15 INFO Completed upload id=426307worker2 # [ 136.794523] nix-grpc-daemon[1630]: time=2026-09-20T08:17:15.408Z level=INFO msg="Upload complete. (244ms)"6308lb # [ 136.791839] niks3-server[1206]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6309worker2 # [ 136.799438] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16310worker2 # [ 136.810284] nix-daemon[919]: reaped child process 1783, status = succeeded6311client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 6.42 seconds)6312client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6313client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.20 seconds)6314worker1: must succeed: pkill -f 'read -t [9]0 x'6315worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds)6316client: waiting for success: ! systemctl is-active sw6317worker1 # [ 137.226935] nix-daemon[918]: reaped child process 1540, status = succeeded6318worker1 # [ 137.393315] nix-daemon[918]: accepted connection from pid 1591, user nix-grpc-daemon (trusted)6319worker1 # [ 137.404917] nix-daemon[918]: reaped child process 1594, status = succeeded6320lb # [ 137.423869] niks3-server[1206]: 2026/09/20 08:17:16 INFO Received uploads request method=POST path=/api/pending_closures6321worker1 # [ 137.429450] nix-grpc-daemon[1477]: time=2026-09-20T08:17:16.134Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6322worker1 # [ 137.431150] nix-grpc-daemon[1477]: time=2026-09-20T08:17:16.136Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6323lb # [ 137.457977] niks3-server[1206]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6324lb # [ 137.466253] niks3-server[1206]: 2026/09/20 08:17:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6325lb # [ 137.470210] niks3-server[1206]: 2026/09/20 08:17:16 INFO Signed narinfos id=43 count=16326worker1 # [ 137.469471] nix-grpc-daemon[1477]: time=2026-09-20T08:17:16.174Z level=INFO msg="Uploading 1 narinfos"6327lb # [ 137.480711] niks3-server[1206]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6328lb # [ 137.482781] niks3-server[1206]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6329lb # [ 137.486055] niks3-server[1206]: 2026/09/20 08:17:16 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6330lb # [ 137.489023] niks3-server[1206]: 2026/09/20 08:17:16 INFO Completed upload id=436331worker1 # [ 137.486861] nix-grpc-daemon[1477]: time=2026-09-20T08:17:16.192Z level=INFO msg="Upload complete. (277ms)"6332lb # [ 137.491484] niks3-server[1206]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6333worker1 # [ 137.492862] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38222 duration_s=9 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16334worker1 # [ 137.503302] nix-daemon[918]: reaped child process 1538, status = succeeded6335client # [ 137.508877] systemd[1]: sw.service: Deactivated successfully.6336client # [ 137.512710] systemd[1]: sw.service: Consumed 124ms CPU time over 10.810s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9.2K outgoing IP traffic.6337worker1 # [ 138.000885] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=signal_exit6338client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6339client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6340client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6341worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6342worker1 # [ 138.220442] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=scheduler_yield6343lb # [ 138.226391] niks3-server[1206]: 2026/09/20 08:17:17 INFO lead: released remote=192.168.1.3:487886344worker2 # [ 138.231785] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:16Z level=info event=scheduler_restarting addr=lb:500516345worker1 # [ 138.228172] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:382166346worker1 # [ 138.233273] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=worker_gone addr=192.168.1.4:500516347worker1 # [ 138.236381] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=scheduler_restarting addr=lb:500516348worker1 # [ 138.239438] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:382166349worker1 # [ 138.243195] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:16Z level=info event=worker_gone addr=192.168.1.3:500516350lb # [ 138.325555] niks3-server[1206]: 2026/09/20 08:17:17 INFO lead: acquired remote=192.168.1.4:601386351worker2 # [ 138.330573] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:16Z level=info event=scheduler_take_over6352worker2 # [ 138.431943] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500516353worker1 # [ 138.428997] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500516354worker2 # [ 138.436690] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6355worker2 # [ 138.447920] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=06356worker2 # [ 138.637829] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500516357worker2 # [ 138.641875] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6358worker2 # [ 138.842663] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500516359worker2 # [ 138.847434] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06360lb # [ 138.892656] envoy[982]: conn peer=[2001:db8:1::1]:39048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9446 tx=3767 ms=61616361lb # [ 138.894258] envoy[982]: conn peer=[2001:db8:1::1]:39038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1349 ms=105826362worker1 # [ 139.224092] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:17Z level=info event=scheduler_restarting6363worker2 # [ 139.232366] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:359386364worker1 # [ 139.229258] nix-grpc-daemon[1398]: ts=2026-09-20T08:17:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6365worker2 # [ 139.236560] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:17Z level=info event=worker_gone addr=192.168.1.3:500516366worker1 # [ 139.239796] nix-daemon[918]: reaped child process 1449, status = succeeded6367worker1 # [ 139.399955] nix-grpc-daemon[1398]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6368worker1 # [ 139.401421] nix-grpc-daemon[1398]: E0000 00:00:1789892238.105182 1441 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6369worker1 # [ 139.403268] nix-grpc-daemon[1398]: E0000 00:00:1789892238.105291 1441 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6370worker1 # [ 141.036515] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6371worker1 # [ 141.040069] systemd[1]: nix-grpc-daemon.service: Consumed 662ms CPU time over 24.399s wall clock time, 33.3M memory peak, 23.3K incoming IP traffic, 31.3K outgoing IP traffic.6372worker1 # [ 141.056376] systemd[1]: Starting Nix worker-protocol over gRPC...6373worker1 # [ 141.227701] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6374worker1 # [ 141.230979] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16375worker1 # [ 141.236820] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6376worker1 # [ 141.238399] systemd[1]: Started Nix worker-protocol over gRPC.6377worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.05 seconds)6378lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6379lb: must succeed: curl -sf localhost:9901/clusters6380worker1 # [ 141.269926] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500516381worker2 # [ 141.280446] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06382lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6383lb: must succeed: curl -sf localhost:9901/clusters6384lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6385lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)6386lb: must succeed: curl -sf localhost:9901/clusters6387lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6388worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6389worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6390(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.84 seconds)6391subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6392client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16393worker1 # [ 142.746465] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:446866394worker1 # [ 142.757909] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6395worker2 # [ 142.788549] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:21Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06396worker2 # [ 142.792601] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:21Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16397worker2 # [ 142.796805] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:21Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06398worker2 # [ 142.800634] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:21Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06399worker1 # [ 142.824965] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866400worker1 # [ 142.836525] nix-grpc-daemon[1608]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)6401worker1 # [ 142.925302] nix-grpc-daemon[1608]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5)6402worker1 # [ 143.000383] nix-grpc-daemon[1608]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 171 ms (attempt 3/5)6403worker1 # [ 143.177365] nix-grpc-daemon[1608]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 427 ms (attempt 4/5)6404worker1 # [ 143.610438] nix-grpc-daemon[1608]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6405worker1 # [ 143.623447] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866406worker1 # [ 143.632039] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866407worker1 # [ 143.636541] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6408worker1 # [ 143.649291] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:22Z level=info event=niks3_push_started pid=16646409worker1 # [ 143.970876] nix-daemon[918]: accepted connection from pid 1677, user nix-grpc-daemon (trusted)6410worker1 # [ 143.982708] nix-daemon[918]: reaped child process 1680, status = succeeded6411worker1 # [ 144.146368] nix-daemon[918]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)6412worker1 # [ 144.156574] nix-daemon[918]: reaped child process 1685, status = succeeded6413lb # [ 144.175592] niks3-server[1206]: 2026/09/20 08:17:22 INFO Received uploads request method=POST path=/api/pending_closures6414worker1 # [ 144.180510] nix-grpc-daemon[1664]: time=2026-09-20T08:17:22.885Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6415worker1 # [ 144.182248] nix-grpc-daemon[1664]: time=2026-09-20T08:17:22.887Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6416lb # [ 144.207984] niks3-server[1206]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6417lb # [ 144.217343] niks3-server[1206]: 2026/09/20 08:17:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6418lb # [ 144.222139] niks3-server[1206]: 2026/09/20 08:17:23 INFO Signed narinfos id=44 count=16419worker1 # [ 144.221841] nix-grpc-daemon[1664]: time=2026-09-20T08:17:22.926Z level=INFO msg="Uploading 1 narinfos"6420lb # [ 144.231963] niks3-server[1206]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6421lb # [ 144.241423] niks3-server[1206]: 2026/09/20 08:17:23 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6422lb # [ 144.246180] niks3-server[1206]: 2026/09/20 08:17:23 INFO Completed upload id=446423worker1 # [ 144.244930] nix-grpc-daemon[1664]: time=2026-09-20T08:17:22.950Z level=INFO msg="Upload complete. (425ms)"6424lb # [ 144.250311] niks3-server[1206]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6425worker1 # [ 144.248261] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=5046426worker1 # [ 144.253431] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866427worker1 # [ 144.261783] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6428worker1 # [ 144.265492] nix-daemon[918]: reaped child process 1662, status = succeeded6429worker1 # [ 144.270193] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6430worker1 # [ 145.093975] nix-daemon[918]: reaped child process 1689, status = succeeded6431worker1 # [ 145.249844] nix-daemon[918]: accepted connection from pid 1704, user nix-grpc-daemon (trusted)6432worker1 # [ 145.260718] nix-daemon[918]: reaped child process 1707, status = succeeded6433lb # [ 145.279172] niks3-server[1206]: 2026/09/20 08:17:24 INFO Received uploads request method=POST path=/api/pending_closures6434worker1 # [ 145.283898] nix-grpc-daemon[1664]: time=2026-09-20T08:17:23.989Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6435worker1 # [ 145.285372] nix-grpc-daemon[1664]: time=2026-09-20T08:17:23.990Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6436lb # [ 145.315885] niks3-server[1206]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6437lb # [ 145.323110] niks3-server[1206]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6438lb # [ 145.335379] niks3-server[1206]: 2026/09/20 08:17:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6439lb # [ 145.340123] niks3-server[1206]: 2026/09/20 08:17:24 INFO Signed narinfos id=45 count=16440worker1 # [ 145.340684] nix-grpc-daemon[1664]: time=2026-09-20T08:17:24.045Z level=INFO msg="Uploading 1 narinfos"6441lb # [ 145.344299] niks3-server[1206]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6442lb # [ 145.354150] niks3-server[1206]: 2026/09/20 08:17:24 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6443lb # [ 145.360042] niks3-server[1206]: 2026/09/20 08:17:24 INFO Completed upload id=456444worker1 # [ 145.356542] nix-grpc-daemon[1664]: time=2026-09-20T08:17:24.061Z level=INFO msg="Upload complete. (279ms)"6445lb # [ 145.362975] niks3-server[1206]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6446worker1 # [ 145.363434] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16447worker2 # [ 145.375657] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:23Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16448worker2 # [ 145.382775] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:23Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06449worker1 # [ 145.377946] nix-daemon[918]: reaped child process 1687, status = succeeded6450worker1 # [ 145.411285] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866451worker1 # [ 145.422773] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866452worker1 # [ 145.433400] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866453worker1 # [ 145.441308] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6454worker1 # [ 145.605599] nix-daemon[918]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6455worker1 # [ 145.618190] nix-daemon[918]: reaped child process 1714, status = succeeded6456worker1 # [ 145.770141] nix-daemon[918]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)6457worker1 # [ 145.781560] nix-daemon[918]: reaped child process 1719, status = succeeded6458lb # [ 145.801132] niks3-server[1206]: 2026/09/20 08:17:24 INFO Received uploads request method=POST path=/api/pending_closures6459worker1 # [ 145.805533] nix-grpc-daemon[1664]: time=2026-09-20T08:17:24.510Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6460worker1 # [ 145.806918] nix-grpc-daemon[1664]: time=2026-09-20T08:17:24.510Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6461lb # [ 145.823995] niks3-server[1206]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6462lb # [ 145.834463] niks3-server[1206]: 2026/09/20 08:17:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6463lb # [ 145.838671] niks3-server[1206]: 2026/09/20 08:17:24 INFO Signed narinfos id=46 count=16464worker1 # [ 145.838193] nix-grpc-daemon[1664]: time=2026-09-20T08:17:24.543Z level=INFO msg="Uploading 1 narinfos"6465lb # [ 145.847645] niks3-server[1206]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6466lb # [ 145.857733] niks3-server[1206]: 2026/09/20 08:17:24 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6467lb # [ 145.862411] niks3-server[1206]: 2026/09/20 08:17:24 INFO Completed upload id=466468worker1 # [ 145.861059] nix-grpc-daemon[1664]: time=2026-09-20T08:17:24.566Z level=INFO msg="Upload complete. (407ms)"6469lb # [ 145.867645] niks3-server[1206]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6470worker1 # [ 145.863391] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=5046471worker1 # [ 145.868537] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866472worker1 # [ 145.877264] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6473worker1 # [ 145.881412] nix-daemon[918]: reaped child process 1709, status = succeeded6474worker1 # [ 145.886257] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6475worker1 # [ 146.708898] nix-daemon[918]: reaped child process 1723, status = succeeded6476worker1 # [ 146.835710] nix-daemon[918]: accepted connection from pid 1738, user nix-grpc-daemon (trusted)6477worker1 # [ 146.846187] nix-daemon[918]: reaped child process 1741, status = succeeded6478lb # [ 146.862482] niks3-server[1206]: 2026/09/20 08:17:25 INFO Received uploads request method=POST path=/api/pending_closures6479worker1 # [ 146.865643] nix-grpc-daemon[1664]: time=2026-09-20T08:17:25.570Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6480worker1 # [ 146.867681] nix-grpc-daemon[1664]: time=2026-09-20T08:17:25.572Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6481lb # [ 146.888662] niks3-server[1206]: 2026/09/20 08:17:25 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6482lb # [ 146.904180] niks3-server[1206]: 2026/09/20 08:17:25 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6483lb # [ 146.913554] niks3-server[1206]: 2026/09/20 08:17:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6484worker1 # [ 146.914328] nix-grpc-daemon[1664]: time=2026-09-20T08:17:25.619Z level=INFO msg="Uploading 1 narinfos"6485lb # [ 146.918063] niks3-server[1206]: 2026/09/20 08:17:25 INFO Signed narinfos id=47 count=16486lb # [ 146.927825] niks3-server[1206]: 2026/09/20 08:17:25 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6487lb # [ 146.937205] niks3-server[1206]: 2026/09/20 08:17:25 INFO Completed upload id=476488worker1 # [ 146.932278] nix-grpc-daemon[1664]: time=2026-09-20T08:17:25.637Z level=INFO msg="Upload complete. (239ms)"6489lb # [ 146.938429] niks3-server[1206]: 2026/09/20 08:17:25 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6490worker2 # [ 146.946171] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:25Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16491worker1 # [ 146.937208] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16492worker1 # [ 146.946125] nix-grpc-daemon[1664]: time=2026-09-20T08:17:25.647Z level=WARN msg="Failed to register uploaded object" key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo error="server returned 404: object is not pending upload\n"6493worker2 # [ 146.954927] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:25Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06494worker1 # [ 146.950657] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866495worker1 # [ 146.957803] nix-daemon[918]: reaped child process 1721, status = succeeded6496worker1 # [ 146.959684] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866497worker1 # [ 146.964612] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866498worker1 # [ 146.968382] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6499worker1 # [ 147.115464] nix-daemon[918]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6500worker1 # [ 147.127696] nix-daemon[918]: reaped child process 1748, status = succeeded6501worker1 # [ 147.276304] nix-daemon[918]: accepted connection from pid 1750, user nix-grpc-daemon (trusted)6502worker1 # [ 147.289256] nix-daemon[918]: reaped child process 1753, status = succeeded6503lb # [ 147.302064] niks3-server[1206]: 2026/09/20 08:17:26 INFO Received uploads request method=POST path=/api/pending_closures6504worker1 # [ 147.309404] nix-grpc-daemon[1664]: time=2026-09-20T08:17:26.014Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6505worker1 # [ 147.310768] nix-grpc-daemon[1664]: time=2026-09-20T08:17:26.014Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6506lb # [ 147.338328] niks3-server[1206]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6507lb # [ 147.342570] niks3-server[1206]: 2026/09/20 08:17:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6508lb # [ 147.346947] niks3-server[1206]: 2026/09/20 08:17:26 INFO Signed narinfos id=48 count=16509worker1 # [ 147.346553] nix-grpc-daemon[1664]: time=2026-09-20T08:17:26.051Z level=INFO msg="Uploading 1 narinfos"6510lb # [ 147.356881] niks3-server[1206]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6511lb # [ 147.365244] niks3-server[1206]: 2026/09/20 08:17:26 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6512lb # [ 147.373145] niks3-server[1206]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6513lb # [ 147.377445] niks3-server[1206]: 2026/09/20 08:17:26 INFO Completed upload id=486514worker1 # [ 147.375198] nix-grpc-daemon[1664]: time=2026-09-20T08:17:26.079Z level=INFO msg="Upload complete. (399ms)"6515worker1 # [ 147.377607] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=5046516worker1 # [ 147.383325] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866517worker1 # [ 147.392236] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6518worker1 # [ 147.400580] nix-daemon[918]: reaped child process 1743, status = succeeded6519worker1 # [ 147.405258] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6520worker1 # [ 148.417661] nix-daemon[918]: reaped child process 1757, status = succeeded6521worker1 # [ 148.554579] nix-daemon[918]: accepted connection from pid 1772, user nix-grpc-daemon (trusted)6522worker1 # [ 148.566620] nix-daemon[918]: reaped child process 1775, status = succeeded6523lb # [ 148.586357] niks3-server[1206]: 2026/09/20 08:17:27 INFO Received uploads request method=POST path=/api/pending_closures6524worker1 # [ 148.592585] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.297Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6525worker1 # [ 148.594082] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.299Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6526lb # [ 148.624548] niks3-server[1206]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6527lb # [ 148.629630] niks3-server[1206]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6528lb # [ 148.639746] niks3-server[1206]: 2026/09/20 08:17:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6529worker1 # [ 148.641703] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.346Z level=INFO msg="Uploading 1 narinfos"6530lb # [ 148.645231] niks3-server[1206]: 2026/09/20 08:17:27 INFO Signed narinfos id=49 count=16531lb # [ 148.650350] niks3-server[1206]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6532lb # [ 148.654818] niks3-server[1206]: 2026/09/20 08:17:27 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6533lb # [ 148.658630] niks3-server[1206]: 2026/09/20 08:17:27 INFO Completed upload id=496534lb # [ 148.660590] niks3-server[1206]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6535worker1 # [ 148.656425] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.361Z level=INFO msg="Upload complete. (245ms)"6536worker2 # [ 148.669151] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:27Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16537worker1 # [ 148.662433] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16538worker2 # [ 148.675337] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:27Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06539worker1 # [ 148.670669] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866540worker1 # [ 148.680289] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866541worker1 # [ 148.682280] nix-daemon[918]: reaped child process 1755, status = succeeded6542worker1 # [ 148.687263] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.392Z level=INFO msg="All 1 paths already cached"6543worker1 # [ 148.691150] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866544worker1 # [ 148.694959] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6545worker1 # [ 148.849046] nix-daemon[918]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)6546worker1 # [ 148.860798] nix-daemon[918]: reaped child process 1782, status = succeeded6547lb # [ 148.892837] envoy[982]: conn peer=[2001:db8:1::3]:54536 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1142 tx=344 ms=222156548worker1 # [ 149.020210] nix-daemon[918]: accepted connection from pid 1784, user nix-grpc-daemon (trusted)6549worker1 # [ 149.032104] nix-daemon[918]: reaped child process 1787, status = succeeded6550lb # [ 149.046955] niks3-server[1206]: 2026/09/20 08:17:27 INFO Received uploads request method=POST path=/api/pending_closures6551worker1 # [ 149.051301] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.756Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6552worker1 # [ 149.052800] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.758Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6553lb # [ 149.077142] niks3-server[1206]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6554lb # [ 149.086839] niks3-server[1206]: 2026/09/20 08:17:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6555lb # [ 149.090987] niks3-server[1206]: 2026/09/20 08:17:27 INFO Signed narinfos id=50 count=16556worker1 # [ 149.090356] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.795Z level=INFO msg="Uploading 1 narinfos"6557lb # [ 149.095439] niks3-server[1206]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6558lb # [ 149.106905] niks3-server[1206]: 2026/09/20 08:17:27 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6559lb # [ 149.113841] niks3-server[1206]: 2026/09/20 08:17:27 INFO Completed upload id=506560lb # [ 149.115846] niks3-server[1206]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6561worker1 # [ 149.112205] nix-grpc-daemon[1664]: time=2026-09-20T08:17:27.817Z level=INFO msg="Upload complete. (411ms)"6562worker1 # [ 149.115403] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=6246563worker1 # [ 149.120248] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866564worker1 # [ 149.128798] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6565worker1 # [ 149.137118] nix-daemon[918]: reaped child process 1777, status = succeeded6566worker1 # [ 149.140278] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6567worker1 # [ 149.952513] nix-daemon[918]: reaped child process 1791, status = succeeded6568worker1 # [ 150.092492] nix-daemon[918]: accepted connection from pid 1806, user nix-grpc-daemon (trusted)6569worker1 # [ 150.104158] nix-daemon[918]: reaped child process 1809, status = succeeded6570lb # [ 150.124905] niks3-server[1206]: 2026/09/20 08:17:28 INFO Received uploads request method=POST path=/api/pending_closures6571worker1 # [ 150.130306] nix-grpc-daemon[1664]: time=2026-09-20T08:17:28.834Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6572worker1 # [ 150.134767] nix-grpc-daemon[1664]: time=2026-09-20T08:17:28.835Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6573lb # [ 150.163565] niks3-server[1206]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6574lb # [ 150.172101] niks3-server[1206]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6575lb # [ 150.182141] niks3-server[1206]: 2026/09/20 08:17:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6576worker1 # [ 150.184315] nix-grpc-daemon[1664]: time=2026-09-20T08:17:28.889Z level=INFO msg="Uploading 1 narinfos"6577lb # [ 150.187824] niks3-server[1206]: 2026/09/20 08:17:28 INFO Signed narinfos id=51 count=16578lb # [ 150.193166] niks3-server[1206]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6579lb # [ 150.202834] niks3-server[1206]: 2026/09/20 08:17:28 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6580lb # [ 150.209664] niks3-server[1206]: 2026/09/20 08:17:28 INFO Completed upload id=516581worker1 # [ 150.206238] nix-grpc-daemon[1664]: time=2026-09-20T08:17:28.911Z level=INFO msg="Upload complete. (260ms)"6582lb # [ 150.211377] niks3-server[1206]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6583worker2 # [ 150.218855] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:28Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16584worker1 # [ 150.209338] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16585worker2 # [ 150.224115] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:28Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06586worker1 # [ 150.214296] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866587worker1 # [ 150.226517] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866588worker1 # [ 150.229461] nix-daemon[918]: reaped child process 1789, status = succeeded6589worker1 # [ 150.233230] nix-grpc-daemon[1664]: time=2026-09-20T08:17:28.938Z level=INFO msg="All 1 paths already cached"6590worker1 # [ 150.236788] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866591worker1 # [ 150.240546] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6592worker1 # [ 150.388515] nix-daemon[918]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)6593worker1 # [ 150.401368] nix-daemon[918]: reaped child process 1816, status = succeeded6594worker1 # [ 150.562271] nix-daemon[918]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6595worker1 # [ 150.574073] nix-daemon[918]: reaped child process 1821, status = succeeded6596lb # [ 150.593440] niks3-server[1206]: 2026/09/20 08:17:29 INFO Received uploads request method=POST path=/api/pending_closures6597worker1 # [ 150.598114] nix-grpc-daemon[1664]: time=2026-09-20T08:17:29.303Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6598worker1 # [ 150.599600] nix-grpc-daemon[1664]: time=2026-09-20T08:17:29.304Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6599lb # [ 150.623065] niks3-server[1206]: 2026/09/20 08:17:29 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6600lb # [ 150.634080] niks3-server[1206]: 2026/09/20 08:17:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6601lb # [ 150.639508] niks3-server[1206]: 2026/09/20 08:17:29 INFO Signed narinfos id=52 count=16602worker1 # [ 150.638919] nix-grpc-daemon[1664]: time=2026-09-20T08:17:29.344Z level=INFO msg="Uploading 1 narinfos"6603lb # [ 150.645675] niks3-server[1206]: 2026/09/20 08:17:29 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6604lb # [ 150.657254] niks3-server[1206]: 2026/09/20 08:17:29 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6605lb # [ 150.662203] niks3-server[1206]: 2026/09/20 08:17:29 INFO Completed upload id=526606worker1 # [ 150.658853] nix-grpc-daemon[1664]: time=2026-09-20T08:17:29.364Z level=INFO msg="Upload complete. (412ms)"6607lb # [ 150.666724] niks3-server[1206]: 2026/09/20 08:17:29 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6608worker1 # [ 150.663330] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=6246609worker1 # [ 150.667813] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866610worker1 # [ 150.677881] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6611worker1 # [ 150.681487] nix-daemon[918]: reaped child process 1811, status = succeeded6612worker1 # [ 150.686442] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6613worker1 # [ 151.711420] nix-daemon[918]: reaped child process 1825, status = succeeded6614worker1 # [ 151.866433] nix-daemon[918]: accepted connection from pid 1840, user nix-grpc-daemon (trusted)6615worker1 # [ 151.878455] nix-daemon[918]: reaped child process 1843, status = succeeded6616lb # [ 151.899406] niks3-server[1206]: 2026/09/20 08:17:30 INFO Received uploads request method=POST path=/api/pending_closures6617worker1 # [ 152.094333] nix-grpc-daemon[1664]: time=2026-09-20T08:17:30.798Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6618worker1 # [ 152.095706] nix-grpc-daemon[1664]: time=2026-09-20T08:17:30.798Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6619lb # [ 152.116746] niks3-server[1206]: 2026/09/20 08:17:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6620lb # [ 152.118806] niks3-server[1206]: 2026/09/20 08:17:30 INFO Signed narinfos id=53 count=16621worker1 # [ 152.116623] nix-grpc-daemon[1664]: time=2026-09-20T08:17:30.821Z level=INFO msg="Uploading 1 narinfos"6622lb # [ 152.120875] niks3-server[1206]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6623lb # [ 152.127838] niks3-server[1206]: 2026/09/20 08:17:30 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6624lb # [ 152.133259] niks3-server[1206]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6625lb # [ 152.142417] niks3-server[1206]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6626lb # [ 152.148958] niks3-server[1206]: 2026/09/20 08:17:30 INFO Completed upload id=536627worker1 # [ 152.145654] nix-grpc-daemon[1664]: time=2026-09-20T08:17:30.850Z level=INFO msg="Upload complete. (452ms)"6628lb # [ 152.154817] niks3-server[1206]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6629worker1 # [ 152.151800] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16630worker2 # [ 152.159701] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:30Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16631worker2 # [ 152.169755] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:30Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06632worker1 # [ 152.165748] nix-daemon[918]: reaped child process 1823, status = succeeded6633worker1 # [ 152.200765] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866634worker1 # [ 152.212602] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866635worker1 # [ 152.226542] nix-grpc-daemon[1664]: time=2026-09-20T08:17:30.931Z level=INFO msg="All 1 paths already cached"6636worker1 # [ 152.232889] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866637worker1 # [ 152.242258] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6638worker1 # [ 152.422210] nix-daemon[918]: accepted connection from pid 1847, user nix-grpc-daemon (trusted)6639worker1 # [ 152.437715] nix-daemon[918]: reaped child process 1850, status = succeeded6640worker1 # [ 152.600108] nix-daemon[918]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6641worker1 # [ 152.612268] nix-daemon[918]: reaped child process 1855, status = succeeded6642lb # [ 152.631512] niks3-server[1206]: 2026/09/20 08:17:31 INFO Received uploads request method=POST path=/api/pending_closures6643worker1 # [ 152.635872] nix-grpc-daemon[1664]: time=2026-09-20T08:17:31.340Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6644worker1 # [ 152.637274] nix-grpc-daemon[1664]: time=2026-09-20T08:17:31.341Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6645lb # [ 152.655511] niks3-server[1206]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6646lb # [ 152.664545] niks3-server[1206]: 2026/09/20 08:17:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6647lb # [ 152.668696] niks3-server[1206]: 2026/09/20 08:17:31 INFO Signed narinfos id=54 count=16648worker1 # [ 152.668188] nix-grpc-daemon[1664]: time=2026-09-20T08:17:31.373Z level=INFO msg="Uploading 1 narinfos"6649lb # [ 152.679136] niks3-server[1206]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6650lb # [ 152.688744] niks3-server[1206]: 2026/09/20 08:17:31 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6651lb # [ 152.695072] niks3-server[1206]: 2026/09/20 08:17:31 INFO Completed upload id=546652worker1 # [ 152.691766] nix-grpc-daemon[1664]: time=2026-09-20T08:17:31.396Z level=INFO msg="Upload complete. (436ms)"6653worker1 # [ 152.695654] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=6246654lb # [ 152.699190] niks3-server[1206]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6655worker1 # [ 152.700436] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866656worker1 # [ 152.705025] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6657worker1 # [ 152.707157] nix-daemon[918]: reaped child process 1845, status = succeeded6658worker1 # [ 152.712742] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6659worker1 # [ 153.725770] nix-daemon[918]: reaped child process 1859, status = succeeded6660worker1 # [ 153.869183] nix-daemon[918]: accepted connection from pid 1874, user nix-grpc-daemon (trusted)6661worker1 # [ 153.880743] nix-daemon[918]: reaped child process 1877, status = succeeded6662lb # [ 153.901497] niks3-server[1206]: 2026/09/20 08:17:32 INFO Received uploads request method=POST path=/api/pending_closures6663worker1 # [ 153.907277] nix-grpc-daemon[1664]: time=2026-09-20T08:17:32.612Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6664worker1 # [ 153.908738] nix-grpc-daemon[1664]: time=2026-09-20T08:17:32.614Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6665lb # [ 153.947617] niks3-server[1206]: 2026/09/20 08:17:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6666lb # [ 153.952244] niks3-server[1206]: 2026/09/20 08:17:32 INFO Signed narinfos id=55 count=16667worker1 # [ 153.951806] nix-grpc-daemon[1664]: time=2026-09-20T08:17:32.657Z level=INFO msg="Uploading 1 narinfos"6668lb # [ 153.958690] niks3-server[1206]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6669lb # [ 153.966116] niks3-server[1206]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6670lb # [ 153.973487] niks3-server[1206]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6671lb # [ 153.981065] niks3-server[1206]: 2026/09/20 08:17:32 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6672lb # [ 153.986837] niks3-server[1206]: 2026/09/20 08:17:32 INFO Completed upload id=556673worker1 # [ 153.983633] nix-grpc-daemon[1664]: time=2026-09-20T08:17:32.688Z level=INFO msg="Upload complete. (264ms)"6674lb # [ 153.992210] niks3-server[1206]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6675worker1 # [ 153.989531] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16676worker2 # [ 153.997785] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:32Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16677worker2 # [ 154.007430] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:32Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06678worker1 # [ 154.003857] nix-daemon[918]: reaped child process 1857, status = succeeded6679worker1 # [ 154.038000] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866680worker1 # [ 154.051278] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866681worker1 # [ 154.063510] nix-grpc-daemon[1664]: time=2026-09-20T08:17:32.768Z level=INFO msg="All 2 paths already cached"6682worker1 # [ 154.070334] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866683worker1 # [ 154.080156] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6684worker1 # [ 154.247089] nix-daemon[918]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6685worker1 # [ 154.259229] nix-daemon[918]: reaped child process 1884, status = succeeded6686worker1 # [ 154.414330] nix-daemon[918]: accepted connection from pid 1886, user nix-grpc-daemon (trusted)6687worker1 # [ 154.425768] nix-daemon[918]: reaped child process 1889, status = succeeded6688lb # [ 154.445768] niks3-server[1206]: 2026/09/20 08:17:33 INFO Received uploads request method=POST path=/api/pending_closures6689worker1 # [ 154.637155] nix-grpc-daemon[1664]: time=2026-09-20T08:17:33.341Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6690worker1 # [ 154.640530] nix-grpc-daemon[1664]: time=2026-09-20T08:17:33.341Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6691lb # [ 154.656629] niks3-server[1206]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6692lb # [ 154.667066] niks3-server[1206]: 2026/09/20 08:17:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6693lb # [ 154.671239] niks3-server[1206]: 2026/09/20 08:17:33 INFO Signed narinfos id=56 count=16694worker1 # [ 154.671231] nix-grpc-daemon[1664]: time=2026-09-20T08:17:33.376Z level=INFO msg="Uploading 1 narinfos"6695lb # [ 154.687219] niks3-server[1206]: 2026/09/20 08:17:33 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6696lb # [ 154.691344] niks3-server[1206]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6697lb # [ 154.699498] niks3-server[1206]: 2026/09/20 08:17:33 INFO Completed upload id=566698worker1 # [ 154.696066] nix-grpc-daemon[1664]: time=2026-09-20T08:17:33.401Z level=INFO msg="Upload complete. (603ms)"6699worker1 # [ 154.700439] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=7526700lb # [ 154.708155] niks3-server[1206]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6701worker1 # [ 154.707471] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866702worker1 # [ 154.722236] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6703worker1 # [ 154.738849] nix-daemon[918]: reaped child process 1879, status = succeeded6704worker1 # [ 154.745125] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6705worker1 # [ 155.962184] nix-daemon[918]: reaped child process 1893, status = succeeded6706worker1 # [ 156.114530] nix-daemon[918]: accepted connection from pid 1908, user nix-grpc-daemon (trusted)6707worker1 # [ 156.126151] nix-daemon[918]: reaped child process 1911, status = succeeded6708lb # [ 156.146570] niks3-server[1206]: 2026/09/20 08:17:34 INFO Received uploads request method=POST path=/api/pending_closures6709worker1 # [ 156.158589] nix-grpc-daemon[1664]: time=2026-09-20T08:17:34.863Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6710worker1 # [ 156.160165] nix-grpc-daemon[1664]: time=2026-09-20T08:17:34.865Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6711lb # [ 156.196858] niks3-server[1206]: 2026/09/20 08:17:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6712worker1 # [ 156.201267] nix-grpc-daemon[1664]: time=2026-09-20T08:17:34.906Z level=INFO msg="Uploading 1 narinfos"6713lb # [ 156.204844] niks3-server[1206]: 2026/09/20 08:17:34 INFO Signed narinfos id=57 count=16714lb # [ 156.209507] niks3-server[1206]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6715lb # [ 156.215754] niks3-server[1206]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6716lb # [ 156.220762] niks3-server[1206]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6717lb # [ 156.226293] niks3-server[1206]: 2026/09/20 08:17:35 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6718lb # [ 156.229271] niks3-server[1206]: 2026/09/20 08:17:35 INFO Completed upload id=576719lb # [ 156.230801] niks3-server[1206]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6720worker1 # [ 156.227302] nix-grpc-daemon[1664]: time=2026-09-20T08:17:34.932Z level=INFO msg="Upload complete. (270ms)"6721worker2 # [ 156.241279] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:34Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16722worker1 # [ 156.233903] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16723worker1 # [ 156.247241] nix-daemon[918]: reaped child process 1891, status = succeeded6724worker1 # [ 156.276305] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866725worker1 # [ 156.288404] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866726worker1 # [ 156.301209] nix-grpc-daemon[1664]: time=2026-09-20T08:17:35.006Z level=INFO msg="All 2 paths already cached"6727worker1 # [ 156.309074] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866728worker1 # [ 156.318156] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6729worker1 # [ 156.486519] nix-daemon[918]: accepted connection from pid 1915, user nix-grpc-daemon (trusted)6730worker1 # [ 156.499792] nix-daemon[918]: reaped child process 1918, status = succeeded6731worker1 # [ 156.629719] nix-daemon[918]: accepted connection from pid 1920, user nix-grpc-daemon (trusted)6732worker1 # [ 156.641153] nix-daemon[918]: reaped child process 1923, status = succeeded6733lb # [ 156.655799] niks3-server[1206]: 2026/09/20 08:17:35 INFO Received uploads request method=POST path=/api/pending_closures6734worker1 # [ 156.660691] nix-grpc-daemon[1664]: time=2026-09-20T08:17:35.366Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6735worker1 # [ 156.662503] nix-grpc-daemon[1664]: time=2026-09-20T08:17:35.367Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6736lb # [ 156.682208] niks3-server[1206]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6737lb # [ 156.693720] niks3-server[1206]: 2026/09/20 08:17:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6738lb # [ 156.697896] niks3-server[1206]: 2026/09/20 08:17:35 INFO Signed narinfos id=58 count=16739worker1 # [ 156.697337] nix-grpc-daemon[1664]: time=2026-09-20T08:17:35.402Z level=INFO msg="Uploading 1 narinfos"6740lb # [ 156.704368] niks3-server[1206]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6741lb # [ 156.715477] niks3-server[1206]: 2026/09/20 08:17:35 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6742worker1 # [ 156.719304] nix-grpc-daemon[1664]: time=2026-09-20T08:17:35.424Z level=INFO msg="Upload complete. (390ms)"6743lb # [ 156.722833] niks3-server[1206]: 2026/09/20 08:17:35 INFO Completed upload id=586744worker1 # [ 156.721261] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=7526745lb # [ 156.725371] niks3-server[1206]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6746worker1 # [ 156.727347] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866747worker1 # [ 156.731278] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6748worker1 # [ 156.733434] nix-daemon[918]: reaped child process 1913, status = succeeded6749worker1 # [ 156.738827] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6750worker1 # [ 158.162993] nix-daemon[918]: reaped child process 1927, status = succeeded6751worker1 # [ 158.318994] nix-daemon[918]: accepted connection from pid 1942, user nix-grpc-daemon (trusted)6752worker1 # [ 158.330891] nix-daemon[918]: reaped child process 1945, status = succeeded6753lb # [ 158.351455] niks3-server[1206]: 2026/09/20 08:17:37 INFO Received uploads request method=POST path=/api/pending_closures6754worker1 # [ 158.355683] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.060Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6755worker1 # [ 158.357293] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.062Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6756lb # [ 158.389220] niks3-server[1206]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6757lb # [ 158.396293] niks3-server[1206]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6758lb # [ 158.404410] niks3-server[1206]: 2026/09/20 08:17:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6759lb # [ 158.408983] niks3-server[1206]: 2026/09/20 08:17:37 INFO Signed narinfos id=59 count=16760worker1 # [ 158.408308] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.113Z level=INFO msg="Uploading 1 narinfos"6761lb # [ 158.414700] niks3-server[1206]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6762lb # [ 158.424242] niks3-server[1206]: 2026/09/20 08:17:37 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6763lb # [ 158.429865] niks3-server[1206]: 2026/09/20 08:17:37 INFO Completed upload id=596764worker1 # [ 158.426347] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.131Z level=INFO msg="Upload complete. (278ms)"6765lb # [ 158.432550] niks3-server[1206]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6766worker2 # [ 158.441209] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:37Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16767worker1 # [ 158.431596] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16768worker1 # [ 158.444950] nix-daemon[918]: reaped child process 1925, status = succeeded6769worker1 # [ 158.475945] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866770worker1 # [ 158.488115] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446866771worker1 # [ 158.501137] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.206Z level=INFO msg="All 2 paths already cached"6772worker1 # [ 158.508411] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446866773worker1 # [ 158.516742] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6774worker1 # [ 158.682423] nix-daemon[918]: accepted connection from pid 1949, user nix-grpc-daemon (trusted)6775worker1 # [ 158.694945] nix-daemon[918]: reaped child process 1952, status = succeeded6776worker1 # [ 158.829408] nix-daemon[918]: accepted connection from pid 1954, user nix-grpc-daemon (trusted)6777worker1 # [ 158.840911] nix-daemon[918]: reaped child process 1957, status = succeeded6778lb # [ 158.857848] niks3-server[1206]: 2026/09/20 08:17:37 INFO Received uploads request method=POST path=/api/pending_closures6779worker1 # [ 158.862852] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.567Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6780worker1 # [ 158.864213] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.567Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6781lb # [ 158.882494] niks3-server[1206]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6782lb # [ 158.893650] niks3-server[1206]: 2026/09/20 08:17:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6783lb # [ 158.899794] niks3-server[1206]: 2026/09/20 08:17:37 INFO Signed narinfos id=60 count=16784worker1 # [ 158.899125] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.604Z level=INFO msg="Uploading 1 narinfos"6785lb # [ 158.904465] niks3-server[1206]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6786lb # [ 158.916736] niks3-server[1206]: 2026/09/20 08:17:37 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6787worker1 # [ 158.918426] nix-grpc-daemon[1664]: time=2026-09-20T08:17:37.623Z level=INFO msg="Upload complete. (388ms)"6788lb # [ 158.922090] niks3-server[1206]: 2026/09/20 08:17:37 INFO Completed upload id=606789worker1 # [ 158.920425] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=0 paths=1 nar_bytes_in=7526790lb # [ 158.925087] niks3-server[1206]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6791worker1 # [ 158.925825] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446866792worker1 # [ 158.932617] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6793worker1 # [ 158.934865] nix-daemon[918]: reaped child process 1947, status = succeeded6794worker1 # [ 158.940234] nix-daemon[918]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6795worker1 # [ 160.165812] nix-daemon[918]: reaped child process 1961, status = succeeded6796worker1 # [ 160.315241] nix-daemon[918]: accepted connection from pid 1976, user nix-grpc-daemon (trusted)6797worker1 # [ 160.327109] nix-daemon[918]: reaped child process 1979, status = succeeded6798lb # [ 160.346327] niks3-server[1206]: 2026/09/20 08:17:39 INFO Received uploads request method=POST path=/api/pending_closures6799worker1 # [ 160.350682] nix-grpc-daemon[1664]: time=2026-09-20T08:17:39.055Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6800worker1 # [ 160.352306] nix-grpc-daemon[1664]: time=2026-09-20T08:17:39.057Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6801lb # [ 160.377152] niks3-server[1206]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6802lb # [ 160.390079] niks3-server[1206]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6803lb # [ 160.399170] niks3-server[1206]: 2026/09/20 08:17:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6804lb # [ 160.403095] niks3-server[1206]: 2026/09/20 08:17:39 INFO Signed narinfos id=61 count=16805worker1 # [ 160.401946] nix-grpc-daemon[1664]: time=2026-09-20T08:17:39.107Z level=INFO msg="Uploading 1 narinfos"6806lb # [ 160.408229] niks3-server[1206]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6807lb # [ 160.416220] niks3-server[1206]: 2026/09/20 08:17:39 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6808lb # [ 160.422256] niks3-server[1206]: 2026/09/20 08:17:39 INFO Completed upload id=616809worker1 # [ 160.421185] nix-grpc-daemon[1664]: time=2026-09-20T08:17:39.126Z level=INFO msg="Upload complete. (273ms)"6810lb # [ 160.425840] niks3-server[1206]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6811worker1 # [ 160.426632] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44686 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16812worker1 # [ 160.438689] nix-daemon[918]: reaped child process 1959, status = succeeded6813client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.96 seconds)6814worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6815worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6816client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16817worker2 # [ 160.765423] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:354346818worker2 # [ 160.775912] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:39Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06819client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.25 seconds)6820(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 18.28 seconds)6821subtest: low disk drains a worker and builds go to the other6822worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6823worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.95 seconds)6824worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6825worker1 # [ 162.249610] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:40Z level=info event=unhealthy reason=min_free6826worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.10 seconds)6827client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26828worker1 # [ 163.060873] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:446866829client # don't know how to build these paths:6830client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6831worker2 # [ 163.088164] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:41Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06832worker2 # [ 163.092343] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:41Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16833worker2 # [ 163.129522] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346834worker2 # [ 163.137251] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354346835client # copying 1 paths to 'lb:50051'...6836client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6837worker2 # [ 163.144363] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354346838worker2 # [ 163.149584] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6839worker2 # [ 163.299222] nix-daemon[919]: accepted connection from pid 1830, user nix-grpc-daemon (trusted)6840worker2 # [ 163.312359] nix-daemon[919]: reaped child process 1833, status = succeeded6841worker2 # [ 163.475074] nix-daemon[919]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6842worker2 # [ 163.486809] nix-daemon[919]: reaped child process 1838, status = succeeded6843lb # [ 163.492905] niks3-server[1206]: 2026/09/20 08:17:42 INFO Received uploads request method=POST path=/api/pending_closures6844worker2 # [ 163.507508] nix-grpc-daemon[1630]: time=2026-09-20T08:17:42.121Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6845worker2 # [ 163.509049] nix-grpc-daemon[1630]: time=2026-09-20T08:17:42.122Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6846lb # [ 163.525458] niks3-server[1206]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6847lb # [ 163.538969] niks3-server[1206]: 2026/09/20 08:17:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6848lb # [ 163.544071] niks3-server[1206]: 2026/09/20 08:17:42 INFO Signed narinfos id=62 count=16849worker2 # [ 163.551551] nix-grpc-daemon[1630]: time=2026-09-20T08:17:42.165Z level=INFO msg="Uploading 1 narinfos"6850lb # [ 163.547467] niks3-server[1206]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6851lb # [ 163.556232] niks3-server[1206]: 2026/09/20 08:17:42 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6852lb # [ 163.559572] niks3-server[1206]: 2026/09/20 08:17:42 INFO Completed upload id=626853worker2 # [ 163.564165] nix-grpc-daemon[1630]: time=2026-09-20T08:17:42.177Z level=INFO msg="Upload complete. (409ms)"6854lb # [ 163.561101] niks3-server[1206]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6855worker2 # [ 163.568110] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=0 paths=1 nar_bytes_in=5126856worker2 # [ 163.573254] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346857worker2 # [ 163.581082] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6858worker2 # [ 163.586369] nix-daemon[919]: reaped child process 1828, status = succeeded6859worker2 # [ 163.591134] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6860client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6861client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6862client # farm-a> LOG-farm-a-drain6863worker2 # [ 165.005791] nix-daemon[919]: reaped child process 1842, status = succeeded6864worker2 # [ 165.152549] nix-daemon[919]: accepted connection from pid 1857, user nix-grpc-daemon (trusted)6865worker2 # [ 165.163180] nix-daemon[919]: reaped child process 1860, status = succeeded6866lb # [ 165.174501] niks3-server[1206]: 2026/09/20 08:17:43 INFO Received uploads request method=POST path=/api/pending_closures6867worker2 # [ 165.187039] nix-grpc-daemon[1630]: time=2026-09-20T08:17:43.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6868worker2 # [ 165.188559] nix-grpc-daemon[1630]: time=2026-09-20T08:17:43.802Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6869lb # [ 165.214837] niks3-server[1206]: 2026/09/20 08:17:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6870lb # [ 165.220518] niks3-server[1206]: 2026/09/20 08:17:44 INFO Signed narinfos id=63 count=16871worker2 # [ 165.227745] nix-grpc-daemon[1630]: time=2026-09-20T08:17:43.841Z level=INFO msg="Uploading 1 narinfos"6872lb # [ 165.235295] niks3-server[1206]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6873lb # [ 165.238697] niks3-server[1206]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6874lb # [ 165.246786] niks3-server[1206]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6875lb # [ 165.254630] niks3-server[1206]: 2026/09/20 08:17:44 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6876lb # [ 165.257506] niks3-server[1206]: 2026/09/20 08:17:44 INFO Completed upload id=636877lb # [ 165.258909] niks3-server[1206]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6878worker2 # [ 165.263445] nix-grpc-daemon[1630]: time=2026-09-20T08:17:43.877Z level=INFO msg="Upload complete. (265ms)"6879worker2 # [ 165.268859] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16880worker2 # [ 165.280396] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:43Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06881worker2 # [ 165.283799] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:43Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16882worker2 # [ 165.291994] nix-daemon[919]: reaped child process 1840, status = succeeded6883worker2 # [ 165.324356] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346884worker2 # [ 165.337632] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354346885worker2 # [ 165.350241] nix-grpc-daemon[1630]: time=2026-09-20T08:17:43.963Z level=INFO msg="All 1 paths already cached"6886client # copying 1 paths to 'lb:50051'...6887client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6888worker2 # [ 165.358079] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354346889worker2 # [ 165.368126] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6890worker2 # [ 165.532154] nix-daemon[919]: accepted connection from pid 1866, user nix-grpc-daemon (trusted)6891worker2 # [ 165.544266] nix-daemon[919]: reaped child process 1869, status = succeeded6892worker2 # [ 165.701140] nix-daemon[919]: accepted connection from pid 1871, user nix-grpc-daemon (trusted)6893worker2 # [ 165.712719] nix-daemon[919]: reaped child process 1874, status = succeeded6894lb # [ 165.724191] niks3-server[1206]: 2026/09/20 08:17:44 INFO Received uploads request method=POST path=/api/pending_closures6895worker2 # [ 165.736805] nix-grpc-daemon[1630]: time=2026-09-20T08:17:44.350Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6896worker2 # [ 165.738188] nix-grpc-daemon[1630]: time=2026-09-20T08:17:44.350Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6897lb # [ 165.749414] niks3-server[1206]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6898lb # [ 165.759471] niks3-server[1206]: 2026/09/20 08:17:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6899lb # [ 165.764675] niks3-server[1206]: 2026/09/20 08:17:44 INFO Signed narinfos id=64 count=16900worker2 # [ 165.772278] nix-grpc-daemon[1630]: time=2026-09-20T08:17:44.385Z level=INFO msg="Uploading 1 narinfos"6901lb # [ 165.771625] niks3-server[1206]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6902lb # [ 165.781890] niks3-server[1206]: 2026/09/20 08:17:44 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6903worker2 # [ 165.792288] nix-grpc-daemon[1630]: time=2026-09-20T08:17:44.405Z level=INFO msg="Upload complete. (413ms)"6904lb # [ 165.787634] niks3-server[1206]: 2026/09/20 08:17:44 INFO Completed upload id=646905worker2 # [ 165.795073] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=0 paths=1 nar_bytes_in=6246906lb # [ 165.792487] niks3-server[1206]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6907worker2 # [ 165.800315] nix-daemon[919]: reaped child process 1864, status = succeeded6908worker2 # [ 165.801561] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346909worker2 # [ 165.805145] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6910client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6911worker2 # [ 165.812386] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6912client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6913client # farm-b> LOG-farm-b-drain6914worker2 # [ 167.234843] nix-daemon[919]: reaped child process 1878, status = succeeded6915worker2 # [ 167.382233] nix-daemon[919]: accepted connection from pid 1893, user nix-grpc-daemon (trusted)6916worker2 # [ 167.393436] nix-daemon[919]: reaped child process 1896, status = succeeded6917lb # [ 167.397833] niks3-server[1206]: 2026/09/20 08:17:46 INFO Received uploads request method=POST path=/api/pending_closures6918worker2 # [ 167.409970] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.023Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6919worker2 # [ 167.412051] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.025Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6920lb # [ 167.439460] niks3-server[1206]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6921lb # [ 167.445602] niks3-server[1206]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6922lb # [ 167.453318] niks3-server[1206]: 2026/09/20 08:17:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6923lb # [ 167.459269] niks3-server[1206]: 2026/09/20 08:17:46 INFO Signed narinfos id=65 count=16924worker2 # [ 167.467523] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.081Z level=INFO msg="Uploading 1 narinfos"6925lb # [ 167.466704] niks3-server[1206]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6926lb # [ 167.475249] niks3-server[1206]: 2026/09/20 08:17:46 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6927lb # [ 167.480206] niks3-server[1206]: 2026/09/20 08:17:46 INFO Completed upload id=656928worker2 # [ 167.487295] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.100Z level=INFO msg="Upload complete. (266ms)"6929lb # [ 167.484790] niks3-server[1206]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6930worker2 # [ 167.491678] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16931worker2 # [ 167.504280] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06932worker2 # [ 167.508211] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16933worker2 # [ 167.516474] nix-daemon[919]: reaped child process 1876, status = succeeded6934worker2 # [ 167.546764] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346935worker2 # [ 167.553477] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:354346936worker2 # [ 167.559755] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.173Z level=INFO msg="All 2 paths already cached"6937client # copying 1 paths to 'lb:50051'...6938worker2 # [ 167.564888] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:354346939client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6940worker2 # [ 167.570343] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6941worker2 # [ 167.715779] nix-daemon[919]: accepted connection from pid 1902, user nix-grpc-daemon (trusted)6942worker2 # [ 167.728894] nix-daemon[919]: reaped child process 1905, status = succeeded6943worker2 # [ 167.879360] nix-daemon[919]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)6944worker2 # [ 167.890885] nix-daemon[919]: reaped child process 1910, status = succeeded6945lb # [ 167.901710] niks3-server[1206]: 2026/09/20 08:17:46 INFO Received uploads request method=POST path=/api/pending_closures6946worker2 # [ 167.913877] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.527Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6947worker2 # [ 167.915792] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.529Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6948lb # [ 167.926975] niks3-server[1206]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6949lb # [ 167.938398] niks3-server[1206]: 2026/09/20 08:17:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6950lb # [ 167.942703] niks3-server[1206]: 2026/09/20 08:17:46 INFO Signed narinfos id=66 count=16951worker2 # [ 167.950294] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.563Z level=INFO msg="Uploading 1 narinfos"6952lb # [ 167.949849] niks3-server[1206]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6953lb # [ 167.960783] niks3-server[1206]: 2026/09/20 08:17:46 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6954lb # [ 167.966168] niks3-server[1206]: 2026/09/20 08:17:46 INFO Completed upload id=666955worker2 # [ 167.973095] nix-grpc-daemon[1630]: time=2026-09-20T08:17:46.586Z level=INFO msg="Upload complete. (396ms)"6956lb # [ 167.968620] niks3-server[1206]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6957worker2 # [ 167.975036] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=0 paths=1 nar_bytes_in=7526958worker2 # [ 167.979631] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:354346959worker2 # [ 167.988524] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6960worker2 # [ 167.992038] nix-daemon[919]: reaped child process 1900, status = succeeded6961worker2 # [ 167.996062] nix-daemon[919]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6962client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6963client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6964client # farm-top> LOG-farm-top-drain6965lb # [ 168.893317] envoy[982]: conn peer=[2001:db8:1::1]:47794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26752 tx=10661 ms=177046966lb # [ 168.894870] envoy[982]: conn peer=[2001:db8:1::1]:38476 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=708 tx=438 ms=296967worker2 # [ 169.022738] nix-daemon[919]: reaped child process 1914, status = succeeded6968worker2 # [ 169.175263] nix-daemon[919]: accepted connection from pid 1929, user nix-grpc-daemon (trusted)6969worker2 # [ 169.187101] nix-daemon[919]: reaped child process 1932, status = succeeded6970lb # [ 169.198184] niks3-server[1206]: 2026/09/20 08:17:47 INFO Received uploads request method=POST path=/api/pending_closures6971worker2 # [ 169.207441] nix-grpc-daemon[1630]: time=2026-09-20T08:17:47.820Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6972worker2 # [ 169.208962] nix-grpc-daemon[1630]: time=2026-09-20T08:17:47.822Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6973lb # [ 169.219717] niks3-server[1206]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6974lb # [ 169.222929] niks3-server[1206]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6975lb # [ 169.226027] niks3-server[1206]: 2026/09/20 08:17:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6976lb # [ 169.228752] niks3-server[1206]: 2026/09/20 08:17:48 INFO Signed narinfos id=67 count=16977worker2 # [ 169.233546] nix-grpc-daemon[1630]: time=2026-09-20T08:17:47.847Z level=INFO msg="Uploading 1 narinfos"6978lb # [ 169.234269] niks3-server[1206]: 2026/09/20 08:17:48 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6979lb # [ 169.237988] niks3-server[1206]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6980lb # [ 169.240819] niks3-server[1206]: 2026/09/20 08:17:48 INFO Completed upload id=676981worker2 # [ 169.245422] nix-grpc-daemon[1630]: time=2026-09-20T08:17:47.859Z level=INFO msg="Upload complete. (242ms)"6982lb # [ 169.243222] niks3-server[1206]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6983worker2 # [ 169.249222] nix-grpc-daemon[1542]: ts=2026-09-20T08:17:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35434 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16984worker2 # [ 169.254623] nix-daemon[919]: reaped child process 1912, status = succeeded6985client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.47 seconds)6986client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6987client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.18 seconds)6988worker1: must succeed: rm /nix/.rw-store/fill6989worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6990worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6991worker1 # [ 170.257273] nix-grpc-daemon[1608]: ts=2026-09-20T08:17:48Z level=info event=healthy reason=min_free6992worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)6993(finished: subtest: low disk drains a worker and builds go to the other, in 9.96 seconds)6994(finished: run the VM test script, in 171.69 seconds)6995test script finished in 171.94s6996cleanup6997kill QemuMachine (pid 49)6998client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6999kill QemuMachine (pid 50)7000lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7001kill QemuMachine (pid 51)7002worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7003kill QemuMachine (pid 52)7004worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7005(finished: cleanup, in 0.96 seconds)7006additionally exposed symbols:7007 client, lb, worker1, worker2,7008 vlan1,7009 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh