tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2: QEMU running (pid 52) worker2 # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.WcUnTSO9dj', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: de790940-3e3b-4282-a820-89c8def9c959 worker2 # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 worker2 # worker2 # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. worker2 # Starting virtiofs daemons... worker2 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Disk image does not exist, creating the virtualisation disk image... worker2 # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Formatting '/build/vm-state-lb/tmp.49aCVaTM3Z', fmt=raw size=1073741824 worker2 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # Discarding device blocks: 0/262144 done worker2 # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests lb # Filesystem UUID: 2889e468-078f-4b61-be2f-08828f933773 lb # Superblock backups stored on blocks: worker1: QEMU running (pid 51) worker1 # Disk image does not exist, creating the virtualisation disk image... lb # 32768, 98304, 163840, 229376 worker2 # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests lb: QEMU running (pid 50) worker1 # Formatting '/build/vm-state-worker1/tmp.53KL03rafn', fmt=raw size=1073741824 lb # worker1 # mke2fs 1.47.4 (6-Mar-2025) lb # Allocating group tables: 0/8 done worker1 # Discarding device blocks: 0/262144 done lb # Writing inode tables: 0/8 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Creating journal (8192 blocks): done worker1 # Filesystem UUID: c08cad62-9032-4186-bfc3-8fdaf7b86aaa lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Superblock backups stored on blocks: lb # client # Disk image does not exist, creating the virtualisation disk image... worker1 # 32768, 98304, 163840, 229376 lb # Virtualisation disk image created. client # Formatting '/build/vm-state-client/tmp.4B85MuuL2O', fmt=raw size=1073741824 worker1 # lb # Starting virtiofs daemons... client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Allocating group tables: 0/8 done lb # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Discarding device blocks: 0/262144 done worker1 # Writing inode tables: 0/8 done lb # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Creating journal (8192 blocks): done lb # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Filesystem UUID: 2e6968cc-8085-486f-a88e-8c11acb36939 worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Superblock backups stored on blocks: worker1 # lb # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # 32768, 98304, 163840, 229376 worker1 # Virtualisation disk image created. lb # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... client # worker1 # Starting virtiofs daemons... lb # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Allocating group tables: 0/8 done worker1 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Writing inode tables: 0/8 done worker1 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Creating journal (8192 blocks): done worker1 # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # worker1 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # Virtualisation disk image created. worker1 # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... client: QEMU running (pid 49) worker2 # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # Starting virtiofs daemons... worker1 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... (finished: start all VMs, in 0.23 seconds) client # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client: waiting for unit network-addresses-eth1.service client # [2026-09-22T11:32:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client: waiting for the VM to finish booting client # [2026-09-22T11:32:18Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:32:18Z INFO virtiofsd] Client connected, servicing requests worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # worker2 # worker1 # worker1 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # client # worker2 # client # worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker1 # Booting from ROM... worker2 # Booting from ROM... client # Booting from ROM... lb # Booting from ROM... worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9l48jkcr6cdiqp8y6v9sxvagdw5w59l4-nixos-system-worker1-test/init regInfo=/nix/store/jjgcx7snicxga06ahrah0z8a6l3fgmhf-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2r960cj2h4zwi2h592n0agq168cha874-nixos-system-worker2-test/init regInfo=/nix/store/7g0xk07bpn0vi477049b6nn9r1qix82k-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test/init regInfo=/nix/store/iayv2xqplqy5pxgnqa549zwg9kilmzp9-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] kvm-clock: using sched offset of 476237589 cycles client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000001] kvm-clock: using sched offset of 473636102 cycles worker1 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.002739] Using GB pages for direct mapping client # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002866] RAMDISK: [mem 0x5e370000-0x5ffcffff] client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002875] ACPI: Early table checksum verification disabled client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.002877] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] kvm-clock: using sched offset of 462979805 cycles worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.002881] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002729] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.002740] Using GB pages for direct mapping client # [ 0.000006] tsc: Detected 2400.012 MHz processor worker1 # [ 0.002886] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002876] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.000816] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002884] ACPI: Early table checksum verification disabled worker1 # [ 0.002892] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002887] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000849] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.002894] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000852] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002891] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002895] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002741] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.002753] Using GB pages for direct mapping worker2 # [ 0.002895] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002897] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002873] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.002902] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002898] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002882] ACPI: Early table checksum verification disabled lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.002904] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.002885] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002900] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002906] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002890] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002901] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002907] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002902] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.002895] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002909] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002903] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002902] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.002910] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002904] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.002903] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.002911] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.002904] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.002905] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002912] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.002904] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.002907] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002913] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002905] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.002908] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003129] No NUMA configuration found worker2 # [ 0.002913] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.003129] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002910] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002914] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.003132] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005410] Zone ranges: client # [ 0.002911] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002914] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.002912] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.005411] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002915] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.003141] No NUMA configuration found worker1 # [ 0.005412] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.002913] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.005413] Normal empty lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.005414] Device empty worker2 # [ 0.003142] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002913] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.005414] Movable zone start for each node worker2 # [ 0.003144] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005415] Early memory node ranges worker2 # [ 0.005365] Zone ranges: client # [ 0.002914] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.005415] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.005366] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.002914] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.005368] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.005416] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.002915] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.005369] Normal empty lb # [ 0.000000] SMBIOS 2.8 present. client # [ 0.003143] No NUMA configuration found worker2 # [ 0.005370] Device empty worker1 # [ 0.005418] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.005370] Movable zone start for each node worker1 # [ 0.005437] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.003144] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.005371] Early memory node ranges lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.005707] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.003147] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.005372] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.005357] Zone ranges: lb # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.032774] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.005373] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.005359] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.033227] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.005374] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.005360] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.033239] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.005361] Normal empty lb # [ 0.000000] kvm-clock: using sched offset of 492142319 cycles worker2 # [ 0.005393] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.005362] Device empty worker1 # [ 0.033265] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.005363] Movable zone start for each node worker2 # [ 0.005652] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.005364] Early memory node ranges worker1 # [ 0.033268] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.031950] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.005364] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.033269] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.032416] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.005365] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.032427] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.033271] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.005366] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.032457] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.033272] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.005386] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.032460] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.033272] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.005650] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.032461] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.033275] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002745] Using GB pages for direct mapping client # [ 0.031943] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.033276] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.032463] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.002848] RAMDISK: [mem 0x5e36e000-0x5ffcffff] client # [ 0.032414] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.033279] TSC deadline timer available client # [ 0.032426] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.002857] ACPI: Early table checksum verification disabled worker2 # [ 0.032464] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.033283] CPU topo: Max. logical packages: 1 lb # [ 0.002860] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.033284] CPU topo: Max. logical dies: 1 client # [ 0.032456] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.032464] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.033284] CPU topo: Max. dies per package: 1 worker2 # [ 0.032467] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.032459] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.002864] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033288] CPU topo: Max. threads per core: 1 worker2 # [ 0.032468] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.032461] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.033288] CPU topo: Num. cores per package: 1 lb # [ 0.002867] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.032471] TSC deadline timer available worker1 # [ 0.033289] CPU topo: Num. threads per package: 1 client # [ 0.032462] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.032475] CPU topo: Max. logical packages: 1 lb # [ 0.002875] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.032476] CPU topo: Max. logical dies: 1 worker1 # [ 0.033289] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.032463] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.002877] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.032476] CPU topo: Max. dies per package: 1 worker1 # [ 0.033305] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.032464] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.032480] CPU topo: Max. threads per core: 1 lb # [ 0.002878] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033333] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.032480] CPU topo: Num. cores per package: 1 client # [ 0.032466] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.032481] CPU topo: Num. threads per package: 1 client # [ 0.032467] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.002880] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033335] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.032472] TSC deadline timer available worker2 # [ 0.032481] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.033336] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.032476] CPU topo: Max. logical packages: 1 lb # [ 0.002881] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.032498] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.033338] Booting paravirtualized kernel on KVM client # [ 0.032476] CPU topo: Max. logical dies: 1 client # [ 0.032477] CPU topo: Max. dies per package: 1 lb # [ 0.002883] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.032530] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.032480] CPU topo: Max. threads per core: 1 worker1 # [ 0.033340] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.002884] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.032481] CPU topo: Num. cores per package: 1 worker2 # [ 0.032532] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.037821] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.032481] CPU topo: Num. threads per package: 1 lb # [ 0.002885] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.032533] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.040305] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.032481] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.032535] Booting paravirtualized kernel on KVM lb # [ 0.002885] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.040349] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.032502] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.002886] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.032538] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.032539] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.002886] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.037022] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.032541] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.002887] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.039157] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.032542] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.039203] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.002887] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.032544] Booting paravirtualized kernel on KVM lb # [ 0.003127] No NUMA configuration found worker1 # [ 0.040350] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9l48jkcr6cdiqp8y6v9sxvagdw5w59l4-nixos-system-worker1-test/init regInfo=/nix/store/jjgcx7snicxga06ahrah0z8a6l3fgmhf-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.003127] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.032547] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.003130] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005374] Zone ranges: client # [ 0.037024] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.040442] Unknown kernel command line parameters "regInfo=/nix/store/jjgcx7snicxga06ahrah0z8a6l3fgmhf-closure-info/registration", will be passed to user space. worker1 # [ 0.040454] random: crng init done lb # [ 0.005375] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.039191] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.039205] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2r960cj2h4zwi2h592n0agq168cha874-nixos-system-worker2-test/init regInfo=/nix/store/7g0xk07bpn0vi477049b6nn9r1qix82k-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.005376] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.039238] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.040455] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.005377] Normal empty lb # [ 0.005378] Device empty worker1 # [ 0.042624] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.005379] Movable zone start for each node worker2 # [ 0.039300] Unknown kernel command line parameters "regInfo=/nix/store/7g0xk07bpn0vi477049b6nn9r1qix82k-closure-info/registration", will be passed to user space. lb # [ 0.005380] Early memory node ranges worker1 # [ 0.043706] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.039320] random: crng init done worker1 # [ 0.043743] Fallback order for Node 0: 0 lb # [ 0.005380] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.039320] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.005381] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.043746] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.043747] Policy zone: DMA32 client # [ 0.039240] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test/init regInfo=/nix/store/iayv2xqplqy5pxgnqa549zwg9kilmzp9-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.041443] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.005382] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.046258] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.005403] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.042676] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.049341] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.042708] Fallback order for Node 0: 0 lb # [ 0.005662] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.039345] Unknown kernel command line parameters "regInfo=/nix/store/iayv2xqplqy5pxgnqa549zwg9kilmzp9-closure-info/registration", will be passed to user space. worker1 # [ 0.053021] allocated 3145728 bytes of page_ext client # [ 0.039357] random: crng init done worker2 # [ 0.042711] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.031940] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.062727] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.042712] Policy zone: DMA32 lb # [ 0.032404] ACPI: PM-Timer IO Port: 0x608 client # [ 0.039358] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.062728] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.045189] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.063562] Dynamic Preempt: lazy lb # [ 0.032416] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.041477] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.063735] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.048428] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.032445] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.063736] rcu: RCU event tracing is enabled. worker2 # [ 0.051734] allocated 3145728 bytes of page_ext client # [ 0.042723] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.032448] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.061446] ftrace: allocating 48787 entries in 192 pages client # [ 0.042755] Fallback order for Node 0: 0 worker1 # [ 0.063737] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.032450] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.061448] ftrace: allocated 192 pages with 2 groups client # [ 0.042758] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.063738] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.062285] Dynamic Preempt: lazy client # [ 0.042760] Policy zone: DMA32 worker1 # [ 0.063739] Rude variant of Tasks RCU enabled. lb # [ 0.032451] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.062419] rcu: Preemptible hierarchical RCU implementation. client # [ 0.045263] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.063739] Tracing variant of Tasks RCU enabled. lb # [ 0.032452] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.062419] rcu: RCU event tracing is enabled. client # [ 0.048529] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.063739] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.032452] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.062420] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.051832] allocated 3145728 bytes of page_ext worker2 # [ 0.062422] Trampoline variant of Tasks RCU enabled. lb # [ 0.032455] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.063740] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.061651] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.062422] Rude variant of Tasks RCU enabled. lb # [ 0.032456] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.061652] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.063762] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.062422] Tracing variant of Tasks RCU enabled. lb # [ 0.032459] TSC deadline timer available client # [ 0.062498] Dynamic Preempt: lazy lb # [ 0.032463] CPU topo: Max. logical packages: 1 client # [ 0.062636] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.062423] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.063763] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.032464] CPU topo: Max. logical dies: 1 client # [ 0.062637] rcu: RCU event tracing is enabled. lb # [ 0.032464] CPU topo: Max. dies per package: 1 worker2 # [ 0.062424] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.062637] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.063764] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.032467] CPU topo: Max. threads per core: 1 worker2 # [ 0.062443] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.062639] Trampoline variant of Tasks RCU enabled. lb # [ 0.032468] CPU topo: Num. cores per package: 1 worker1 # [ 0.068180] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.032468] CPU topo: Num. threads per package: 1 client # [ 0.062640] Rude variant of Tasks RCU enabled. worker1 # [ 0.068448] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.062445] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.062640] Tracing variant of Tasks RCU enabled. lb # [ 0.032469] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.062641] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.062446] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.032487] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.068455] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.062641] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.067039] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.032521] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.068565] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.067357] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.072085] Console: colour VGA+ 80x25 client # [ 0.062656] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.032523] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.072088] printk: legacy console [tty0] enabled lb # [ 0.032524] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.067365] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.062658] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.101591] printk: legacy console [ttyS0] enabled lb # [ 0.032526] Booting paravirtualized kernel on KVM worker1 # [ 0.198634] ACPI: Core revision 20250807 worker2 # [ 0.067470] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.062659] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.070998] Console: colour VGA+ 80x25 lb # [ 0.032528] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.067022] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.071001] printk: legacy console [tty0] enabled worker1 # [ 0.199543] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.037004] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.067308] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.100571] printk: legacy console [ttyS0] enabled lb # [ 0.039157] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.201085] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.196090] ACPI: Core revision 20250807 client # [ 0.067316] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.039203] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.202032] x2apic enabled client # [ 0.067421] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.196983] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.202776] APIC: Switched APIC routing to: physical x2apic client # [ 0.071190] Console: colour VGA+ 80x25 client # [ 0.071194] printk: legacy console [tty0] enabled worker2 # [ 0.198484] APIC: Switch to symmetric I/O mode setup client # [ 0.100741] printk: legacy console [ttyS0] enabled worker2 # [ 0.199446] x2apic enabled worker1 # [ 0.204581] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.195831] ACPI: Core revision 20250807 worker2 # [ 0.200212] APIC: Switched APIC routing to: physical x2apic lb # [ 0.039204] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.205572] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.196742] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.039299] Unknown kernel command line parameters "regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration", will be passed to user space. worker2 # [ 0.202045] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.198288] APIC: Switch to symmetric I/O mode setup lb # [ 0.039311] random: crng init done worker1 # [ 0.207255] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.199262] x2apic enabled lb # [ 0.039311] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.208338] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.203010] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.200021] APIC: Switched APIC routing to: physical x2apic lb # [ 0.041408] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.209376] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.204636] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.042797] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.042828] Fallback order for Node 0: 0 worker1 # [ 0.210253] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.201812] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.205723] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.042831] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.042832] Policy zone: DMA32 worker2 # [ 0.206757] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.211257] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.045523] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.202770] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.207633] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.048735] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.213252] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.204391] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.052162] allocated 3145728 bytes of page_ext lb # [ 0.061784] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.214253] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.208637] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.205477] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.061786] ftrace: allocated 192 pages with 2 groups lb # [ 0.062693] Dynamic Preempt: lazy worker1 # [ 0.215252] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.206505] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.062867] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.209633] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.062868] rcu: RCU event tracing is enabled. worker1 # [ 0.216253] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.207388] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.210633] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.062869] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.062870] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.211633] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.062871] Rude variant of Tasks RCU enabled. client # [ 0.208392] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.212633] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.062871] Tracing variant of Tasks RCU enabled. client # [ 0.209389] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.062872] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.217252] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.062872] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.210388] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.219260] Spectre V2 : Enabling IBPB for BPF client # [ 0.211388] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.062887] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.220254] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.212388] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.213633] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.062888] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.221253] active return thunk: srso_alias_return_thunk worker2 # [ 0.215641] Spectre V2 : Enabling IBPB for BPF lb # [ 0.062889] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.067465] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.222273] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.216634] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.067740] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.217633] active return thunk: srso_alias_return_thunk worker1 # [ 0.223252] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.213388] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.067746] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.225001] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.218655] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.215395] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.225986] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.067848] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.219633] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.071375] Console: colour VGA+ 80x25 client # [ 0.216091] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.226997] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.071378] printk: legacy console [tty0] enabled worker2 # [ 0.220633] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.100840] printk: legacy console [ttyS0] enabled client # [ 0.217388] active return thunk: srso_alias_return_thunk worker1 # [ 0.228000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.221633] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.197274] ACPI: Core revision 20250807 client # [ 0.218410] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.222633] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.229038] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.219388] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.198207] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.223633] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.230253] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.220388] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.199681] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.231252] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.224633] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.200651] x2apic enabled client # [ 0.221388] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.232252] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.225633] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.201392] APIC: Switched APIC routing to: physical x2apic client # [ 0.222388] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.233252] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.226633] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.223388] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.234175] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.227633] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.203202] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.224388] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.228633] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.234983] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.225388] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.229633] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.204176] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.226388] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.205837] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.230633] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.227388] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.206921] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.228388] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.229388] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.207973] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.209563] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.230388] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.210640] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.211834] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.212834] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.213833] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.214834] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.215833] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.217842] Spectre V2 : Enabling IBPB for BPF lb # [ 0.218603] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.219834] active return thunk: srso_alias_return_thunk lb # [ 0.220854] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.221833] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.223643] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.224644] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.225654] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.226648] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.227833] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.228833] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.229833] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.230833] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.231833] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.232833] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.233833] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.270024] Freeing SMP alternatives memory: 44K worker1 # [ 0.270829] pid_max: default: 32768 minimum: 301 worker2 # [ 0.265766] Freeing SMP alternatives memory: 44K worker1 # [ 0.271344] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.266538] pid_max: default: 32768 minimum: 301 worker1 # [ 0.272350] landlock: Up and running. worker1 # [ 0.273253] Yama: becoming mindful. worker2 # [ 0.267257] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.274341] LSM support for eBPF active worker2 # [ 0.267755] landlock: Up and running. worker2 # [ 0.269058] Yama: becoming mindful. client # [ 0.265196] Freeing SMP alternatives memory: 44K worker1 # [ 0.275106] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.269838] LSM support for eBPF active client # [ 0.265933] pid_max: default: 32768 minimum: 301 worker1 # [ 0.276292] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.270664] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.266495] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.267494] landlock: Up and running. worker2 # [ 0.271673] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.268389] Yama: becoming mindful. worker1 # [ 0.278712] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.269395] LSM support for eBPF active client # [ 0.270163] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.274145] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.279822] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.280258] ... version: 2 client # [ 0.271416] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.280967] ... bit width: 48 worker2 # [ 0.275140] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.281255] ... generic counters: 6 worker2 # [ 0.275638] ... version: 2 worker2 # [ 0.276354] ... bit width: 48 worker1 # [ 0.281978] ... generic bitmap: 000000000000003f client # [ 0.273629] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.276635] ... generic counters: 6 worker1 # [ 0.282261] ... fixed-purpose counters: 0 worker2 # [ 0.277306] ... generic bitmap: 000000000000003f worker1 # [ 0.282965] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.274971] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.277683] ... fixed-purpose counters: 0 worker1 # [ 0.283255] ... value mask: 0000ffffffffffff client # [ 0.275398] ... version: 2 worker2 # [ 0.278392] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.284148] ... max period: 00007fffffffffff client # [ 0.276102] ... bit width: 48 worker2 # [ 0.278636] ... value mask: 0000ffffffffffff client # [ 0.276391] ... generic counters: 6 worker1 # [ 0.284928] ... global_ctrl mask: 000000000000003f worker2 # [ 0.279511] ... max period: 00007fffffffffff worker1 # [ 0.285351] signal: max sigframe size: 3376 client # [ 0.277094] ... generic bitmap: 000000000000003f worker2 # [ 0.280275] ... global_ctrl mask: 000000000000003f client # [ 0.277391] ... fixed-purpose counters: 0 worker1 # [ 0.286166] rcu: Hierarchical SRCU implementation. worker2 # [ 0.280750] signal: max sigframe size: 3376 client # [ 0.278050] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.286868] rcu: Max phase no-delay instances is 400. worker2 # [ 0.281536] rcu: Hierarchical SRCU implementation. client # [ 0.278391] ... value mask: 0000ffffffffffff worker2 # [ 0.282224] rcu: Max phase no-delay instances is 400. client # [ 0.279255] ... max period: 00007fffffffffff client # [ 0.280064] ... global_ctrl mask: 000000000000003f client # [ 0.280497] signal: max sigframe size: 3376 client # [ 0.281283] rcu: Hierarchical SRCU implementation. client # [ 0.281987] rcu: Max phase no-delay instances is 400. worker1 # [ 0.291790] smp: Bringing up secondary CPUs ... worker1 # [ 0.292269] smp: Brought up 1 node, 1 CPU worker2 # [ 0.287232] smp: Bringing up secondary CPUs ... worker1 # [ 0.292968] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.287649] smp: Brought up 1 node, 1 CPU worker2 # [ 0.288363] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.293426] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) worker1 # [ 0.294472] devtmpfs: initialized client # [ 0.287050] smp: Bringing up secondary CPUs ... worker2 # [ 0.288864] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) client # [ 0.287406] smp: Brought up 1 node, 1 CPU worker1 # [ 0.295197] x86/mm: Memory block size: 128MB worker2 # [ 0.289929] devtmpfs: initialized client # [ 0.288077] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.268703] Freeing SMP alternatives memory: 44K worker2 # [ 0.290731] x86/mm: Memory block size: 128MB lb # [ 0.269410] pid_max: default: 32768 minimum: 301 worker1 # [ 0.296853] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.269927] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.288593] Memory: 1454632K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker1 # [ 0.297279] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.270937] landlock: Up and running. worker2 # [ 0.292510] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.289680] devtmpfs: initialized lb # [ 0.271834] Yama: becoming mindful. worker1 # [ 0.298342] pinctrl core: initialized pinctrl subsystem client # [ 0.290492] x86/mm: Memory block size: 128MB worker2 # [ 0.293535] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.272910] LSM support for eBPF active worker1 # [ 0.299441] PM: RTC time: 11:32:18, date: 2026-09-22 worker2 # [ 0.294724] pinctrl core: initialized pinctrl subsystem lb # [ 0.273652] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.295839] PM: RTC time: 11:32:18, date: 2026-09-22 client # [ 0.292238] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.274878] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.293262] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.294472] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.303383] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.277200] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.295601] PM: RTC time: 11:32:18, date: 2026-09-22 worker2 # [ 0.299397] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.304755] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.278391] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.300130] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.305277] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.278842] ... version: 2 lb # [ 0.279526] ... bit width: 48 worker2 # [ 0.300660] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.279836] ... generic counters: 6 worker1 # [ 0.306547] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.299075] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.280518] ... generic bitmap: 000000000000003f worker1 # [ 0.307265] audit: initializing netlink subsys (disabled) worker2 # [ 0.301926] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.280836] ... fixed-purpose counters: 0 client # [ 0.299879] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.302647] audit: initializing netlink subsys (disabled) worker1 # [ 0.308414] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.281533] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.300418] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.308416] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.281835] ... value mask: 0000ffffffffffff worker2 # [ 0.303638] audit: type=2000 audit(1790076739.377:1): state=initialized audit_enabled=0 res=1 lb # [ 0.282673] ... max period: 00007fffffffffff worker1 # [ 0.309256] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.301666] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.304773] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.283482] ... global_ctrl mask: 000000000000003f worker1 # [ 0.310179] thermal_sys: Registered thermal governor 'user_space' client # [ 0.302401] audit: initializing netlink subsys (disabled) worker2 # [ 0.304775] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.283931] signal: max sigframe size: 3376 worker1 # [ 0.310980] audit: type=2000 audit(1790076739.375:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.305636] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.284704] rcu: Hierarchical SRCU implementation. client # [ 0.303637] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.312258] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.285396] rcu: Max phase no-delay instances is 400. worker2 # [ 0.306561] thermal_sys: Registered thermal governor 'user_space' client # [ 0.303640] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.312273] cpuidle: using governor menu client # [ 0.304392] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.307342] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.307649] cpuidle: using governor menu client # [ 0.305288] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.314285] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.309844] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.306116] audit: type=2000 audit(1790076739.382:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.315489] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.307393] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.316258] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.310923] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.307408] cpuidle: using governor menu lb # [ 0.290380] smp: Bringing up secondary CPUs ... worker1 # [ 0.317266] PCI: Using configuration type 1 for base access worker2 # [ 0.311638] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.290850] smp: Brought up 1 node, 1 CPU client # [ 0.309618] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.312647] PCI: Using configuration type 1 for base access lb # [ 0.291524] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.318355] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.310670] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.313732] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.311394] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.292019] Memory: 1454588K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) client # [ 0.312402] PCI: Using configuration type 1 for base access lb # [ 0.293136] devtmpfs: initialized lb # [ 0.293942] x86/mm: Memory block size: 128MB client # [ 0.313467] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.295758] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.325399] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.296767] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.326256] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.320650] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.297912] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.321636] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.299026] PM: RTC time: 11:32:18, date: 2026-09-22 client # [ 0.318476] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.319391] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.302536] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.331256] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.326637] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.332256] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.303318] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.327636] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.324391] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.303860] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.325390] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.305109] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.305846] audit: initializing netlink subsys (disabled) lb # [ 0.307063] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.307065] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.307841] audit: type=2000 audit(1790076739.409:1): state=initialized audit_enabled=0 res=1 lb # [ 0.309838] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.309839] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.342678] ACPI: Added _OSI(Module Device) worker1 # [ 0.343257] ACPI: Added _OSI(Processor Device) lb # [ 0.310835] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.311847] cpuidle: using governor menu worker1 # [ 0.343989] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.338904] ACPI: Added _OSI(Module Device) client # [ 0.335760] ACPI: Added _OSI(Module Device) worker2 # [ 0.339637] ACPI: Added _OSI(Processor Device) client # [ 0.336392] ACPI: Added _OSI(Processor Device) lb # [ 0.314050] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.340345] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.337118] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.315055] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.315839] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.316848] PCI: Using configuration type 1 for base access lb # [ 0.317980] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.350835] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.345974] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.345454] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.354663] ACPI: Interpreter enabled lb # [ 0.322950] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.350037] ACPI: Interpreter enabled worker1 # [ 0.355271] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.350650] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.355970] ACPI: Using IOAPIC for interrupt routing lb # [ 0.323837] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.351335] ACPI: Using IOAPIC for interrupt routing client # [ 0.349790] ACPI: Interpreter enabled client # [ 0.350405] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.358318] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.351110] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.353702] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.359256] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.354637] PCI: Using E820 reservations for host bridge windows lb # [ 0.328837] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.329836] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.353439] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.362349] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.357724] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.354391] PCI: Using E820 reservations for host bridge windows client # [ 0.357462] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.369312] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.365130] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.370260] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.340181] ACPI: Added _OSI(Module Device) worker2 # [ 0.365641] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.340837] ACPI: Added _OSI(Processor Device) worker1 # [ 0.371332] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.341591] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.366713] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.372378] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.364954] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.367757] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.373594] PCI host bridge to bus 0000:00 client # [ 0.365403] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.368996] PCI host bridge to bus 0000:00 worker1 # [ 0.374259] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.366469] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.369641] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.375255] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.367513] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.370636] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.376255] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.368775] PCI host bridge to bus 0000:00 worker2 # [ 0.371636] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.377256] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.369395] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.372635] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.378255] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.370391] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.373635] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.379255] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.371391] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.349899] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.374635] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.380255] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.372391] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.375649] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.381276] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.373391] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.376675] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.374391] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.382706] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.354240] ACPI: Interpreter enabled client # [ 0.375391] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.378100] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.354851] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.355596] ACPI: Using IOAPIC for interrupt routing client # [ 0.376362] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.377792] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.357879] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.358837] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.385319] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.380789] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.361962] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.386267] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.381648] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.382576] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.387234] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.380481] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.383568] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.388609] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.381403] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.382349] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.389974] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.385410] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.383625] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.369488] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.392275] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.388673] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.385119] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.393122] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.369843] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.389482] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.393968] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.370915] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.390330] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.394261] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.390649] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.371967] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.388425] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.373180] PCI host bridge to bus 0000:00 client # [ 0.389360] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.396027] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.392329] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.373840] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.390112] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.374836] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.390396] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.398274] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.375836] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.394673] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.399187] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.392318] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.376836] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.395491] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.399980] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.396325] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.377836] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.400803] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.378836] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.394423] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.397204] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.379836] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.395257] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.396124] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.380813] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.396976] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.382290] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.403263] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.399831] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.404261] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.400642] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.405276] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.401596] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.406806] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.399399] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.403029] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.400995] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.408274] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.401412] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.409120] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.404652] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.402961] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.405470] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.410027] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.384972] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.411052] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.406359] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.385971] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.406641] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.404421] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.386860] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.413035] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.405309] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.408176] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.406130] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.388203] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.415089] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.406397] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.415999] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.409678] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.389571] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.410627] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.416813] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.408704] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.412065] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.392874] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.410428] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.418269] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.393738] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.411396] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.419203] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.413678] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.394564] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.394841] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.414621] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.412972] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.421063] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.396853] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.416254] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.414427] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.423203] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.424003] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.417655] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.415395] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.398871] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.418612] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.399709] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.424813] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.416927] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.400549] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.419985] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.426277] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.418397] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.401409] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.427277] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.421649] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.419344] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.422600] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.420750] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.429292] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.424203] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.403844] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.422429] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.431263] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.405485] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.432089] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.423365] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.425655] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.405858] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.432994] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.426457] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.424953] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.407380] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.427382] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.433804] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.428224] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.426429] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.408844] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.427251] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.409677] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.435275] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.428114] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.436262] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.410628] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.429866] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.437175] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.411685] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.428960] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.430642] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.431640] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.438599] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.413391] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.439793] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.433194] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.430419] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.414849] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.440458] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.432072] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.434356] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.415811] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.432412] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.441791] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.434832] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.442469] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.417310] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.434001] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.436250] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.435124] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.444283] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.418849] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.436837] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.435621] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.438307] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.419776] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.437054] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.421397] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.437589] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.422849] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.439059] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.423858] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.425441] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.426881] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.445347] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.427858] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.447780] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.438900] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.429407] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.448529] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.441327] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.449554] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.430880] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.431786] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.441991] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.450502] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.439689] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.432532] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.442922] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.452276] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.442071] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.433373] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.453128] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.443881] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.442627] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.454261] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.445652] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.443700] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.435778] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.455795] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.446546] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.436482] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.444638] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.447695] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.436858] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.449236] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.446391] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.459233] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.438391] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.447249] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.460052] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.439485] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.448397] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.461123] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.440046] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.462094] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.450045] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.453146] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.463052] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.453741] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.441514] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.464086] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.454733] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.465094] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.442033] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.455735] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.466072] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.453935] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.456733] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.443503] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.467016] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.454494] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.457732] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.467271] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.455490] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.458734] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.468226] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.456487] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.459734] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.468987] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.457487] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.469269] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.460683] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.458489] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.470267] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.461652] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.459490] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.471205] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.462649] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.460491] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.471978] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.463649] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.461428] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.464623] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.473261] iommu: Default domain type: Translated client # [ 0.462366] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.465340] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.474029] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.463229] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.465647] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.474538] ACPI: bus type USB registered client # [ 0.464146] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.466594] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.475245] usbcore: registered new interface driver usbfs client # [ 0.464404] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.475929] usbcore: registered new interface driver hub client # [ 0.465354] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.444090] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.468444] iommu: Default domain type: Translated worker1 # [ 0.476264] usbcore: registered new device driver usb client # [ 0.466100] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.469228] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.446481] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.466406] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.477890] NetLabel: Initializing worker2 # [ 0.469898] ACPI: bus type USB registered worker1 # [ 0.478256] NetLabel: domain hash size = 128 worker2 # [ 0.470656] usbcore: registered new interface driver usbfs lb # [ 0.447070] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.479036] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.468475] iommu: Default domain type: Translated worker2 # [ 0.471547] usbcore: registered new interface driver hub worker1 # [ 0.479295] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.472305] usbcore: registered new device driver usb client # [ 0.469254] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.448136] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.480172] PCI: Using ACPI for IRQ routing client # [ 0.470363] ACPI: bus type USB registered worker2 # [ 0.473476] NetLabel: Initializing client # [ 0.470937] usbcore: registered new interface driver usbfs lb # [ 0.449108] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.474037] NetLabel: domain hash size = 128 client # [ 0.471405] usbcore: registered new interface driver hub worker2 # [ 0.474635] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.472221] usbcore: registered new device driver usb lb # [ 0.450813] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.475657] NetLabel: unlabeled traffic allowed by default lb # [ 0.451564] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.476578] PCI: Using ACPI for IRQ routing client # [ 0.473854] NetLabel: Initializing client # [ 0.474391] NetLabel: domain hash size = 128 lb # [ 0.452150] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.475081] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.475429] NetLabel: unlabeled traffic allowed by default lb # [ 0.453489] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.476302] PCI: Using ACPI for IRQ routing lb # [ 0.457483] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.457951] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.458966] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.459933] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.460933] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.461936] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.462957] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.463932] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.464874] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.465853] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.466856] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.467852] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.468849] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.469851] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.470847] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.471847] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.473896] iommu: Default domain type: Translated lb # [ 0.474726] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.475913] ACPI: bus type USB registered lb # [ 0.476690] usbcore: registered new interface driver usbfs lb # [ 0.477558] usbcore: registered new interface driver hub lb # [ 0.477845] usbcore: registered new device driver usb lb # [ 0.479712] NetLabel: Initializing lb # [ 0.480284] NetLabel: domain hash size = 128 lb # [ 0.480836] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.481854] NetLabel: unlabeled traffic allowed by default lb # [ 0.482824] PCI: Using ACPI for IRQ routing worker1 # [ 0.523745] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.524251] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.524251] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.524259] vgaarb: loaded worker1 # [ 0.525003] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.520989] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.525257] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.521632] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.521632] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.519251] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.521641] vgaarb: loaded client # [ 0.519387] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.522390] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.528340] clocksource: Switched to clocksource kvm-clock client # [ 0.519387] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.522636] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.519395] vgaarb: loaded client # [ 0.520107] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.520391] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.531806] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.532499] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.533882] pnp: PnP ACPI init worker2 # [ 0.526726] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.534683] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.523473] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.535614] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.530288] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.537201] pnp: PnP ACPI: found 5 devices client # [ 0.526930] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.530952] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.532331] pnp: PnP ACPI init client # [ 0.527602] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.528883] pnp: PnP ACPI init worker2 # [ 0.533060] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.529650] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.534022] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.535507] pnp: PnP ACPI: found 5 devices client # [ 0.530579] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.532059] pnp: PnP ACPI: found 5 devices worker1 # [ 0.544790] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.546316] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.547320] NET: Registered PF_INET protocol family worker1 # [ 0.548518] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.543085] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.544505] clocksource: Switched to clocksource acpi_pm client # [ 0.539655] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.545476] NET: Registered PF_INET protocol family client # [ 0.541032] clocksource: Switched to clocksource acpi_pm client # [ 0.541971] NET: Registered PF_INET protocol family worker2 # [ 0.546626] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.543146] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.526511] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.526832] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.526832] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.526840] vgaarb: loaded lb # [ 0.527632] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.528502] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.565270] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.566861] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.568208] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.531920] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.569589] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.563412] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.570856] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.559797] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.564914] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.571974] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.535505] VFS: Disk quotas dquot_6.6.0 client # [ 0.561282] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.573214] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.566179] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.536463] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.562519] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.574253] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.567504] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.537784] pnp: PnP ACPI init worker1 # [ 0.575396] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.563801] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.568706] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.538596] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.576325] NET: Registered PF_XDP protocol family client # [ 0.564991] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.569790] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.577144] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.539543] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.566103] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.571000] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.578108] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.541037] pnp: PnP ACPI: found 5 devices client # [ 0.567301] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.579058] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.572052] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.568346] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.573222] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.580134] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.569495] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.574149] NET: Registered PF_XDP protocol family worker1 # [ 0.581229] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.570450] NET: Registered PF_XDP protocol family worker2 # [ 0.574983] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.582333] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.571269] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.576012] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.572236] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.584013] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.577025] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.573204] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.578094] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.574256] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.579141] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.586492] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.575305] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.549023] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.580170] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.550481] clocksource: Switched to clocksource acpi_pm client # [ 0.576344] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.588380] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.581808] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.551477] NET: Registered PF_INET protocol family client # [ 0.577968] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.590298] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.552779] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.584021] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.580207] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.591938] PCI: CLS 0 bytes, default 64 worker2 # [ 0.586015] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.592760] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.582481] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.594504] Trying to unpack rootfs image as initramfs... worker2 # [ 0.587976] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.584468] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.589649] PCI: CLS 0 bytes, default 64 client # [ 0.586248] PCI: CLS 0 bytes, default 64 worker2 # [ 0.590587] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.587197] Trying to unpack rootfs image as initramfs... worker2 # [ 0.592258] Trying to unpack rootfs image as initramfs... client # [ 0.593263] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.569516] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.571029] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.572342] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.573773] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.574995] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.576108] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.577335] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.578407] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.579605] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.580542] NET: Registered PF_XDP protocol family lb # [ 0.581380] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.582365] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.583369] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.584436] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.585528] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.586603] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.588333] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.590718] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.593119] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.595161] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.596839] PCI: CLS 0 bytes, default 64 lb # [ 0.597797] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.599506] Trying to unpack rootfs image as initramfs... worker1 # [ 0.637239] Initialise system trusted keyrings worker1 # [ 0.639875] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.634451] Initialise system trusted keyrings worker2 # [ 0.637343] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.634921] Initialise system trusted keyrings client # [ 0.638154] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.662159] Key type asymmetric registered worker1 # [ 0.664832] Asymmetric key parser 'x509' registered worker2 # [ 0.658537] Key type asymmetric registered worker1 # [ 0.665684] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.659232] Asymmetric key parser 'x509' registered worker2 # [ 0.660066] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.657369] Key type asymmetric registered worker1 # [ 0.668960] io scheduler mq-deadline registered worker1 # [ 0.669732] io scheduler kyber registered client # [ 0.660104] Asymmetric key parser 'x509' registered worker2 # [ 0.665400] io scheduler mq-deadline registered worker1 # [ 0.672390] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.660972] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.666110] io scheduler kyber registered worker1 # [ 0.673633] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.664205] io scheduler mq-deadline registered worker2 # [ 0.668833] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.664989] io scheduler kyber registered worker2 # [ 0.670058] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.679222] Linux agpgart interface v0.103 worker1 # [ 0.679999] ACPI: bus type drm_connector registered lb # [ 0.643246] Initialise system trusted keyrings client # [ 0.669114] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.670375] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.675440] Linux agpgart interface v0.103 worker2 # [ 0.676151] ACPI: bus type drm_connector registered worker1 # [ 0.683236] usbcore: registered new interface driver usbserial_generic lb # [ 0.646155] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.684307] usbserial: USB Serial support registered for generic worker2 # [ 0.678420] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.679473] usbserial: USB Serial support registered for generic client # [ 0.675922] Linux agpgart interface v0.103 client # [ 0.676707] ACPI: bus type drm_connector registered worker1 # [ 0.687837] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.687837] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.682303] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.690077] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.682303] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.684468] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.681227] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.692963] drop_monitor: Initializing network drop monitor service client # [ 0.682334] usbserial: USB Serial support registered for generic worker1 # [ 0.694148] NET: Registered PF_INET6 protocol family worker2 # [ 0.689465] drop_monitor: Initializing network drop monitor service worker1 # [ 0.697320] Segment Routing with IPv6 client # [ 0.685104] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.690605] NET: Registered PF_INET6 protocol family client # [ 0.685104] Please enable it if your BIOS has the CPPC option. client # [ 0.687310] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.692720] Segment Routing with IPv6 worker1 # [ 0.699887] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.700936] IPI shorthand broadcast: enabled client # [ 0.690306] drop_monitor: Initializing network drop monitor service worker2 # [ 0.695311] In-situ OAM (IOAM) with IPv6 client # [ 0.691526] NET: Registered PF_INET6 protocol family worker2 # [ 0.696393] IPI shorthand broadcast: enabled lb # [ 0.669214] Key type asymmetric registered lb # [ 0.669931] Asymmetric key parser 'x509' registered client # [ 0.696570] Segment Routing with IPv6 client # [ 0.697264] In-situ OAM (IOAM) with IPv6 lb # [ 0.670791] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.708298] sched_clock: Marking stable (573013842, 134796566)->(778202339, -70391931) client # [ 0.700398] IPI shorthand broadcast: enabled lb # [ 0.674261] io scheduler mq-deadline registered worker2 # [ 0.704694] sched_clock: Marking stable (571014599, 133267684)->(776485177, -72202894) lb # [ 0.675271] io scheduler kyber registered worker1 # [ 0.715055] registered taskstats version 1 worker2 # [ 0.708403] registered taskstats version 1 worker1 # [ 0.716047] Loading compiled-in X.509 certificates worker2 # [ 0.709321] Loading compiled-in X.509 certificates lb # [ 0.679296] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.680642] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.708747] sched_clock: Marking stable (575014565, 133071445)->(780693846, -72607836) lb # [ 0.685867] Linux agpgart interface v0.103 client # [ 0.712176] registered taskstats version 1 lb # [ 0.686676] ACPI: bus type drm_connector registered client # [ 0.713165] Loading compiled-in X.509 certificates lb # [ 0.689851] usbcore: registered new interface driver usbserial_generic lb # [ 0.690975] usbserial: USB Serial support registered for generic worker1 # [ 0.732380] Demotion targets for Node 0: null lb # [ 0.695120] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.695120] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.728296] Demotion targets for Node 0: null lb # [ 0.697423] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.735859] Key type .fscrypt registered worker2 # [ 0.729129] Key type .fscrypt registered worker1 # [ 0.736522] Key type fscrypt-provisioning registered worker1 # [ 0.737482] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.700267] drop_monitor: Initializing network drop monitor service lb # [ 0.701496] NET: Registered PF_INET6 protocol family worker2 # [ 0.732288] Key type fscrypt-provisioning registered worker1 # [ 0.739827] ima: Allocated hash algorithm: sha1 worker2 # [ 0.733172] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.740605] ima: No architecture policies found worker2 # [ 0.734033] ima: Allocated hash algorithm: sha1 worker1 # [ 0.742823] PM: Magic number: 10:316:530 worker2 # [ 0.736315] ima: No architecture policies found client # [ 0.732104] Demotion targets for Node 0: null lb # [ 0.706560] Segment Routing with IPv6 worker2 # [ 0.737224] PM: Magic number: 10:316:530 client # [ 0.732977] Key type .fscrypt registered worker1 # [ 0.744424] RAS: Correctable Errors collector initialized. lb # [ 0.707248] In-situ OAM (IOAM) with IPv6 client # [ 0.736091] Key type fscrypt-provisioning registered lb # [ 0.710394] IPI shorthand broadcast: enabled worker2 # [ 0.740903] RAS: Correctable Errors collector initialized. client # [ 0.736998] ima: No TPM chip found, activating TPM-bypass! client # [ 0.737922] ima: Allocated hash algorithm: sha1 client # [ 0.740118] ima: No architecture policies found client # [ 0.741119] PM: Magic number: 10:316:530 worker1 # [ 0.753435] clk: Disabling unused clocks client # [ 0.742800] RAS: Correctable Errors collector initialized. worker2 # [ 0.749607] clk: Disabling unused clocks lb # [ 0.718771] sched_clock: Marking stable (584015367, 134086659)->(792552057, -74450031) worker1 # [ 0.756829] PM: genpd: Disabling unused power domains worker2 # [ 0.752306] PM: genpd: Disabling unused power domains lb # [ 0.722292] registered taskstats version 1 lb # [ 0.723265] Loading compiled-in X.509 certificates client # [ 0.752797] clk: Disabling unused clocks client # [ 0.755106] PM: genpd: Disabling unused power domains lb # [ 0.739726] Demotion targets for Node 0: null lb # [ 0.743149] Key type .fscrypt registered lb # [ 0.743837] Key type fscrypt-provisioning registered lb # [ 0.744827] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.747113] ima: Allocated hash algorithm: sha1 lb # [ 0.747921] ima: No architecture policies found lb # [ 0.752112] PM: Magic number: 10:316:530 lb # [ 0.753767] RAS: Correctable Errors collector initialized. lb # [ 0.762819] clk: Disabling unused clocks lb # [ 0.765115] PM: genpd: Disabling unused power domains worker2 # [ 0.919825] Freeing initrd memory: 29060K worker1 # [ 0.928001] Freeing initrd memory: 29056K client # [ 0.918266] Freeing initrd memory: 29056K worker2 # [ 0.923002] Freeing unused decrypted memory: 2028K worker1 # [ 0.931219] Freeing unused decrypted memory: 2028K worker2 # [ 0.925595] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.921477] Freeing unused decrypted memory: 2028K worker2 # [ 0.926664] Write protecting the kernel read-only data: 32768k worker1 # [ 0.933903] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.934992] Write protecting the kernel read-only data: 32768k client # [ 0.924035] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.928478] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.925108] Write protecting the kernel read-only data: 32768k worker1 # [ 0.936861] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.929931] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.938339] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.926936] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.928473] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.934138] Freeing initrd memory: 29064K lb # [ 0.937317] Freeing unused decrypted memory: 2028K lb # [ 0.939921] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.941054] Write protecting the kernel read-only data: 32768k lb # [ 0.942978] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.944529] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.980545] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.981588] Run /init as init process worker1 # [ 0.989162] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.990238] Run /init as init process client # [ 0.979478] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.980828] Run /init as init process worker2 # [ 0.992669] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.000884] systemd[1]: Inserted module 'autofs4' client # [ 0.991898] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.012478] fuse: init (API version 7.45) worker1 # [ 1.020714] fuse: init (API version 7.45) client # [ 1.011950] fuse: init (API version 7.45) worker2 # [ 1.019834] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.028123] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.022253] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.030730] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.019350] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.025633] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.021732] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 0.995526] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.996633] Run /init as init process worker1 # [ 1.034785] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.027956] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.025142] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.037106] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.027532] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.033781] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.035388] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.042494] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.044239] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.007509] systemd[1]: Inserted module 'autofs4' client # [ 1.033518] virtiofs virtio5: discovered new tag: nix-store client # [ 1.035219] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.042872] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.051347] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.044443] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.053018] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.047834] virtiofs virtio7: discovered new tag: xchg client # [ 1.043818] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.049321] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.056626] virtiofs virtio7: discovered new tag: xchg client # [ 1.045376] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.058113] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.049036] virtiofs virtio7: discovered new tag: xchg client # [ 1.050504] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.027280] fuse: init (API version 7.45) lb # [ 1.034638] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.037192] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.040177] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.071414] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.042170] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.081997] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.047296] virtiofs virtio5: discovered new tag: nix-store client # [ 1.074153] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.048913] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.055298] virtiofs virtio6: discovered new tag: shared lb # [ 1.056816] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.060205] virtiofs virtio7: discovered new tag: xchg lb # [ 1.061732] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.080880] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.406976] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.412065] systemd[1]: Detected virtualization kvm. worker2 # [ 1.412923] systemd[1]: Detected architecture x86-64. worker2 # [ 1.413794] systemd[1]: Running in initrd. worker1 # [ 1.417698] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.414969] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.422756] systemd[1]: Detected virtualization kvm. worker2 # [ 1.416160] systemd[1]: Hostname set to . worker1 # [ 1.423597] systemd[1]: Detected architecture x86-64. worker1 # [ 1.424472] systemd[1]: Running in initrd. worker1 # [ 1.425648] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.426939] systemd[1]: Hostname set to . client # [ 1.410922] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.423142] systemd[1]: Detected virtualization kvm. client # [ 1.425276] systemd[1]: Detected architecture x86-64. client # [ 1.427367] systemd[1]: Running in initrd. client # [ 1.429815] systemd[1]: Initializing machine ID from random generator. client # [ 1.432627] systemd[1]: Hostname set to . lb # [ 1.416479] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.421421] systemd[1]: Detected virtualization kvm. lb # [ 1.422269] systemd[1]: Detected architecture x86-64. lb # [ 1.423073] systemd[1]: Running in initrd. lb # [ 1.424128] systemd[1]: Initializing machine ID from random generator. lb # [ 1.425341] systemd[1]: Hostname set to . worker1 # [ 1.622674] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.625778] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.643899] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.620579] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.662519] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.667246] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.668483] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.669881] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.670961] systemd[1]: Reached target Path Units. worker1 # [ 1.671873] systemd[1]: Reached target Slice Units. worker1 # [ 1.672693] systemd[1]: Reached target Swaps. worker1 # [ 1.673461] systemd[1]: Reached target Timer Units. worker1 # [ 1.674433] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.675622] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.676726] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.677689] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.678655] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.679642] systemd[1]: Reached target Socket Units. worker1 # [ 1.681554] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.685883] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.680067] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.684674] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.685902] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.687379] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.683285] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.688508] systemd[1]: Reached target Path Units. lb # [ 1.658354] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.689420] systemd[1]: Reached target Slice Units. worker2 # [ 1.690258] systemd[1]: Reached target Swaps. worker2 # [ 1.691057] systemd[1]: Reached target Timer Units. client # [ 1.687435] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.692081] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.662409] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.693308] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.688606] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.694403] systemd[1]: Listening on Journal Sockets. lb # [ 1.663647] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.690011] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.695409] systemd[1]: Listening on udev Control Socket. client # [ 1.691125] systemd[1]: Reached target Path Units. lb # [ 1.665061] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.696419] systemd[1]: Listening on udev Kernel Socket. client # [ 1.691994] systemd[1]: Reached target Slice Units. lb # [ 1.666135] systemd[1]: Reached target Path Units. client # [ 1.692874] systemd[1]: Reached target Swaps. worker2 # [ 1.697338] systemd[1]: Reached target Socket Units. lb # [ 1.666942] systemd[1]: Reached target Slice Units. client # [ 1.693626] systemd[1]: Reached target Timer Units. lb # [ 1.667822] systemd[1]: Reached target Swaps. lb # [ 1.668640] systemd[1]: Reached target Timer Units. worker2 # [ 1.699143] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.694697] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.695325] systemd[1]: Starting Journal Service... lb # [ 1.669600] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.695900] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.670794] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.697048] systemd[1]: Listening on Journal Sockets. lb # [ 1.671981] systemd[1]: Listening on Journal Sockets. client # [ 1.698058] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.703354] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.672987] systemd[1]: Listening on udev Control Socket. client # [ 1.699109] systemd[1]: Listening on udev Kernel Socket. client # [ 1.700100] systemd[1]: Reached target Socket Units. lb # [ 1.674001] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.675034] systemd[1]: Reached target Socket Units. client # [ 1.701988] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.676851] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.706023] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.682183] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.721990] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.725915] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.714356] systemd[1]: Starting Journal Service... worker1 # [ 1.732993] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.715748] systemd[1]: Starting Journal Service... lb # [ 1.690696] systemd[1]: Starting Journal Service... worker1 # [ 1.744689] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.737933] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.747953] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.742420] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.742275] systemd[1]: Starting Load Kernel Modules... lb # [ 1.716294] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.755497] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.720208] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.746203] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.751539] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.761259] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.753154] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.728285] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.767262] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.762854] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.764560] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.739407] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.765656] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.741189] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.778885] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.772435] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.769436] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.776685] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.773278] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.747510] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.781699] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.780484] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.754511] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.791232] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.786528] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.760515] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.799848] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.794353] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.771164] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.798185] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.806415] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.780641] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.809525] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.814564] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.822440] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.789134] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.819122] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.831019] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.842880] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.835486] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.812676] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.844571] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.853542] systemd[1]: Starting Apply Kernel Variables... client # [ 1.842711] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.821314] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.852316] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.858362] systemd[1]: Finished Load Kernel Modules. lb # [ 1.832162] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.869994] systemd[1]: Started Journal Service. worker1 # [ 1.737057] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 1.738380] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.740256] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.868386] systemd[1]: Starting Apply Kernel Variables... client # [ 1.864207] systemd[1]: Finished Load Kernel Modules. lb # [ 1.841333] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.747125] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.873174] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.752912] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.757080] systemd[1]: Reached target Local File Systems. worker1 # [ 1.759069] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.886875] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.755148] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.859199] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.758291] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.763993] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.887897] systemd[1]: Started Journal Service. worker2 # [ 1.760324] systemd-modules-load[67]: Inserted module 'virtio_gpu' client # [ 1.755852] systemd-modules-load[68]: Inserted module 'dm_mod' lb # [ 1.727569] systemd-modules-load[68]: Inserted module 'dm_mod' lb # [ 1.730252] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.895155] systemd[1]: Started Journal Service. client # [ 1.758235] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 1.731291] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.769155] systemd[1]: Finished Apply Kernel Variables. client # [ 1.759891] systemd-modules-load[68]: Inserted module 'virtio_gpu' lb # [ 1.868013] systemd[1]: Started Journal Service. client # [ 1.766985] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.771740] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.774769] systemd[1]: Reached target Local File Systems. lb # [ 1.743678] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.775941] systemd[1]: Starting Create System Files and Directories... lb # [ 1.745745] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.748750] systemd[1]: Reached target Local File Systems. client # [ 1.776201] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.780903] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.777276] systemd[1]: Reached target Local File Systems. lb # [ 1.752087] systemd[1]: Starting Create System Files and Directories... client # [ 1.780067] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.790496] systemd[1]: Finished Create System Files and Directories. lb # [ 1.757344] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.784921] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.789776] systemd[1]: Finished Apply Kernel Variables. client # [ 1.790171] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.809391] systemd[1]: Finished Create System Files and Directories. lb # [ 1.781102] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.819297] systemd-udevd[80]: Using default interface naming scheme 'v261'. client # [ 1.817084] systemd[1]: Finished Create System Files and Directories. lb # [ 1.801978] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker1 # [ 1.841347] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.836279] systemd-udevd[80]: Using default interface naming scheme 'v261'. client # [ 1.836631] systemd-udevd[81]: Using default interface naming scheme 'v261'. lb # [ 1.826141] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.860068] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.861069] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.898090] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.898951] systemd[1]: Reached target System Initialization. worker1 # [ 1.899810] systemd[1]: Reached target Basic System. lb # [ 1.877219] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.879536] systemd[1]: Reached target System Initialization. lb # [ 1.880435] systemd[1]: Reached target Basic System. worker2 # [ 1.914099] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.914940] systemd[1]: Reached target System Initialization. worker2 # [ 1.915921] systemd[1]: Reached target Basic System. client # [ 1.916732] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.919132] systemd[1]: Reached target System Initialization. client # [ 1.920085] systemd[1]: Reached target Basic System. worker1 # [ 2.227734] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.230947] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.229759] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.199714] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.243449] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.244317] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.237489] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.207422] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.246235] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.248537] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.239312] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.214319] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.241023] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.253836] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.255178] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.256304] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.221039] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.258658] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.221777] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.260046] usb usb1: Product: EHCI Host Controller worker1 # [ 2.260742] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.255669] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.263429] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.264923] hub 1-0:1.0: USB hub found client # [ 2.253538] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.267812] hub 1-0:1.0: 6 ports detected lb # [ 2.230961] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.269440] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.231829] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.233579] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.264144] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.260057] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.265058] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.260903] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.266835] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.262851] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.275659] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.276426] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.270922] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.241128] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.268810] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.269574] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.244161] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.275387] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.245332] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.271698] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.276635] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.272841] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.277751] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.249015] usb usb1: Product: EHCI Host Controller client # [ 2.275836] usb usb1: Product: EHCI Host Controller lb # [ 2.249868] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.281400] usb usb1: Product: EHCI Host Controller worker2 # [ 2.282060] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.251662] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.278088] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.278829] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.283385] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.290760] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.284194] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.254341] hub 1-0:1.0: USB hub found worker1 # [ 2.292082] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.255001] hub 1-0:1.0: 6 ports detected client # [ 2.281278] hub 1-0:1.0: USB hub found worker2 # [ 2.285843] hub 1-0:1.0: USB hub found client # [ 2.281877] hub 1-0:1.0: 6 ports detected worker2 # [ 2.287055] hub 1-0:1.0: 6 ports detected client # [ 2.283530] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.261117] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.261815] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.302182] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.296866] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.272500] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.273339] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.300544] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.311825] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.301284] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.307200] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.322334] usb usb2: Product: UHCI Host Controller worker2 # [ 2.318437] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.319230] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.288530] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.315995] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.329950] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.330695] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.319425] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.296327] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.329998] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.338682] SCSI subsystem initialized worker2 # [ 2.332029] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.204825] systemd[1]: Starting Virtual Console Setup... lb # [ 2.303130] SCSI subsystem initialized lb # [ 2.305755] usb usb2: Product: UHCI Host Controller client # [ 2.331455] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.332562] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.209818] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.341306] usb usb2: Product: UHCI Host Controller worker2 # [ 2.341995] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.355325] hub 2-0:1.0: USB hub found lb # [ 2.184046] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.319564] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.320413] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.351293] usb usb2: Product: UHCI Host Controller client # [ 2.351986] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.363596] hub 2-0:1.0: 2 ports detected worker2 # [ 2.224093] systemd[1]: Starting Virtual Console Setup... client # [ 2.220133] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.359291] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.196404] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.227908] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.235743] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.237746] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.336306] hub 2-0:1.0: USB hub found lb # [ 2.339114] hub 2-0:1.0: 2 ports detected worker2 # [ 2.235261] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.242322] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.239559] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.245455] systemd[1]: Finished Virtual Console Setup. client # [ 2.236309] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.210383] (udev-worker)[89]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.372910] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.379359] hub 2-0:1.0: USB hub found lb # [ 2.214546] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.377318] hub 2-0:1.0: USB hub found client # [ 2.379201] SCSI subsystem initialized worker2 # [ 2.383988] hub 2-0:1.0: 2 ports detected worker1 # [ 2.391173] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.393972] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.388810] SCSI subsystem initialized client # [ 2.252329] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.254861] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.256257] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.367282] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.260893] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.264772] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.368005] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.406517] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.407873] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.267659] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.408625] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.397449] hub 2-0:1.0: 2 ports detected lb # [ 2.240624] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.408033] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.377747] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.405252] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.245589] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.417889] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.419045] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.413039] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.286080] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.287746] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.291071] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.418761] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.430931] usb usb3: Product: UHCI Host Controller client # [ 2.419482] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.431636] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.425078] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.432607] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.433661] hub 3-0:1.0: USB hub found worker1 # [ 2.436836] hub 3-0:1.0: 2 ports detected lb # [ 2.400127] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.431468] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.400950] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.427164] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.432242] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.427952] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.301061] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.301919] systemd[1]: Reached target Initrd Root Device. client # [ 2.297633] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.300788] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.305072] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.408171] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.301833] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.409334] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.447999] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.277072] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.437138] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.448948] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.278023] systemd[1]: Reached target Initrd Root Device. client # [ 2.438309] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.450854] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.451749] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.280153] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.444714] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.446018] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.444155] usb usb3: Product: UHCI Host Controller worker1 # [ 2.455897] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.444850] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.420111] usb usb3: Product: UHCI Host Controller lb # [ 2.420817] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.458968] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.453303] usb usb3: Product: UHCI Host Controller client # [ 2.449121] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.453995] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.455694] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.463449] usb usb4: Product: UHCI Host Controller lb # [ 2.426140] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.464896] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.454211] hub 3-0:1.0: USB hub found client # [ 2.456105] hub 3-0:1.0: 2 ports detected worker2 # [ 2.461505] hub 3-0:1.0: USB hub found worker1 # [ 2.333387] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.431447] hub 3-0:1.0: USB hub found worker1 # [ 2.469240] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.463110] hub 3-0:1.0: 2 ports detected lb # [ 2.433575] hub 3-0:1.0: 2 ports detected client # [ 2.461017] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.338156] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.463118] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.469424] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.439989] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.466226] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.478048] hub 4-0:1.0: USB hub found worker2 # [ 2.471510] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.479145] hub 4-0:1.0: 2 ports detected client # [ 2.469117] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.443171] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.476374] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.446181] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.477156] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.472529] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.447012] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.476122] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.347402] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.451500] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.482084] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.478763] usb usb4: Product: UHCI Host Controller client # [ 2.346869] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.352570] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.322826] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.487937] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.352107] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.490358] usb usb4: Product: UHCI Host Controller worker2 # [ 2.491043] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.487209] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.487971] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.493439] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.329465] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.495217] hub 4-0:1.0: USB hub found client # [ 2.491218] hub 4-0:1.0: USB hub found lb # [ 2.465137] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.492423] hub 4-0:1.0: 2 ports detected worker2 # [ 2.497379] hub 4-0:1.0: 2 ports detected lb # [ 2.468352] usb usb4: Product: UHCI Host Controller lb # [ 2.469287] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.470055] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.508318] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.473569] hub 4-0:1.0: USB hub found lb # [ 2.476427] hub 4-0:1.0: 2 ports detected worker1 # [ 2.514611] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.515762] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.520828] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.525278] scsi host0: ahci worker1 # [ 2.526901] scsi host1: ahci worker1 # [ 2.528473] scsi host2: ahci lb # [ 2.491126] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.530241] scsi host3: ahci client # [ 2.519146] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.531936] scsi host4: ahci client # [ 2.521108] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.533546] scsi host5: ahci lb # [ 2.495659] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.496757] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.534625] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.529308] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.536328] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.526274] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.537521] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.538756] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.539944] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.529603] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.541113] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.507489] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.535158] scsi host0: ahci worker2 # [ 2.539732] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.540958] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.537458] scsi host1: ahci client # [ 2.538698] scsi host2: ahci worker2 # [ 2.542970] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.540697] scsi host3: ahci client # [ 2.542021] scsi host4: ahci lb # [ 2.516282] scsi host0: ahci worker2 # [ 2.546870] scsi host0: ahci client # [ 2.543742] scsi host5: ahci worker2 # [ 2.548701] scsi host1: ahci client # [ 2.544917] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.550305] scsi host2: ahci lb # [ 2.520143] scsi host1: ahci client # [ 2.546397] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.551897] scsi host3: ahci lb # [ 2.521667] scsi host2: ahci client # [ 2.547553] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.553581] scsi host4: ahci client # [ 2.548701] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.523645] scsi host3: ahci client # [ 2.549872] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.555137] scsi host5: ahci lb # [ 2.524981] scsi host4: ahci client # [ 2.551011] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.556176] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.526775] scsi host5: ahci worker2 # [ 2.557956] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.527991] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.559159] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.529420] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.560358] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.530629] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.561552] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.531805] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.562718] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.532975] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.534125] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.638097] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.641001] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.644269] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.646206] usb 1-1: Manufacturer: QEMU worker1 # [ 2.647885] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.621180] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.624067] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.651132] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.627534] usb 1-1: Product: QEMU USB Tablet client # [ 2.653969] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.629399] usb 1-1: Manufacturer: QEMU client # [ 2.657247] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.660542] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.631207] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.658961] usb 1-1: Manufacturer: QEMU worker2 # [ 2.663435] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.660570] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.666739] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.668546] usb 1-1: Manufacturer: QEMU worker2 # [ 2.670173] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.678699] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.664591] hid: raw HID events driver (C) Jiri Kosina client # [ 2.691997] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.702178] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.609497] systemd[1]: Mounting /sysroot... worker2 # [ 2.628141] systemd[1]: Mounting /sysroot... client # [ 2.630892] systemd[1]: Mounting /sysroot... lb # [ 2.606206] systemd[1]: Mounting /sysroot... worker1 # [ 2.852904] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.855163] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.857928] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.860211] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.862404] ata3.00: applying bridge limits worker1 # [ 2.864341] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.866614] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.868941] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.871215] ata3.00: configured for UDMA/100 worker1 # [ 2.873562] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.866795] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.870725] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.867676] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.868726] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.869638] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.842572] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.872988] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.870520] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.871438] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.872445] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.875788] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.873283] ata3.00: applying bridge limits client # [ 2.873962] ata3.00: configured for UDMA/100 worker2 # [ 2.878014] ata3.00: applying bridge limits client # [ 2.875010] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.879933] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.851006] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.882221] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.853339] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.884572] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.855517] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.886792] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.889019] ata3.00: configured for UDMA/100 lb # [ 2.858407] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.860750] ata3.00: applying bridge limits worker2 # [ 2.891498] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.862783] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.865287] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.867568] ata3.00: configured for UDMA/100 lb # [ 2.869991] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.934189] usbcore: registered new interface driver usbhid client # [ 2.935020] usbhid: USB HID core driver worker1 # [ 2.953026] usbcore: registered new interface driver usbhid worker1 # [ 2.956190] usbhid: USB HID core driver worker1 # [ 2.968939] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.963708] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.965454] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.941303] usbcore: registered new interface driver usbhid worker2 # [ 2.974999] usbcore: registered new interface driver usbhid worker2 # [ 2.975806] usbhid: USB HID core driver client # [ 2.971593] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.983546] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.985523] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.948501] usbhid: USB HID core driver worker1 # [ 2.986712] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.982289] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.987337] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.983543] EXT4-fs (vda): mounted filesystem 2e6968cc-8085-486f-a88e-8c11acb36939 r/w with ordered data mode. Quota mode: none. lb # [ 2.960566] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.856170] systemd[1]: Mounted /sysroot. worker1 # [ 3.000560] EXT4-fs (vda): mounted filesystem c08cad62-9032-4186-bfc3-8fdaf7b86aaa r/w with ordered data mode. Quota mode: none. client # [ 2.858983] systemd[1]: Reached target Initrd Root File System. lb # [ 2.966385] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.861447] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.871830] systemd[1]: Mounted /sysroot. worker1 # [ 2.874069] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.002416] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.878076] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.007943] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.009723] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.876336] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.880560] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.882104] systemd[1]: Reloading... worker1 # [ 2.892214] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.895132] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.023452] EXT4-fs (vda): mounted filesystem de790940-3e3b-4282-a820-89c8def9c959 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.897513] systemd[1]: Reloading... worker2 # [ 2.898831] systemd[1]: Mounted /sysroot. worker2 # [ 2.900184] systemd[1]: Reached target Initrd Root File System. lb # [ 3.004290] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.904080] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.008685] EXT4-fs (vda): mounted filesystem 2889e468-078f-4b61-be2f-08828f933773 r/w with ordered data mode. Quota mode: none. lb # [ 2.878651] systemd[1]: Mounted /sysroot. lb # [ 2.880182] systemd[1]: Reached target Initrd Root File System. lb # [ 3.016218] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.883624] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.921859] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.927074] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.928768] systemd[1]: Reloading... lb # [ 2.901881] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.905069] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.907124] systemd[1]: Reloading... client # [ 2.964047] systemd[1]: Reloading finished in 84 ms. worker1 # [ 2.977610] systemd[1]: Reloading finished in 80 ms. client # [ 2.972212] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... client # [ 2.976223] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker1 # [ 2.987085] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... client # [ 2.979185] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 2.980593] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.990151] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... client # [ 2.981624] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 2.994682] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.995990] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.997073] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.012175] systemd[1]: Reloading finished in 85 ms. worker2 # [ 3.020209] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.023152] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker2 # [ 3.028686] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.030193] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.031201] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.000287] systemd[1]: Reloading finished in 93 ms. lb # [ 3.008254] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... lb # [ 3.013168] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... lb # [ 3.017261] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.019132] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.020141] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.611168] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.618161] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.626167] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.628445] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.634163] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.631927] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.630643] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.636768] systemd[1]: Mounting /sysroot/run... client # [ 3.633751] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.638727] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.607095] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.638144] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.647680] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.645141] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.614178] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.642297] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.620304] systemd[1]: Mounting /sysroot/run... client # [ 3.654399] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.633408] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.668462] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.681360] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.676137] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.644672] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.677675] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.678602] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.684971] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.680157] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.689214] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.683802] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.692589] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.694351] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.697678] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.688580] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.694527] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.696076] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.691972] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.698170] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.696794] systemd[1]: Mounted /sysroot/run. client # [ 3.697651] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.708235] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.710116] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.701532] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.713249] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.704292] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.681705] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.714062] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.688592] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.719949] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.715531] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.721321] systemd[1]: Reached target Initrd File Systems. lb # [ 3.691112] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.722930] systemd[1]: Starting Find NixOS closure... lb # [ 3.691729] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.693745] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.725533] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.697422] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.739053] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.740144] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.741810] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.744539] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.708615] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.711129] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.712203] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.744206] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.751917] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.753779] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.754889] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.763262] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.733824] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.771454] systemd[1]: Finished Find NixOS closure. lb # [ 3.735073] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.773171] systemd[1]: Reached target Initrd Default Target. lb # [ 3.737071] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.768761] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.774434] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.770056] systemd[1]: Stopped target Basic System. lb # [ 3.739304] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.770970] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.771870] systemd[1]: Stopped target Path Units. worker2 # [ 3.772741] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.775110] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.776127] systemd[1]: Stopped target Slice Units. worker2 # [ 3.776802] systemd[1]: Stopped target Socket Units. worker2 # [ 3.777701] systemd[1]: Stopped target System Initialization. worker2 # [ 3.778557] systemd[1]: Stopped target Swaps. worker2 # [ 3.779271] systemd[1]: Stopped target Timer Units. worker2 # [ 3.779960] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.780742] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.781646] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.787623] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.783131] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.788967] systemd[1]: Stopped target Basic System. worker2 # [ 3.784422] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.789956] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.790910] systemd[1]: Stopped target Path Units. worker2 # [ 3.786100] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.787407] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.756098] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 3.793117] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.788491] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.794117] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.795110] systemd[1]: Stopped target Slice Units. worker2 # [ 3.789607] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.795766] systemd[1]: Stopped target Socket Units. worker2 # [ 3.790620] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.796485] systemd[1]: Stopped target System Initialization. worker1 # [ 3.797454] systemd[1]: Stopped target Swaps. worker2 # [ 3.792211] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.798132] systemd[1]: Stopped target Timer Units. worker1 # [ 3.798788] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.793445] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.799621] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.794604] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.763552] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.801202] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.764651] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.796347] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.802219] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.797308] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.766401] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.803249] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.798346] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.804351] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.800106] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.806341] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.800818] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.807396] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.802030] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.808587] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.803596] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.809588] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.810815] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.812096] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.814144] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.815297] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.816255] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.779608] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.811720] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.817319] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.780899] systemd[1]: Stopped target Basic System. worker1 # [ 3.818478] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.781819] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.815054] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.784146] systemd[1]: Stopped target Path Units. worker1 # [ 3.821182] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.784825] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.822199] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.785820] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.786813] systemd[1]: Stopped target Slice Units. worker1 # [ 3.824111] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.787509] systemd[1]: Stopped target Socket Units. lb # [ 3.788427] systemd[1]: Stopped target System Initialization. lb # [ 3.789282] systemd[1]: Stopped target Swaps. lb # [ 3.789933] systemd[1]: Stopped target Timer Units. worker2 # [ 3.821191] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.790649] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.791437] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.824073] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.792829] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.793854] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.825074] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.826192] systemd[1]: Closed udev Control Socket. lb # [ 3.795123] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.832714] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.796154] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.828778] systemd[1]: Starting Cleanup udev Database... lb # [ 3.798123] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.835144] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.829642] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.798815] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.830732] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.799764] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.800712] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.832236] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.801813] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.833433] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.802873] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.834477] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.803860] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.840812] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.836186] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.805106] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.836980] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.805847] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.807122] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.844147] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.839135] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.808047] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.845155] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.846189] systemd[1]: Closed udev Control Socket. lb # [ 3.810601] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.848827] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.849663] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.813737] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.851141] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.814769] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.851981] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.854079] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.855065] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.855943] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.857122] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.820769] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.858499] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.853756] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.856072] systemd[1]: Finished Cleanup udev Database. lb # [ 3.824807] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.856779] systemd[1]: Reached target Switch Root. worker2 # [ 3.858494] systemd[1]: Starting NixOS Activation... lb # [ 3.833145] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.834089] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.835178] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.836125] systemd[1]: Closed udev Control Socket. lb # [ 3.838513] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.876504] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.840079] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.877743] systemd[1]: Finished Cleanup udev Database. lb # [ 3.841109] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.841916] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.879182] systemd[1]: Reached target Switch Root. lb # [ 3.843126] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.880530] systemd[1]: Starting NixOS Activation... lb # [ 3.844105] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.846110] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.846941] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.848291] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.863186] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.865199] systemd[1]: Finished Cleanup udev Database. lb # [ 3.866434] systemd[1]: Reached target Switch Root. lb # [ 3.868259] systemd[1]: Starting NixOS Activation... worker2 # [ 3.921579] initrd-nixos-activation-start[191]: booting system configuration /nix/store/2r960cj2h4zwi2h592n0agq168cha874-nixos-system-worker2-test worker1 # [ 3.950634] initrd-nixos-activation-start[191]: booting system configuration /nix/store/9l48jkcr6cdiqp8y6v9sxvagdw5w59l4-nixos-system-worker1-test worker2 # [ 3.946237] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 3.975033] initrd-nixos-activation-start[191]: running activation script... lb # [ 3.940809] initrd-nixos-activation-start[191]: booting system configuration /nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test lb # [ 3.967149] initrd-nixos-activation-start[191]: running activation script... worker2 # [ 4.140826] initrd-nixos-activation-start[214]: setting up /etc... worker1 # [ 4.182591] initrd-nixos-activation-start[214]: setting up /etc... lb # [ 4.163373] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 4.245466] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.246732] systemd[1]: Finished NixOS Activation. worker2 # [ 4.248859] systemd[1]: Starting Switch Root... worker2 # [ 4.263590] systemd[1]: Switching root. worker1 # [ 4.280672] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.283074] systemd[1]: Finished NixOS Activation. worker1 # [ 4.284224] systemd[1]: Starting Switch Root... lb # [ 4.256683] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.258325] systemd[1]: Finished NixOS Activation. worker1 # [ 4.295631] systemd[1]: Switching root. lb # [ 4.260282] systemd[1]: Starting Switch Root... lb # [ 4.271672] systemd[1]: Switching root. worker2 # [ 4.528882] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.551694] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.536328] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.616611] NET: Registered PF_VSOCK protocol family worker2 # [ 4.628154] NET: Registered PF_VSOCK protocol family lb # [ 4.617342] NET: Registered PF_VSOCK protocol family client # [ 4.631454] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.661756] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.663328] systemd[1]: Reached target Initrd File Systems. client # [ 4.665137] systemd[1]: Starting Find NixOS closure... client # [ 4.667889] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.688579] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.691605] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.697829] systemd[1]: Finished Find NixOS closure. client # [ 4.699346] systemd[1]: Reached target Initrd Default Target. client # [ 4.701165] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.714565] systemd[1]: Stopped target Initrd Default Target. client # [ 4.715868] systemd[1]: Stopped target Basic System. client # [ 4.716777] systemd[1]: Stopped target Initrd Root Device. client # [ 4.718110] systemd[1]: Stopped target Path Units. client # [ 4.718806] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.719909] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.721097] systemd[1]: Stopped target Slice Units. client # [ 4.722120] systemd[1]: Stopped target Socket Units. client # [ 4.723106] systemd[1]: Stopped target System Initialization. client # [ 4.724178] systemd[1]: Stopped target Swaps. client # [ 4.725266] systemd[1]: Stopped target Timer Units. client # [ 4.726204] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.728026] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.728847] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.729962] systemd[1]: Stopped Find NixOS closure. client # [ 4.730972] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.731877] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.733302] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.734317] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.736207] systemd[1]: Stopped Load Kernel Modules. client # [ 4.737241] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.738468] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.739782] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.741115] systemd[1]: Stopped Create System Files and Directories. client # [ 4.743145] systemd[1]: Stopped target Local File Systems. client # [ 4.744149] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.745601] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.747127] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.748384] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.749893] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.751103] systemd[1]: Stopped Virtual Console Setup. client # [ 4.761377] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 4.765248] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.770233] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.771714] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 4.773230] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.774667] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.777139] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 4.778223] systemd[1]: Closed udev Control Socket. client # [ 4.779513] systemd[1]: Starting Cleanup udev Database... client # [ 4.780892] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.781993] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 4.782887] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.785055] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 4.786108] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 4.787087] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.801927] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.803535] systemd[1]: Finished Cleanup udev Database. client # [ 4.805206] systemd[1]: Reached target Switch Root. client # [ 4.807068] systemd[1]: Starting NixOS Activation... worker1 # [ 4.974381] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 4.984158] systemd[1]: Detected virtualization kvm. worker1 # [ 4.985945] systemd[1]: Detected architecture x86-64. worker1 # [ 4.987861] systemd[1]: Detected first boot. worker1 # [ 4.991610] systemd[1]: Initializing machine ID from random generator. worker2 # [ 4.987450] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 4.992090] systemd[1]: Detected virtualization kvm. worker2 # [ 4.992896] systemd[1]: Detected architecture x86-64. worker2 # [ 4.993859] systemd[1]: Detected first boot. worker2 # [ 4.996216] systemd[1]: Initializing machine ID from random generator. lb # [ 4.974658] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 4.978605] systemd[1]: Detected virtualization kvm. lb # [ 4.979321] systemd[1]: Detected architecture x86-64. lb # [ 4.980086] systemd[1]: Detected first boot. lb # [ 4.982103] systemd[1]: Initializing machine ID from random generator. client # [ 4.880743] initrd-nixos-activation-start[191]: booting system configuration /nix/store/6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test client # [ 4.908599] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 5.111036] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.210875] systemd[1]: Applying preset policy. worker2 # [ 5.218460] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.083853] initrd-nixos-activation-start[214]: setting up /etc... lb # [ 5.218991] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.171699] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.173331] systemd[1]: Finished NixOS Activation. client # [ 5.175428] systemd[1]: Starting Switch Root... client # [ 5.188376] systemd[1]: Switching root. worker2 # [ 5.331384] systemd[1]: Applying preset policy. lb # [ 5.329882] systemd[1]: Applying preset policy. worker1 # [ 5.376704] systemd[1]: Populated /etc with preset unit settings. client # [ 5.445268] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.491778] systemd[1]: Populated /etc with preset unit settings. client # [ 5.518748] NET: Registered PF_VSOCK protocol family lb # [ 5.510999] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.550765] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.552206] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.554251] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.556341] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.557670] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.558587] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.559836] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.560928] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.561614] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.562395] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.563240] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.564024] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.564843] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.565657] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.566550] systemd[1]: Reached target Path Units. worker1 # [ 5.567241] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.568043] systemd[1]: Reached target Slice Units. worker1 # [ 5.568761] systemd[1]: Reached target Swaps. worker1 # [ 5.570401] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.572627] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.574309] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.576414] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.589004] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.591741] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.593198] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.595734] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.596847] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.597984] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.599287] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.602740] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.603743] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.604600] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.606626] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.610866] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.615668] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.624702] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.632340] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.650706] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.655536] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.662377] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.667521] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.677879] systemd[1]: Mounting FUSE Control File System... worker1 # [ 5.678686] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.677190] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.678627] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.680716] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.682898] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.691117] systemd[1]: Starting Journal Service... worker2 # [ 5.684348] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.685197] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.686473] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.687586] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.688337] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.689038] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.689953] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.697243] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.690747] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.691578] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.692463] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.693391] systemd[1]: Reached target Path Units. worker2 # [ 5.694057] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.694849] systemd[1]: Reached target Slice Units. worker2 # [ 5.695588] systemd[1]: Reached target Swaps. worker2 # [ 5.697397] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.705720] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.699865] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.709735] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.711580] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.717191] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.701668] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.721514] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.715216] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.716166] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.724062] systemd[1]: Mounted Huge Pages File System. worker1 # [ 5.725968] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.719036] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.720603] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.729966] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.723128] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.730903] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.724649] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.725802] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.733202] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.727122] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.734616] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.731102] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.732101] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.732975] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.741882] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 5.735210] systemd[1]: Mounting Huge Pages File System... lb # [ 5.707599] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.708941] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.739663] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 5.711488] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 5.713522] systemd[1]: Created slice Slice /system/getty. lb # [ 5.714943] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.746589] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.715853] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 5.717164] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.754791] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.718296] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.756161] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.718971] systemd[1]: Expecting device /dev/ttyS0... lb # [ 5.719745] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.720594] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.721363] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.722140] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.753137] systemd[1]: Mounting Kernel Trace File System... lb # [ 5.722961] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.760925] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.723869] systemd[1]: Reached target Path Units. lb # [ 5.724596] systemd[1]: Reached target Remote File Systems. lb # [ 5.725378] systemd[1]: Reached target Slice Units. lb # [ 5.726076] systemd[1]: Reached target Swaps. lb # [ 5.727848] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.730208] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.760677] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.771972] systemd[1]: Starting Load Kernel Module configfs... lb # [ 5.731841] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.775376] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 5.745363] systemd[1]: Listening on Factory Reset Management. lb # [ 5.746470] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.784179] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.749304] systemd[1]: Starting Journal Log Access Socket... lb # [ 5.750417] systemd[1]: Listening on Journal Audit Socket. lb # [ 5.753121] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.783377] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 5.754222] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.755345] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.756654] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 5.760394] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.761435] systemd[1]: Listening on udev Control Socket. lb # [ 5.762322] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.792560] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 5.764533] systemd[1]: Mounting Huge Pages File System... lb # [ 5.767014] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.807903] EXT4-fs (vda): re-mounted c08cad62-9032-4186-bfc3-8fdaf7b86aaa. lb # [ 5.773235] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.807413] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.808230] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 5.781171] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.819978] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 5.821166] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 5.823294] systemd-journald[284]: Collecting audit messages is enabled. worker1 # [ 5.824345] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.789152] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.828987] loop: module loaded worker2 # [ 5.822708] systemd[1]: Starting Journal Service... worker1 # [ 5.830255] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 5.833841] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.799162] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.830586] systemd[1]: Starting Load Kernel Modules... lb # [ 5.800018] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.840183] systemd[1]: Finished Load Kernel Modules. worker1 # [ 5.846283] systemd[1]: Starting Firewall... worker2 # [ 5.840202] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.810736] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.852325] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.847880] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.849836] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.855296] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.824903] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.859949] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.862657] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.865476] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.867440] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.836959] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.868733] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.871604] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.873933] systemd[1]: Mounted FUSE Control File System. worker1 # [ 5.747404] systemd[1]: Queued start job for default target Multi-User System.[ 5.883179] systemd[1]: Started Journal Service. lb # [ 5.844641] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # worker1 # [ 5.753672] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.883908] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 5.888131] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.890749] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.877587] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.763210] systemd-modules-load[285]: Inserted module 'loop' lb # [ 5.861249] systemd[1]: Starting Journal Service... worker1 # [ 5.764625] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.887194] systemd[1]: Detected virtualization kvm. client # [ 5.889004] systemd[1]: Detected architecture x86-64. client # [ 5.890976] systemd[1]: Detected first boot. worker2 # [ 5.896336] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.868361] systemd[1]: Starting Load Kernel Modules... client # [ 5.894821] systemd[1]: Initializing machine ID from random generator. lb # [ 5.877596] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.782870] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 5.789070] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.886971] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.919969] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.894222] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.899910] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.806094] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 5.806887] systemd[1]: Reached target First Boot Complete. lb # [ 5.911997] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.917384] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 5.919471] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.952456] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 5.922377] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.954290] EXT4-fs (vda): re-mounted de790940-3e3b-4282-a820-89c8def9c959. lb # [ 5.926267] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.930729] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 5.833507] systemd-oomd[286]: No swap; memory pressure usage will be degraded lb # [ 5.936146] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 5.839260] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.968189] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.969765] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.972164] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 5.973858] loop: module loaded lb # [ 5.946360] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.978873] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.980480] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.987968] systemd-journald[284]: Received client request to flush runtime journal. lb # [ 5.818638] systemd[1]: Queued start job for default target Multi-User System. lb # [ 5.954158] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.985224] systemd[1]: Finished Load Kernel Modules. lb # [ 5.821945] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.989723] systemd[1]: Starting Firewall... lb # [ 5.960240] systemd[1]: Started Journal Service. lb # [ 5.962231] loop: module loaded lb # [ 5.829076] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 5.994103] systemd[1]: Starting Apply Kernel Variables... lb # [ 5.831151] systemd[1]: Mounted FUSE Control File System. lb # [ 5.844960] systemd[1]: Finished Load Kernel Modules. worker2 # [ 6.016851] systemd[1]: Started Journal Service. lb # [ 5.854840] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.884599] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.888557] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.995159] EXT4-fs (vda): re-mounted 2889e468-078f-4b61-be2f-08828f933773. lb # [ 5.863275] systemd[1]: Starting Firewall... worker2 # [ 5.896781] systemd-modules-load[285]: Inserted module 'loop' lb # [ 5.867137] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.902858] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.873064] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.889105] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.889985] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.932503] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 5.935169] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.906705] systemd-oomd[287]: No swap; memory pressure usage will be degraded lb # [ 5.911460] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.912434] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.923300] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.924120] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.959167] systemd-oomd[287]: No swap; memory pressure usage will be degraded lb # [ 5.934109] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.966188] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 5.968549] systemd[1]: Reached target First Boot Complete. worker1 # [ 5.977414] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 5.974198] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 5.979725] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 5.982087] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 5.983108] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 5.985168] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 6.122328] systemd-journald[284]: Received client request to flush runtime journal. client # [ 6.138125] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.123575] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 6.031960] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker2 # [ 6.088398] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 6.101070] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.101085] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 6.101943] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.102985] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.077495] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.108167] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 6.078831] systemd[1]: Finished Apply Kernel Variables. client # [ 6.239259] systemd[1]: Applying preset policy. lb # [ 6.083066] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.083868] systemd[1]: Reached target First Boot Complete. lb # [ 6.085058] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.091186] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.095520] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.179747] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.190915] systemd-udevd[318]: Using default interface naming scheme 'v261'. lb # [ 6.185429] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.195771] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 6.197085] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.200237] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.259884] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.266202] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.243339] systemd-udevd[325]: Using default interface naming scheme 'v261'. client # [ 6.420996] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.315442] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.291570] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.340961] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.394860] (udev-worker)[355]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.400782] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.405575] (udev-worker)[351]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.407554] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.420844] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.419741] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.401135] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.468771] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.470482] systemd[1]: Reached target Local File Systems. worker1 # [ 6.473416] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 6.477054] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.479981] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.482122] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.485129] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.488070] systemd[1]: Starting Create System Files and Directories... client # [ 6.618993] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.620516] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.622569] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.624666] systemd[1]: Created slice Slice /system/getty. client # [ 6.626022] systemd[1]: Created slice User and Session Slice. client # [ 6.626985] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.628218] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.500086] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.629325] systemd[1]: Expecting device /dev/hvc0... client # [ 6.630091] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.630839] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.631658] systemd[1]: Stopped target initrd-fs.target. client # [ 6.632417] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.633237] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.634118] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.635018] systemd[1]: Reached target Path Units. client # [ 6.635735] systemd[1]: Reached target Remote File Systems. client # [ 6.636493] systemd[1]: Reached target Slice Units. client # [ 6.637199] systemd[1]: Reached target Swaps. lb # [ 6.479093] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.639207] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.641855] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.643667] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 6.522378] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.645618] systemd[1]: Listening on Factory Reset Management. client # [ 6.657930] systemd[1]: Listening on Hostname Service Socket. client # [ 6.660921] systemd[1]: Starting Journal Log Access Socket... client # [ 6.662399] systemd[1]: Listening on Journal Audit Socket. client # [ 6.665273] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.666400] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.667512] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.668794] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.511977] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.673075] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.674134] systemd[1]: Listening on udev Control Socket. client # [ 6.675007] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 6.548517] systemd[1]: Mounting /run/wrappers... client # [ 6.677357] systemd[1]: Mounting Huge Pages File System... client # [ 6.679867] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.687227] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.566037] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.569570] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.533167] (udev-worker)[348]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.694961] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.541883] (udev-worker)[352]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.544054] (udev-worker)[352]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.705675] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 6.579528] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.583484] (udev-worker)[356]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.586214] (udev-worker)[356]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.718282] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.595614] systemd[1]: Mounted /run/wrappers. client # [ 6.727154] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.599962] systemd[1]: Reached target Local File Systems. worker2 # [ 6.602187] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.734669] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.576276] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.607459] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.611156] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 6.613260] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.745652] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.619208] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.631203] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.627171] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.636492] systemd[1]: Starting Rebuild Journal Catalog... client # [ 6.759941] systemd[1]: Mounting FUSE Control File System... worker1 # [ 6.637722] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.762272] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.614644] systemd[1]: Mounted /run/wrappers. client # [ 6.775525] systemd[1]: Starting Journal Service... lb # [ 6.615697] systemd[1]: Reached target Local File Systems. lb # [ 6.619288] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.781935] systemd[1]: Starting Load Kernel Modules... lb # [ 6.623201] systemd[1]: Starting register-nix-paths.service... lb # [ 6.627137] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.627917] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.632817] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.792913] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.643796] systemd[1]: Starting Create System Files and Directories... client # [ 6.806278] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.809216] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.814822] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.702848] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.831809] systemd[1]: Listening on Journal Log Access Socket. client # [ 6.834904] systemd-journald[284]: Collecting audit messages is enabled. worker2 # [ 6.707421] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.836303] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.717346] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.841659] systemd[1]: Mounted POSIX Message Queue File System. client # [ 6.844276] systemd[1]: Mounted Kernel Debug File System. client # [ 6.850241] systemd[1]: Mounted Kernel Trace File System. client # [ 6.858158] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.866618] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.873529] loop: module loaded client # [ 6.741286] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.742704] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.745579] systemd-modules-load[285]: Inserted module 'loop' client # [ 6.879398] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.882625] systemd[1]: Started Journal Service. worker1 # [ 6.759826] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.761974] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.727427] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.764603] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.767379] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.760760] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.770664] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.772491] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.775144] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.739124] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 6.772234] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.773731] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.777765] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.786255] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.779102] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 6.790953] systemd[1]: Starting Update is Completed... lb # [ 6.757556] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.785859] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.761495] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.763347] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.923637] EXT4-fs (vda): re-mounted 2e6968cc-8085-486f-a88e-8c11acb36939. client # [ 6.791562] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.792670] systemd[1]: Mounted FUSE Control File System. lb # [ 6.765749] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.767960] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.770933] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.772886] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.807271] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.812126] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.823248] systemd-oomd[286]: No swap; memory pressure usage will be degraded client # [ 6.828072] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.829034] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.834703] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.835530] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.840742] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.858367] systemd[1]: Finished Update is Completed. lb # [ 6.825344] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.860630] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 6.834582] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.843397] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 7.027217] systemd-journald[284]: Received client request to flush runtime journal. worker2 # [ 6.910460] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.915878] systemd[1]: Starting Update is Completed... lb # [ 6.929947] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.973601] systemd[1]: Finished Firewall. client # [ 6.977507] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.979789] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.982423] systemd[1]: Reached target First Boot Complete. client # [ 6.983265] systemd[1]: Finished Apply Kernel Variables. client # [ 6.986131] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.964988] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.971548] systemd[1]: Starting Update is Completed... worker2 # [ 7.002869] systemd[1]: Finished Update is Completed. worker1 # [ 7.142978] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.002743] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.008661] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 7.129615] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.036480] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.177876] ACPI: button: Power Button [PWRF] worker2 # [ 7.037911] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.040203] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.042741] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.147778] ACPI: button: Power Button [PWRF] worker2 # [ 7.045137] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.047374] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.049908] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.060448] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.074545] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.075682] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.078148] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 7.056888] systemd[1]: Finished Update is Completed. worker1 # [ 7.229664] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.196641] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 7.206501] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 7.247704] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.251847] mousedev: PS/2 mouse device common for all mice lb # [ 7.217160] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.256123] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 7.111820] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker1 # [ 7.124256] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.125335] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.146296] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.159044] systemd[1]: Finished Firewall. worker2 # [ 7.306954] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.313712] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.229093] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.269925] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.272396] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.285092] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.292123] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.265826] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 7.270183] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:32:25 UTC (1790076745) worker1 # [ 7.270344] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.271013] systemd-journald[284]: Time jumped backwards, rotating. client # [ 7.319399] (udev-worker)[327]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.321656] (udev-worker)[327]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.323316] (udev-worker)[321]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.272077] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 7.272233] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.348668] ACPI: button: Power Button [PWRF] worker2 # [ 7.455912] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.290713] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.349966] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 7.446715] Console: switching to colour dummy device 80x25 lb # [ 7.265913] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.281124] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 7.457970] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.458090] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 7.460707] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.466824] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.466893] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:32:26 UTC (1790076746) client # [ 7.403892] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.510276] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 7.377425] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.510518] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 7.405422] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.407132] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.409632] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.383591] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.411119] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.421691] systemd[1]: Starting Virtual Console Setup... client # [ 7.412303] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.424095] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.466975] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.467856] systemd-journald[284]: Time jumped backwards, rotating. worker2 # [ 7.474697] Console: switching to colour dummy device 80x25 lb # [ 7.281222] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:32:25 UTC (1790076745) lb # [ 7.281299] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.282332] systemd-journald[284]: Time jumped backwards, rotating. worker1 # [ 7.584318] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.584320] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.588291] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.588981] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.584374] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.478496] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.478591] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.480037] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.359933] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.362676] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.449121] systemd[1]: Finished Firewall. client # [ 7.614091] ACPI: button: Power Button [PWRF] lb # [ 7.408824] Console: switching to colour dummy device 80x25 lb # [ 7.562249] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.562361] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.459080] systemd[1]: Finished register-nix-paths.service. lb # [ 7.459943] systemd[1]: Reached target System Initialization. client # [ 7.489206] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.511893] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.627544] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.462811] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.627547] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.463859] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.464765] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.465712] systemd[1]: Reached target Timer Units. lb # [ 7.466488] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 7.469805] systemd[1]: Listening on niks3 server socket. lb # [ 7.470641] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.471440] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.472633] systemd[1]: Reached target Socket Units. lb # [ 7.473454] systemd[1]: Reached target Basic System. lb # [ 7.475613] systemd[1]: Started backdoor.service. worker1 # [ 7.512181] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.513384] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 7.515066] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.644479] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.480057] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.645146] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 7.650352] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.645869] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.651001] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.490621] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.527352] systemd[1]: Mounted /run/wrappers. client # [ 7.528211] systemd[1]: Reached target Local File Systems. client # [ 7.530453] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.639087] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.533975] systemd[1]: Starting register-nix-paths.service... lb # [ 7.507993] systemd[1]: Starting Post-Boot Actions... client # [ 7.537092] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.537886] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.511387] systemd[1]: Started Reset console on configuration changes. lb # [ 7.648119] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.517346] systemd[1]: Starting resolvconf update... client # [ 7.546121] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.524410] systemd[1]: Started rustfs.service. client # [ 7.555854] systemd[1]: Starting Create System Files and Directories... lb # [ 7.668224] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.668668] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.698835] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.706652] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.678359] ppdev: user-space parallel port driver lb # [ 7.555681] systemd[1]: Starting rustfs-bucket.service... worker1 # [ 7.723146] Console: switching to colour frame buffer device 160x50 worker1 # [ 7.725700] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 7.599861] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.600978] systemd[1]: Reached target System Initialization. worker2 # [ 7.602350] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 7.732047] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 7.605344] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.607140] systemd[1]: Reached target Timer Units. worker1 # [ 7.748006] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.608958] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.611210] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 7.618990] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.614663] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 7.615606] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 7.621531] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.616733] systemd[1]: Reached target Socket Units. worker1 # [ 7.623084] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.620109] systemd[1]: Reached target Basic System. worker2 # [ 7.623126] systemd[1]: Started backdoor.service. worker2 # [ 7.623794] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.627110] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.759597] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.735234] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.735906] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.634071] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.634788] systemd[1]: Started Reset console on configuration changes. lb # [ 7.603748] nsncd[523]: Sep 22 11:32:25.955 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # connecting to host... client # [ 7.632989] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.639075] systemd[1]: Starting resolvconf update... lb # [ 7.610094] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.639687] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.646697] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.775396] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.639844] systemd[1]: Finished Post-Boot Actions. lb # [ 7.651157] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.651993] systemd[1]: Reached target User and Group Name Lookups. lb # [ 7.667611] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 7.844279] kvm_amd: TSC scaling supported worker1 # [ 7.844711] kvm_amd: Nested Virtualization enabled worker1 # [ 7.845441] kvm_amd: Nested Paging enabled worker1 # [ 7.846051] kvm_amd: LBR virtualization supported worker1 # [ 7.846478] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 7.847135] kvm_amd: Virtual GIF supported client # [ 7.702583] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.847514] kvm_amd: Virtual NMI enabled lb # [ 7.685785] systemd[1]: Starting User Login Management... client # [ 7.713420] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.714479] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.728513] systemd[1]: Finished Post-Boot Actions. worker1 # [ 7.880545] EDAC MC: Ver: 3.0.0 worker2 # connecting to host... lb # [ 7.720170] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.756078] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.756902] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.760413] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.767967] systemd[1]: Starting User Login Management... worker2 # [ 7.769387] nsncd[514]: Sep 22 11:32:26.934 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.780122] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.793909] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 7.765101] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 7.801532] systemd-vconsole-setup[519]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 7.805912] systemd[1]: Finished Virtual Console Setup. worker1 # [ 7.806706] systemd[1]: Reached target System Initialization. worker1 # [ 7.807796] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 7.809161] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 7.811296] systemd[1]: Reached target Timer Units. worker1 # [ 7.812073] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.812948] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 7.815531] systemd[1]: Listening on Nix worker-protocol over gRPC. client # [ 7.806978] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.816709] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 7.817910] systemd[1]: Reached target Socket Units. worker2 # [ 7.812443] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.819065] systemd[1]: Reached target Basic System. worker1 # [ 7.821061] systemd[1]: Started backdoor.service. client # [ 7.812948] systemd[1]: Starting Update is Completed... worker1 # [ 7.825526] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.820656] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.821948] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 7.830102] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.831679] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.838064] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.839865] systemd[1]: Starting resolvconf update... worker2 # [ 7.840385] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.841779] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 7.852066] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.864558] systemd[1]: Finished Update is Completed. worker2 # [ 7.703303] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.877494] dbus-broker-launch[518]: Ready client # [ 7.789798] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.789902] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.876680] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.791159] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:32:26 UTC (1790076746) client # [ 7.791257] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.916163] systemd[1]: Finished Post-Boot Actions. lb # [ 7.881809] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.703582] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.903129] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.942700] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.945282] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.948628] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.792391] systemd-journald[284]: Time jumped backwards, rotating. worker1 # [ 7.952184] nsncd[526]: Sep 22 11:32:26.314 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # connecting to host... worker1 # [ 7.955891] systemd[1]: Starting User Login Management... lb # [ 7.926350] dbus-broker-launch[552]: Looking up NSS user entry for 'systemd-timesync'... client # [ 7.882787] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.032703] Console: switching to colour dummy device 80x25 client # [ 8.040947] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 8.041096] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 7.948183] Console: switching to colour frame buffer device 160x50 worker1 # [ 7.972854] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.109737] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.931136] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 7.983179] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 7.989539] dbus-broker-launch[530]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 7.954215] dbus-broker-launch[552]: NSS returned no entry for 'systemd-timesync' lb # [ 7.955503] dbus-broker-launch[552]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 7.988386] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.997183] dbus-broker-launch[530]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.991983] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 7.993904] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 7.963074] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 7.999106] dbus-broker-launch[530]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.963939] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 7.965487] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 7.997759] systemd[1]: nscd.service: Deactivated successfully. lb # [ 7.967546] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 7.999122] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.999907] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.968845] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 8.000793] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 7.972465] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.010651] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.005896] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.008082] systemd[1]: Starting Virtual Console Setup... lb # [ 7.978269] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.008992] systemd-logind[539]: New seat seat0. worker2 # [ 8.013909] systemd-logind[539]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 8.015096] systemd-logind[539]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 8.016334] systemd[1]: Started User Login Management. worker2 # [ 8.017052] systemd[1]: Starting linger-users.service... client # [ 8.099403] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 8.099690] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 8.024534] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.025682] nsncd[587]: Sep 22 11:32:27.190 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.034652] dbus-broker-launch[530]: Ready worker2 # [ 8.029266] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.033225] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.044784] systemd[1]: Finished resolvconf update. worker2 # [ 8.047540] systemd[1]: Reached target Preparation for Network. worker2 # [ 8.050327] systemd[1]: Starting DHCP Client... worker2 # [ 8.054968] systemd[1]: Starting Address configuration of eth1... worker1 # [ 8.063962] systemd-logind[549]: New seat seat0. worker2 # [ 8.059057] systemd[1]: Starting Extra networking commands.... client # [ 8.188568] [drm] Found bochs VGA, ID 0xb0c5. client # [ 8.188570] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.066826] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.059947] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.069929] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.073693] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 8.075872] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 8.079212] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.081388] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.205799] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.082492] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.084884] systemd-logind[549]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 8.087164] systemd-logind[549]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.089778] systemd-logind[549]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.092119] systemd[1]: Started User Login Management. worker1 # [ 8.092799] systemd[1]: Starting linger-users.service... worker1 # [ 8.095778] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.093646] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.097327] systemd[1]: Finished linger-users.service. client # [ 8.228470] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.139778] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.143443] systemd[1]: Finished linger-users.service. lb # [ 8.172404] ppdev: user-space parallel port driver lb # [ 8.208811] Console: switching to colour frame buffer device 160x50 lb # [ 8.244616] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.147863] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 7.997616] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 8.149649] nsncd[599]: Sep 22 11:32:26.512 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.114218] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.151722] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.115561] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.152941] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.116579] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.119706] nsncd[615]: Sep 22 11:32:26.435 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.161769] systemd[1]: Finished resolvconf update. worker1 # [ 8.163164] systemd[1]: Reached target Preparation for Network. lb # [ 8.126756] dbus-broker-launch[552]: Ready worker2 # [ 8.291797] ppdev: user-space parallel port driver lb # [ 8.130130] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.167080] systemd[1]: Starting DHCP Client... lb # [ 8.130916] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.132899] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.170156] systemd[1]: Starting Address configuration of eth1... lb # [ 8.133734] systemd[1]: Finished resolvconf update. lb # [ 8.134428] systemd[1]: Reached target Preparation for Network. lb # [ 8.135199] systemd[1]: Starting DHCP Client... lb # [ 8.135808] systemd-logind[555]: New seat seat0. worker1 # [ 8.173327] systemd[1]: Starting Extra networking commands.... lb # [ 8.136470] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.141881] systemd[1]: Starting Address configuration of eth1... lb # [ 8.146343] systemd[1]: Starting Extra networking commands.... lb # [ 8.147151] systemd[1]: Started User Login Management. lb # [ 8.292385] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.168547] systemd[1]: Starting linger-users.service... worker2 # [ 8.210052] network-addresses-eth1-start[617]: adding address 192.168.1.4/24... done worker2 # [ 8.226854] network-addresses-eth1-start[617]: adding address 2001:db8:1::4/64... done lb # [ 8.329983] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.250065] network-addresses-eth1-start[626]: adding address 192.168.1.3/24... done worker2 # [ 8.251114] systemd[1]: Finished Address configuration of eth1. lb # [ 8.221796] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.224580] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.263155] network-addresses-eth1-start[626]: adding address 2001:db8:1::3/64... done client # [ 8.322173] ppdev: user-space parallel port driver client # [ 8.391239] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.392129] Console: switching to colour frame buffer device 160x50 lb # [ 8.241100] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.279075] systemd[1]: Finished Address configuration of eth1. client # [ 8.401411] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.412979] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 8.226982] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.282511] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.288613] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.290476] systemd[1]: Stopped Virtual Console Setup. client # [ 8.296610] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.317439] dhcpcd[633]: dhcpcd-10.3.2 starting worker1 # [ 8.323248] dhcpcd[689]: dev: loaded udev worker2 # [ 8.322029] systemd-vconsole-setup[600]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.294065] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.331169] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.332732] systemd[1]: Reached target Network. worker2 # [ 8.327792] systemd[1]: Finished Virtual Console Setup. worker1 # [ 8.335539] systemd[1]: Starting Permit User Sessions... lb # [ 8.300656] systemd[1]: Finished linger-users.service. worker1 # [ 8.473706] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 8.474313] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.337315] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.338781] systemd[1]: Reached target Network. worker2 # [ 8.343888] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.367636] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.503828] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.373328] dhcpcd[639]: dhcpcd-10.3.2 starting worker2 # [ 8.378351] dhcpcd[688]: dev: loaded udev worker2 # [ 8.390330] systemd[1]: Finished Permit User Sessions. lb # [ 8.359216] network-addresses-eth1-start[645]: adding address 192.168.1.2/24... done worker2 # [ 8.391738] systemd-logind[539]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 8.394344] systemd[1]: Started Getty on tty1. worker2 # [ 8.397310] systemd[1]: Reached target Login Prompts. worker2 # [ 8.400160] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.401973] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.403502] systemd[1]: Stopping Virtual Console Setup... client # [ 8.532805] kvm_amd: TSC scaling supported worker2 # [ 8.404550] systemd[1]: Starting Virtual Console Setup... client # [ 8.533654] kvm_amd: Nested Virtualization enabled client # [ 8.534810] kvm_amd: Nested Paging enabled client # [ 8.535375] kvm_amd: LBR virtualization supported client # [ 8.535858] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.536774] kvm_amd: Virtual GIF supported client # [ 8.537336] kvm_amd: Virtual NMI enabled worker1 # [ 8.416661] systemd[1]: Finished Permit User Sessions. worker2 # [ 8.545681] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.546100] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.420888] systemd[1]: Started Getty on tty1. lb # [ 8.385846] network-addresses-eth1-start[645]: adding address 2001:db8:1::2/64... done worker1 # [ 8.424598] systemd[1]: Reached target Login Prompts. worker1 # [ 8.564477] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.575425] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.576128] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.577927] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 8.578785] cfg80211: failed to load regulatory.db worker2 # [ 8.574688] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.584880] EDAC MC: Ver: 3.0.0 worker1 # [ 8.603962] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.432781] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.470499] dhcpcd[689]: eth0: waiting for carrier worker1 # [ 8.471296] dhcpcd[689]: eth0: carrier acquired worker1 # [ 8.475880] dhcpcd[689]: DUID 00:01:00:01:32:45:23:ca:52:54:00:12:34:56 worker1 # [ 8.476895] dhcpcd[689]: eth0: IAID 00:12:34:56 worker1 # [ 8.477598] dhcpcd[689]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 8.500081] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.678759] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.519727] dhcpcd[665]: dhcpcd-10.3.2 starting lb # [ 8.664016] kvm_amd: TSC scaling supported lb # [ 8.666003] kvm_amd: Nested Virtualization enabled lb # [ 8.666542] kvm_amd: Nested Paging enabled lb # [ 8.666939] kvm_amd: LBR virtualization supported lb # [ 8.668700] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 8.669776] kvm_amd: Virtual GIF supported lb # [ 8.670636] kvm_amd: Virtual NMI enabled lb # [ 8.537599] dhcpcd[720]: dev: loaded udev client # [ 8.591577] systemd[1]: Finished register-nix-paths.service. lb # [ 8.565329] systemd[1]: Finished Extra networking commands.. lb # [ 8.566141] systemd[1]: Reached target Network. worker2 # [ 8.731829] kvm_amd: TSC scaling supported worker2 # [ 8.732433] kvm_amd: Nested Virtualization enabled worker2 # [ 8.732874] kvm_amd: Nested Paging enabled worker2 # [ 8.733585] kvm_amd: LBR virtualization supported worker2 # [ 8.734016] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.734718] kvm_amd: Virtual GIF supported worker2 # [ 8.735104] kvm_amd: Virtual NMI enabled lb # [ 8.574140] systemd[1]: Starting PostgreSQL Server... lb # [ 8.709938] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.710396] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.743487] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.744151] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 8.580159] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.748278] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.610294] systemd-vconsole-setup[417]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.749071] cfg80211: failed to load regulatory.db client # [ 8.614081] systemd[1]: Finished Virtual Console Setup. client # [ 8.615427] systemd[1]: Reached target System Initialization. client # [ 8.616861] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.618259] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.620145] systemd[1]: Reached target Timer Units. client # [ 8.620843] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.621723] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.622554] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.623725] systemd[1]: Reached target Socket Units. client # [ 8.625150] systemd[1]: Reached target Basic System. client # [ 8.626608] systemd[1]: Started backdoor.service. client # [ 8.629541] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.634164] systemd[1]: Starting nftables firewall... client # [ 8.640125] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.645911] systemd[1]: Starting Post-Boot Actions... lb # [ 8.755377] EDAC MC: Ver: 3.0.0 worker2 # [ 8.786998] EDAC MC: Ver: 3.0.0 worker2 # [ 8.789482] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.659257] dhcpcd[688]: eth0: waiting for carrier worker2 # [ 8.661210] dhcpcd[688]: eth0: carrier acquired client # [ 8.663641] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.668095] dhcpcd[688]: DUID 00:01:00:01:32:45:23:cb:52:54:00:12:34:56 worker2 # [ 8.669133] dhcpcd[688]: eth0: IAID 00:12:34:56 worker2 # [ 8.669770] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 8.674667] systemd[1]: Starting resolvconf update... lb # [ 8.651171] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.678173] systemd[1]: Finished Permit User Sessions. client # [ 8.705376] systemd[1]: Starting D-Bus System Message Bus... client # connecting to host... lb # [ 8.685120] systemd[1]: Started Getty on tty1. lb # [ 8.685769] systemd[1]: Reached target Login Prompts. worker2 # [ 8.716657] systemd-vconsole-setup[692]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.720358] systemd[1]: Finished Virtual Console Setup. client # [ 8.721561] nsncd[425]: Sep 22 11:32:27.562 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.731362] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.732900] systemd[1]: Finished Post-Boot Actions. client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 8.763054] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.766369] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.781831] systemd[1]: Starting User Login Management... client: connected to guest root shell lb # [ 8.887817] cfg80211: Loading compiled-in X.509 certificates for regulatory database client: (connecting took 9.44 seconds) worker1 # [ 8.775489] dhcpcd[689]: eth0: soliciting a DHCP lease client: (finished: waiting for the VM to finish booting, in 9.44 seconds) worker1 # [ 8.918951] NET: Registered PF_PACKET protocol family worker1 # [ 8.788484] dhcpcd[689]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 8.790149] dhcpcd[689]: eth0: probing address 10.0.2.15/24 client # [ 8.789080] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.912069] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 8.912800] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 8.915598] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 8.916447] cfg80211: failed to load regulatory.db client # [ 8.876938] dbus-broker-launch[434]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.986856] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.855169] dhcpcd[720]: eth0: waiting for carrier lb # [ 8.856244] dhcpcd[720]: eth0: carrier acquired client # [ 8.894154] dbus-broker-launch[434]: NSS returned no entry for 'systemd-timesync' client # [ 8.895751] dbus-broker-launch[434]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.872298] dhcpcd[720]: DUID 00:01:00:01:32:45:23:cb:52:54:00:12:34:56 lb # [ 8.873194] dhcpcd[720]: eth0: IAID 00:12:34:56 lb # [ 8.873852] dhcpcd[720]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.888360] postgresql-pre-start[737]: The files belonging to this database system will be owned by user "postgres". lb # [ 8.890100] postgresql-pre-start[737]: This user must also own the server process. lb # [ 8.896329] postgresql-pre-start[737]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 8.897505] postgresql-pre-start[737]: The default database encoding has accordingly been set to "UTF8". lb # [ 8.898665] postgresql-pre-start[737]: The default text search configuration will be set to "english". lb # [ 8.899816] postgresql-pre-start[737]: Data page checksums are enabled. lb # [ 8.900981] postgresql-pre-start[737]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 8.902301] postgresql-pre-start[737]: creating subdirectories ... ok lb # [ 8.903440] postgresql-pre-start[737]: selecting dynamic shared memory implementation ... posix client # [ 8.941153] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.942873] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.944236] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.946234] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.949085] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.951923] systemd[1]: Started D-Bus System Message Bus. client # [ 8.953966] systemd-logind[455]: New seat seat0. client # [ 8.959397] systemd-logind[455]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.960670] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.963064] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.966135] systemd-logind[455]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.967368] systemd-logind[455]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.975664] systemd[1]: Started User Login Management. client # [ 8.995176] dbus-broker-launch[434]: Ready client # [ 9.000408] systemd[1]: Starting linger-users.service... client # [ 9.006356] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.984381] systemd-vconsole-setup[655]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.991719] systemd[1]: Finished Virtual Console Setup. lb # [ 8.997503] postgresql-pre-start[737]: selecting default "max_connections" ... 100 client # [ 9.057230] systemd[1]: Finished resolvconf update. client # [ 9.066871] systemd[1]: Starting DHCP Client... client # [ 9.068530] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.070276] nsncd[520]: Sep 22 11:32:27.911 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.073227] systemd[1]: linger-users.service: Deactivated successfully. client # [ 9.076315] systemd[1]: Finished linger-users.service. client # [ 9.079403] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.054543] postgresql-pre-start[737]: selecting default "shared_buffers" ... 128MB client # [ 9.082079] systemd[1]: Reached target User and Group Name Lookups. client # [ 9.174887] dhcpcd[551]: dhcpcd-10.3.2 starting client # [ 9.180388] dhcpcd[558]: dev: loaded udev client # [ 9.322762] 8021q: 802.1Q VLAN Support v1.8 client # [ 9.218187] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 9.398963] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 9.283281] dhcpcd[688]: eth0: soliciting a DHCP lease client # [ 9.414305] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.415006] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 9.418232] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.419104] cfg80211: failed to load regulatory.db worker2 # [ 9.424573] NET: Registered PF_PACKET protocol family worker2 # [ 9.295090] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.297156] dhcpcd[688]: eth0: probing address 10.0.2.15/24 client # [ 9.321836] systemd[1]: Finished nftables firewall. client # [ 9.323176] systemd[1]: Reached target Preparation for Network. client # [ 9.328084] systemd[1]: Starting Address configuration of eth1... client # [ 9.464298] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.333269] dhcpcd[558]: eth0: waiting for carrier client # [ 9.334265] dhcpcd[558]: eth0: carrier acquired client # [ 9.336163] systemd[1]: Starting Extra networking commands.... client # [ 9.344583] dhcpcd[558]: DUID 00:01:00:01:32:45:23:cc:52:54:00:12:34:56 client # [ 9.345528] dhcpcd[558]: eth0: IAID 00:12:34:56 client # [ 9.346438] dhcpcd[558]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 9.508727] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 9.387724] network-addresses-eth1-start[581]: adding address 192.168.1.1/24... done client # [ 9.395308] network-addresses-eth1-start[581]: adding address 2001:db8:1::1/64... done client # [ 9.408692] systemd[1]: Finished Address configuration of eth1. client # [ 9.435984] systemd[1]: Finished Extra networking commands.. client # [ 9.438208] systemd[1]: Reached target Network. client # [ 9.440313] systemd[1]: Starting Permit User Sessions... client # [ 9.457625] systemd[1]: Finished Permit User Sessions. client # [ 9.461275] systemd[1]: Started Getty on tty1. client # [ 9.461966] systemd[1]: Reached target Login Prompts. lb # [ 9.614568] postgresql-pre-start[737]: selecting default time zone ... UTC lb # [ 9.617260] postgresql-pre-start[737]: creating configuration files ... ok lb # [ 9.783586] postgresql-pre-start[737]: running bootstrap script ... ok client: (finished: waiting for unit network-addresses-eth1.service, in 10.69 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.206438] postgresql-pre-start[737]: performing post-bootstrap initialization ... ok worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.02 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service lb # [ 10.358357] postgresql-pre-start[737]: syncing data to disk ... ok lb # [ 10.359394] postgresql-pre-start[737]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.361263] postgresql-pre-start[737]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.363083] postgresql-pre-start[737]: Success. You can now start the database server using: lb # [ 10.364077] postgresql-pre-start[737]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 10.398976] dhcpcd[720]: eth0: soliciting an IPv6 router lb # [ 10.400196] dhcpcd[720]: eth0: Router Advertisement from fe80::2 lb # [ 10.400959] dhcpcd[720]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 10.402448] dhcpcd[720]: eth0: adding route to fec0::/64 lb # [ 10.403209] dhcpcd[720]: eth0: adding default route via fe80::2 lb # [ 10.440416] postgres[780]: [780] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.443058] postgres[780]: [780] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.444126] postgres[780]: [780] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.447090] postgres[780]: [780] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 10.458333] postgres[789]: [789] LOG: database system was shut down at 2026-09-22 11:32:28 GMT lb # [ 10.464454] postgres[780]: [780] LOG: database system is ready to accept connections lb # [ 10.470358] systemd[1]: Started PostgreSQL Server. lb # [ 10.474388] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 10.546458] dhcpcd[720]: eth0: soliciting a DHCP lease lb # [ 10.695189] NET: Registered PF_PACKET protocol family lb # [ 10.567972] dhcpcd[720]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 10.570653] dhcpcd[720]: eth0: probing address 10.0.2.15/24 worker1 # [ 10.623957] dhcpcd[689]: eth0: soliciting an IPv6 router worker1 # [ 10.625253] dhcpcd[689]: eth0: Router Advertisement from fe80::2 worker1 # [ 10.626166] dhcpcd[689]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.627045] dhcpcd[689]: eth0: adding route to fec0::/64 worker1 # [ 10.627751] dhcpcd[689]: eth0: adding default route via fe80::2 lb # [ 10.636859] postgresql-setup-start[800]: CREATE DATABASE lb # [ 10.664562] postgresql-setup-start[807]: CREATE ROLE lb # [ 10.676764] postgresql-setup-start[809]: ALTER DATABASE lb # [ 10.680915] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.682775] systemd[1]: Reached target PostgreSQL. client # [ 10.872812] dhcpcd[558]: eth0: soliciting an IPv6 router client # [ 10.875778] dhcpcd[558]: eth0: Router Advertisement from fe80::2 client # [ 10.877937] dhcpcd[558]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.880215] dhcpcd[558]: eth0: adding route to fec0::/64 client # [ 10.882081] dhcpcd[558]: eth0: adding default route via fe80::2 client # [ 11.149709] dhcpcd[558]: eth0: soliciting a DHCP lease client # [ 11.300536] NET: Registered PF_PACKET protocol family client # [ 11.174699] dhcpcd[558]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 11.178354] dhcpcd[558]: eth0: probing address 10.0.2.15/24 worker2 # [ 11.411940] dhcpcd[688]: eth0: soliciting an IPv6 router worker2 # [ 11.414946] dhcpcd[688]: eth0: Router Advertisement from fe80::2 worker2 # [ 11.417135] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 11.419402] dhcpcd[688]: eth0: adding route to fec0::/64 worker2 # [ 11.421339] dhcpcd[688]: eth0: adding default route via fe80::2 worker1 # [ 13.480414] dhcpcd[689]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 13.483979] dhcpcd[689]: eth0: adding route to 10.0.2.0/24 worker1 # [ 13.486499] dhcpcd[689]: eth0: adding default route via 10.0.2.2 worker1 # [ 13.559940] systemd[1]: Started DHCP Client. worker1 # [ 13.561631] systemd[1]: Reached target Multi-User System. worker1 # [ 13.562826] systemd[1]: Startup finished in 858ms (kernel) + 3.601s (initrd) + 9.102s (userspace) = 13.562s. worker2 # [ 14.386307] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 14.389389] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 worker2 # [ 14.391647] dhcpcd[688]: eth0: adding default route via 10.0.2.2 worker2 # [ 14.476438] systemd[1]: Started DHCP Client. worker2 # [ 14.478386] systemd[1]: Reached target Multi-User System. worker2 # [ 14.479299] systemd[1]: Startup finished in 851ms (kernel) + 3.620s (initrd) + 10.005s (userspace) = 14.478s. lb # [ 16.203932] dhcpcd[720]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.206638] dhcpcd[720]: eth0: adding route to 10.0.2.0/24 lb # [ 16.209310] dhcpcd[720]: eth0: adding default route via 10.0.2.2 lb # [ 16.289311] systemd[1]: Started DHCP Client. lb # [ 16.290851] systemd[1]: Reached target Network is Online. lb # [ 16.294330] systemd[1]: Started Envoy reverse proxy. lb # [ 16.299338] systemd[1]: Started mock-oidc.service. lb # [ 16.454479] mock-oidc-server[919]: Mock OIDC Server running lb # [ 16.455566] mock-oidc-server[919]: OIDC Address: 192.168.1.2:8080 lb # [ 16.457218] mock-oidc-server[919]: Issue Address: 0.0.0.0:8081 lb # [ 16.457949] mock-oidc-server[919]: Issuer: http://192.168.1.2:8080/oidc lb # [ 16.458795] mock-oidc-server[919]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 16.459806] mock-oidc-server[919]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 16.460976] mock-oidc-server[919]: Issue tokens: http://0.0.0.0:8081/issue?sub=... client # [ 16.567196] dhcpcd[558]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 16.568151] dhcpcd[558]: eth0: adding route to 10.0.2.0/24 client # [ 16.568867] dhcpcd[558]: eth0: adding default route via 10.0.2.2 client # [ 16.624337] systemd[1]: Started DHCP Client. client # [ 16.626749] systemd[1]: Reached target Multi-User System. client # [ 16.627880] systemd[1]: Startup finished in 851ms (kernel) + 4.515s (initrd) + 11.260s (userspace) = 16.627s. lb # [ 16.620220] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 16.621982] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 16.623382] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 16.625054] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 16.627694] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 16.637981] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 16.645069] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 16.647128] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 16.649263] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 16.651240] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 16.652950] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 16.655606] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 16.661468] envoy[918]: [2026-09-22 11:32:34.971][918][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 16.663777] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 16.666456] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 16.668056] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 16.670586] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.672808] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 16.675098] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 16.677333] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 16.680584] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 16.687499] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 16.689575] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 16.693302] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 16.695156] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 16.698163] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 16.700589] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 16.702808] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 16.705102] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 16.707035] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 16.709633] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 16.711507] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 16.713336] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 16.715961] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 16.719160] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 16.720757] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 16.725145] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 16.726940] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 16.728588] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 16.730825] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 16.733736] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 16.735924] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 16.739090] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 16.741552] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 16.743150] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 16.746300] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 16.747832] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 16.750679] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 16.752354] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 16.753961] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 16.758839] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 16.761865] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 16.764681] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 16.768535] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 16.770147] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 16.772192] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.774394] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 16.776416] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 16.778626] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 16.780584] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 16.784098] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 16.785541] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 16.790046] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 16.791592] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 16.800334] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 16.806940] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 16.809755] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 16.811906] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 16.816186] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 16.818508] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 16.820430] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 16.823916] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 16.825674] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 16.827759] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 16.830600] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 16.834681] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 16.836963] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 16.838614] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 16.841497] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 16.843876] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 16.846930] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.849638] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 16.852879] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 16.854334] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 16.856210] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 16.858036] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 16.860076] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 16.862491] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.864300] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 16.867125] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 16.868801] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 16.875206] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 16.886192] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 16.887740] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 16.889455] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 16.891125] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 16.892846] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 16.894942] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 16.899091] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 16.904275] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 16.906334] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 16.908739] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 16.910343] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 16.914509] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 16.921179] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 16.922805] envoy[918]: [2026-09-22 11:32:34.972][918][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 16.948277] envoy[918]: [2026-09-22 11:32:35.032][918][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 16.949682] envoy[918]: [2026-09-22 11:32:35.065][918][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 16.962184] envoy[918]: [2026-09-22 11:32:35.065][918][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 16.963516] envoy[918]: [2026-09-22 11:32:35.065][918][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 16.970854] envoy[918]: [2026-09-22 11:32:35.065][918][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 16.982851] envoy[918]: [2026-09-22 11:32:35.334][918][info][main] [source/server/server.cc:968] runtime: {} lb # [ 16.985741] envoy[918]: [2026-09-22 11:32:35.338][918][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 16.987292] envoy[918]: [2026-09-22 11:32:35.338][918][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 16.989442] envoy[918]: [2026-09-22 11:32:35.341][918][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 16.991346] envoy[918]: [2026-09-22 11:32:35.344][918][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 16.993106] envoy[918]: [2026-09-22 11:32:35.344][918][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 16.995329] envoy[918]: [2026-09-22 11:32:35.344][918][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 17.032801] envoy[918]: [2026-09-22 11:32:35.384][918][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 17.066634] systemd[1]: Reached target Network is Online. worker2 # [ 17.072793] systemd[1]: Starting scheduler-token.service... lb # [ 17.041958] envoy[918]: [2026-09-22 11:32:35.394][918][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker1 # [ 17.078120] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 17.045640] envoy[918]: [2026-09-22 11:32:35.398][918][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 17.048589] envoy[918]: [2026-09-22 11:32:35.401][918][info][main] [source/server/server.cc:1077] starting main dispatch loop lb # [ 17.089350] rustfs-bucket-start[934]: mb s3://farm lb # [ 17.095449] systemd[1]: Finished rustfs-bucket.service. lb # [ 17.104130] systemd[1]: Starting niks3 server... worker2 # [ 17.139967] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.143475] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.146325] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 70ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 17.154465] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 17.194047] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 17.204624] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 17.207205] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 17.219183] nix-grpc-daemon[780]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 17.220688] nix-grpc-daemon[780]: E0000 00:00:1790076755.583315 780 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 17.226569] nix-grpc-daemon[780]: E0000 00:00:1790076755.591103 780 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 17.229978] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 17.231627] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 17.237977] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 17.247445] nix-grpc-daemon[780]: E0000 00:00:1790076755.611639 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.250091] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc lb # [ 17.219539] postgres[954]: [954] ERROR: relation "goose_db_version" does not exist at character 36 worker2 # [ 17.252463] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 17.223139] postgres[954]: [954] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 17.227155] envoy[918]: [2026-09-22 11:32:35.579][918][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 17.228682] envoy[918]: [2026-09-22 11:32:35.579][918][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 17.260741] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 17.265780] nix-grpc-daemon[780]: E0000 00:00:1790076755.630244 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 17.230286] envoy[918]: [2026-09-22 11:32:35.579][918][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 17.262382] nix-grpc-daemon[783]: E0000 00:00:1790076756.426693 783 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 17.269142] nix-grpc-daemon[780]: E0000 00:00:1790076755.632402 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.233775] envoy[918]: [2026-09-22 11:32:35.586][918][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 17.267815] nix-grpc-daemon[783]: E0000 00:00:1790076756.433920 783 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.271742] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 17.274225] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 17.281053] nix-grpc-daemon[780]: E0000 00:00:1790076755.645500 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 17.253324] niks3-server[949]: 2026/09/22 11:32:35 OK 20241026095416_initial_model.sql (14.7ms) worker2 # [ 17.287907] nix-grpc-daemon[783]: E0000 00:00:1790076756.453429 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.257747] niks3-server[949]: 2026/09/22 11:32:35 OK 20251210153512_drop_unused_gin_index.sql (4.92ms) worker1 # [ 17.295310] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.299754] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 17.264206] niks3-server[949]: 2026/09/22 11:32:35 OK 20251218171726_add_pins.sql (6.37ms) lb # [ 17.268851] niks3-server[949]: 2026/09/22 11:32:35 OK 20260628120000_add_object_size_and_stats.sql (4.64ms) lb # [ 17.273760] niks3-server[949]: 2026/09/22 11:32:35 OK 20260905000000_add_claims.sql (4.88ms) worker2 # [ 17.306230] nix-grpc-daemon[783]: E0000 00:00:1790076756.472467 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 17.277608] niks3-server[949]: 2026/09/22 11:32:35 OK 20260920000000_drop_claims.sql (3.74ms) lb # [ 17.278822] niks3-server[949]: 2026/09/22 11:32:35 goose: successfully migrated database to version: 20260920000000 worker2 # [ 17.309747] nix-grpc-daemon[783]: E0000 00:00:1790076756.474738 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.282695] niks3-server[949]: 2026/09/22 11:32:35 OK 1_commit_pending_closure.sql (5.1ms) lb # [ 17.285433] niks3-server[949]: 2026/09/22 11:32:35 OK 2_object_stats_trigger.sql (2.78ms) lb # [ 17.286685] niks3-server[949]: 2026/09/22 11:32:35 goose: up to current file version: 2 lb # [ 17.289848] niks3-server[949]: 2026/09/22 11:32:35 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key worker2 # [ 17.321599] nix-grpc-daemon[783]: E0000 00:00:1790076756.487781 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.331289] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.332906] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 17.319638] niks3-server[949]: 2026/09/22 11:32:35 INFO Read proxy enabled — serving cache objects from S3 lb # [ 17.321023] niks3-server[949]: 2026/09/22 11:32:35 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 17.326225] systemd[1]: Started niks3 server. lb # [ 17.326862] niks3-server[949]: 2026/09/22 11:32:35 INFO systemd watchdog enabled interval=15s lb # [ 17.328034] systemd[1]: Reached target Multi-User System. lb # [ 17.329896] systemd[1]: Startup finished in 865ms (kernel) + 3.595s (initrd) + 12.868s (userspace) = 17.329s. lb # [ 17.332118] niks3-server[949]: 2026/09/22 11:32:35 INFO Starting HTTP server address=0.0.0.0:5751 worker1 # [ 17.500542] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.502356] nix-grpc-daemon[780]: ts=2026-09-22T11:32:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.534665] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.538619] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.703301] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.707188] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.739809] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.743654] nix-grpc-daemon[783]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.908179] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.912173] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.944915] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.948789] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.112808] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.116748] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 7.84 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 18.150227] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.154125] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.02 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 18.180159] envoy[918]: conn peer=[::1]:60384 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker2 # [ 18.296280] systemd[1]: Starting scheduler-token.service... worker1 # [ 18.317952] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.320930] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.336635] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 18.338324] systemd[1]: Finished scheduler-token.service. worker2 # [ 18.340328] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 42ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 18.354929] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.356691] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1 # [ 18.519315] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.522552] nix-grpc-daemon[780]: ts=2026-09-22T11:32:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.558288] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.562353] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.723680] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.727783] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.763827] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.767677] nix-grpc-daemon[783]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.928459] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.932371] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.968933] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.972709] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.133100] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.136240] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.170983] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.174919] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.338356] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.341437] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.377504] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.380609] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 19.539425] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.543212] nix-grpc-daemon[780]: ts=2026-09-22T11:32:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.578676] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.582515] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.743911] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.747815] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.783787] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.787608] nix-grpc-daemon[783]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.948906] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.952784] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.988495] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.990636] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.153719] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.157697] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.191540] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.193278] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.359333] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.362884] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.395908] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.399257] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 20.560915] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.564870] nix-grpc-daemon[780]: ts=2026-09-22T11:32:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.597172] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.601133] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.765881] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.769824] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.802298] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.806149] nix-grpc-daemon[783]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.970735] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.975330] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.007070] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.009363] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.176220] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.180719] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.210278] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.212609] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.382396] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.386596] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.414496] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.416153] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 21.587586] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.591482] nix-grpc-daemon[780]: ts=2026-09-22T11:32:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2 # [ 21.617452] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.621373] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.792260] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.796194] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.822092] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.823802] nix-grpc-daemon[783]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.997171] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.001069] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.024587] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.026274] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.201891] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.205860] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.227147] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.228862] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.407515] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.411228] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.430215] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.431745] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 22.609088] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.612801] nix-grpc-daemon[780]: ts=2026-09-22T11:32:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.632849] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.634763] nix-grpc-daemon[783]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 22.813646] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.817505] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.835550] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.837311] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.018395] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.022324] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.038160] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.039888] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.222724] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.224475] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.240624] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.242447] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.425356] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.427050] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.443850] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.445238] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.627699] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.629514] nix-grpc-daemon[780]: ts=2026-09-22T11:32:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 23.644552] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.646286] nix-grpc-daemon[783]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 23.830438] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.834400] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.846970] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.848702] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.035381] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.039542] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.049443] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.051190] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.239796] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.241581] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.253401] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.256618] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.442367] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.445415] nix-grpc-daemon[780]: ts=2026-09-22T11:32:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.455850] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.458955] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.644694] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.646423] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.656633] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.660357] nix-grpc-daemon[783]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 24.847517] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.851405] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.861403] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.865455] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.052167] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.056088] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.066952] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.070978] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.256820] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.260681] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.272577] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.276568] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.461477] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.463226] nix-grpc-daemon[780]: ts=2026-09-22T11:32:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.479484] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.482637] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.663809] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.665582] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.680607] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.684779] nix-grpc-daemon[783]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 25.866164] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.867826] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.886337] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.890338] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.068877] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.072826] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.091415] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.095208] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.273615] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.279667] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.296314] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.300489] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.480438] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.482181] nix-grpc-daemon[780]: ts=2026-09-22T11:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.503113] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.506329] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.682784] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.684588] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.704911] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.708092] nix-grpc-daemon[783]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 26.885176] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.886957] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.906340] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.910237] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.087526] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.089287] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.111548] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.115416] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.289596] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.291260] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.317448] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.322463] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.370339] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_take_over lb # [ 27.340898] niks3-server[949]: 2026/09/22 11:32:45 INFO lead: acquired remote=192.168.1.4:38022 worker1 # [ 27.492210] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.494037] nix-grpc-daemon[780]: ts=2026-09-22T11:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.523493] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.526985] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.694612] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.696259] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.728647] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.732607] nix-grpc-daemon[783]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 27.896934] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.898746] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.933879] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.937930] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.099323] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.101144] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.139346] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.143327] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.301443] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.303212] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.344166] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.358390] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 28.361421] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:55828 worker2 # [ 28.365890] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 28.504062] nix-grpc-daemon[780]: ts=2026-09-22T11:32:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.501314] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:55828 worker2 # [ 28.504935] nix-grpc-daemon[783]: ts=2026-09-22T11:32:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.93 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 29.536178] nix-grpc-daemon[780]: ts=2026-09-22T11:32:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 29.540752] systemd[1]: Started Nix Daemon. worker1 # [ 29.631943] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 29.647790] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5) worker1 # [ 29.727441] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5) worker1 # [ 29.773858] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 3/5) worker1 # [ 29.776771] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 660 ms (attempt 4/5) worker1 # [ 30.441618] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 30.443536] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 30.460339] nix-grpc-daemon[780]: ts=2026-09-22T11:32:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 30.466887] nix-grpc-daemon[780]: ts=2026-09-22T11:32:48Z level=debug event=path_info_miss path=6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test error="error: path '/nix/store/6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 30.470622] nix-grpc-daemon[780]: ts=2026-09-22T11:32:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 30.475492] nix-grpc-daemon[780]: ts=2026-09-22T11:32:48Z level=debug event=path_info_miss path=6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test error="error: path '/nix/store/6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.04 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker2 # [ 30.683357] nix-grpc-daemon[783]: ts=2026-09-22T11:32:49Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:55832 worker2 # [ 30.694496] systemd[1]: Started Nix Daemon. worker2 # [ 30.807334] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 30.822140] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5) worker2 # [ 30.833362] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5) worker2 # [ 30.994154] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 320 ms (attempt 3/5) worker2 # [ 31.315184] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 703 ms (attempt 4/5) worker2 # [ 32.024346] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 32.031230] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 32.065397] nix-grpc-daemon[780]: ts=2026-09-22T11:32:50Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 32.068718] nix-grpc-daemon[780]: ts=2026-09-22T11:32:50Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46202 worker1 # [ 32.077232] nix-grpc-daemon[780]: ts=2026-09-22T11:32:50Z level=debug event=path_info_miss path=6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test error="error: path '/nix/store/6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 32.081655] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:55832 worker2 # [ 32.093147] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=path_info_miss path=6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test error="error: path '/nix/store/6zdlf97nxsya8j2z50jj0v2glbqyi1nw-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker1 # [ 32.282909] nix-grpc-daemon[780]: ts=2026-09-22T11:32:50Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 32.424965] nix-grpc-daemon[780]: ts=2026-09-22T11:32:50Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.10 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 32.570759] nix-grpc-daemon[780]: ts=2026-09-22T11:32:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46202 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 32.575328] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 32.606441] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 32.612260] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 32.663244] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 32.677164] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 client # copying 1 paths to 'lb:50051'... worker2 # [ 32.690292] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker2 # [ 32.716273] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 32.744825] nix-grpc-daemon[783]: ts=2026-09-22T11:32:51Z level=info event=niks3_push_started pid=882 worker2 # [ 32.897225] nix-grpc-daemon[882]: time=2026-09-22T11:32:52.062Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 32.987092] nix-daemon[867]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker2 # [ 33.000565] nix-daemon[867]: reaped child process 897, status = succeeded worker2 # [ 33.082591] nix-daemon[867]: accepted connection from pid 899, user nix-grpc-daemon (trusted) worker2 # [ 33.096036] nix-daemon[867]: reaped child process 902, status = succeeded lb # [ 33.069896] niks3-server[949]: 2026/09/22 11:32:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 33.109710] nix-grpc-daemon[882]: time=2026-09-22T11:32:52.276Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 33.112802] nix-grpc-daemon[882]: time=2026-09-22T11:32:52.277Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 33.116635] niks3-server[949]: 2026/09/22 11:32:51 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 33.122138] niks3-server[949]: 2026/09/22 11:32:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 33.133327] niks3-server[949]: 2026/09/22 11:32:51 INFO Signed narinfos id=1 count=1 worker2 # [ 33.166670] nix-grpc-daemon[882]: time=2026-09-22T11:32:52.332Z level=INFO msg="Uploading 1 narinfos" lb # [ 33.139062] niks3-server[949]: 2026/09/22 11:32:51 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 33.154524] niks3-server[949]: 2026/09/22 11:32:51 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 33.160304] niks3-server[949]: 2026/09/22 11:32:51 INFO Completed upload id=1 worker2 # [ 33.192071] nix-grpc-daemon[882]: time=2026-09-22T11:32:52.358Z level=INFO msg="Upload complete. (291ms)" worker2 # [ 33.198569] nix-grpc-daemon[783]: ts=2026-09-22T11:32:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 33.205558] nix-grpc-daemon[783]: ts=2026-09-22T11:32:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 33.214144] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 33.222824] nix-daemon[867]: reaped child process 880, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker2 # [ 33.227096] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 34.294179] nix-daemon[867]: reaped child process 906, status = succeeded worker2 # [ 34.343978] nix-daemon[867]: accepted connection from pid 922, user nix-grpc-daemon (trusted) lb # [ 34.335700] niks3-server[949]: 2026/09/22 11:32:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 34.368436] nix-daemon[867]: reaped child process 925, status = succeeded worker2 # [ 34.378871] nix-grpc-daemon[882]: time=2026-09-22T11:32:53.544Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 34.382063] nix-grpc-daemon[882]: time=2026-09-22T11:32:53.546Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 34.410293] niks3-server[949]: 2026/09/22 11:32:52 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 34.414078] niks3-server[949]: 2026/09/22 11:32:52 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 34.417279] niks3-server[949]: 2026/09/22 11:32:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 34.420376] niks3-server[949]: 2026/09/22 11:32:52 INFO Signed narinfos id=2 count=1 worker2 # [ 34.452934] nix-grpc-daemon[882]: time=2026-09-22T11:32:53.618Z level=INFO msg="Uploading 1 narinfos" lb # [ 34.433110] niks3-server[949]: 2026/09/22 11:32:52 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 34.443473] niks3-server[949]: 2026/09/22 11:32:52 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 34.449233] niks3-server[949]: 2026/09/22 11:32:52 INFO Completed upload id=2 worker2 # [ 34.480056] nix-grpc-daemon[882]: time=2026-09-22T11:32:53.646Z level=INFO msg="Upload complete. (245ms)" lb # [ 34.451989] niks3-server[949]: 2026/09/22 11:32:52 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls worker2 # [ 34.491198] nix-grpc-daemon[783]: ts=2026-09-22T11:32:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker2 # [ 34.502501] nix-grpc-daemon[783]: ts=2026-09-22T11:32:53Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 34.507468] nix-grpc-daemon[783]: ts=2026-09-22T11:32:53Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 34.518588] nix-daemon[867]: reaped child process 904, status = succeeded worker2 # [ 34.545900] nix-grpc-daemon[783]: ts=2026-09-22T11:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 34.556533] nix-grpc-daemon[783]: ts=2026-09-22T11:32:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 34.568949] nix-grpc-daemon[882]: time=2026-09-22T11:32:53.735Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker2 # [ 34.575876] nix-grpc-daemon[783]: ts=2026-09-22T11:32:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 34.585144] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 34.682688] nix-daemon[867]: accepted connection from pid 932, user nix-grpc-daemon (trusted) worker2 # [ 34.697954] nix-daemon[867]: reaped child process 935, status = succeeded worker2 # [ 34.777560] nix-daemon[867]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker2 # [ 34.792165] nix-daemon[867]: reaped child process 940, status = succeeded lb # [ 34.764676] niks3-server[949]: 2026/09/22 11:32:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 34.803037] nix-grpc-daemon[882]: time=2026-09-22T11:32:53.969Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 34.804952] nix-grpc-daemon[882]: time=2026-09-22T11:32:53.970Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 34.796524] niks3-server[949]: 2026/09/22 11:32:53 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 34.806131] niks3-server[949]: 2026/09/22 11:32:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 34.813143] niks3-server[949]: 2026/09/22 11:32:53 INFO Signed narinfos id=3 count=1 worker2 # [ 34.848316] nix-grpc-daemon[882]: time=2026-09-22T11:32:54.014Z level=INFO msg="Uploading 1 narinfos" lb # [ 34.819254] niks3-server[949]: 2026/09/22 11:32:53 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 34.833285] niks3-server[949]: 2026/09/22 11:32:53 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 34.841286] niks3-server[949]: 2026/09/22 11:32:53 INFO Completed upload id=3 worker2 # [ 34.873057] nix-grpc-daemon[882]: time=2026-09-22T11:32:54.039Z level=INFO msg="Upload complete. (275ms)" lb # [ 34.843358] niks3-server[949]: 2026/09/22 11:32:53 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker2 # [ 34.877398] nix-grpc-daemon[783]: ts=2026-09-22T11:32:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 34.883271] nix-grpc-daemon[783]: ts=2026-09-22T11:32:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 34.894254] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 34.904630] nix-daemon[867]: reaped child process 930, status = succeeded client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... worker2 # [ 34.908307] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 35.724822] nix-daemon[867]: reaped child process 944, status = succeeded worker2 # [ 35.791845] nix-daemon[867]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker2 # [ 35.805795] nix-daemon[867]: reaped child process 963, status = succeeded lb # [ 35.779957] niks3-server[949]: 2026/09/22 11:32:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 35.820217] nix-grpc-daemon[882]: time=2026-09-22T11:32:54.986Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 35.822401] nix-grpc-daemon[882]: time=2026-09-22T11:32:54.987Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 35.821159] niks3-server[949]: 2026/09/22 11:32:54 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 35.832122] niks3-server[949]: 2026/09/22 11:32:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign worker2 # [ 35.870151] nix-grpc-daemon[882]: time=2026-09-22T11:32:55.036Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.840282] niks3-server[949]: 2026/09/22 11:32:54 INFO Signed narinfos id=4 count=1 lb # [ 35.846990] niks3-server[949]: 2026/09/22 11:32:54 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 35.850896] niks3-server[949]: 2026/09/22 11:32:54 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 35.861505] niks3-server[949]: 2026/09/22 11:32:54 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 35.868547] niks3-server[949]: 2026/09/22 11:32:54 INFO Completed upload id=4 worker2 # [ 35.900401] nix-grpc-daemon[882]: time=2026-09-22T11:32:55.066Z level=INFO msg="Upload complete. (186ms)" lb # [ 35.870959] niks3-server[949]: 2026/09/22 11:32:54 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker2 # [ 35.910567] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 35.919422] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 35.924436] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 35.934817] nix-daemon[867]: reaped child process 942, status = succeeded worker2 # [ 35.962877] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 35.975113] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 35.989222] nix-grpc-daemon[882]: time=2026-09-22T11:32:55.155Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 35.998131] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker2 # [ 36.015414] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 36.115481] nix-daemon[867]: accepted connection from pid 969, user nix-grpc-daemon (trusted) worker2 # [ 36.129173] nix-daemon[867]: reaped child process 972, status = succeeded worker2 # [ 36.210785] nix-daemon[867]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker2 # [ 36.224856] nix-daemon[867]: reaped child process 977, status = succeeded lb # [ 36.198870] niks3-server[949]: 2026/09/22 11:32:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 36.239165] nix-grpc-daemon[882]: time=2026-09-22T11:32:55.405Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 36.240591] nix-grpc-daemon[882]: time=2026-09-22T11:32:55.406Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 36.232926] niks3-server[949]: 2026/09/22 11:32:54 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 36.240433] niks3-server[949]: 2026/09/22 11:32:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 36.245953] niks3-server[949]: 2026/09/22 11:32:54 INFO Signed narinfos id=5 count=1 worker2 # [ 36.280894] nix-grpc-daemon[882]: time=2026-09-22T11:32:55.447Z level=INFO msg="Uploading 1 narinfos" lb # [ 36.262875] niks3-server[949]: 2026/09/22 11:32:54 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 36.268745] niks3-server[949]: 2026/09/22 11:32:54 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 36.277569] niks3-server[949]: 2026/09/22 11:32:54 INFO Completed upload id=5 lb # [ 36.279274] niks3-server[949]: 2026/09/22 11:32:54 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker2 # [ 36.310492] nix-grpc-daemon[882]: time=2026-09-22T11:32:55.476Z level=INFO msg="Upload complete. (281ms)" worker2 # [ 36.315436] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 36.322249] nix-grpc-daemon[783]: ts=2026-09-22T11:32:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 36.331133] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 36.342046] nix-daemon[867]: reaped child process 967, status = succeeded client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... worker2 # [ 36.347431] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 37.036301] envoy[918]: conn peer=[2001:db8:1::1]:47396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=362 ms=961 lb # [ 37.040570] envoy[918]: conn peer=[2001:db8:1::1]:47412 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=388 ms=1429 lb # [ 37.043868] envoy[918]: conn peer=[2001:db8:1::1]:47422 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=8 lb # [ 37.047267] envoy[918]: conn peer=[2001:db8:1::1]:47436 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 client # farm-top> LOG-farm-top-t1 worker2 # [ 37.163695] nix-daemon[867]: reaped child process 981, status = succeeded worker2 # [ 37.240584] nix-daemon[867]: accepted connection from pid 997, user nix-grpc-daemon (trusted) worker2 # [ 37.254422] nix-daemon[867]: reaped child process 1000, status = succeeded lb # [ 37.229428] niks3-server[949]: 2026/09/22 11:32:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 37.271154] nix-grpc-daemon[882]: time=2026-09-22T11:32:56.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 37.272927] nix-grpc-daemon[882]: time=2026-09-22T11:32:56.438Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 37.271703] niks3-server[949]: 2026/09/22 11:32:55 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 37.282287] niks3-server[949]: 2026/09/22 11:32:55 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 37.291417] niks3-server[949]: 2026/09/22 11:32:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 37.297142] niks3-server[949]: 2026/09/22 11:32:55 INFO Signed narinfos id=6 count=1 worker2 # [ 37.332451] nix-grpc-daemon[882]: time=2026-09-22T11:32:56.498Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.308378] niks3-server[949]: 2026/09/22 11:32:55 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 37.313046] niks3-server[949]: 2026/09/22 11:32:55 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 37.317421] niks3-server[949]: 2026/09/22 11:32:55 INFO Completed upload id=6 worker2 # [ 37.349157] nix-grpc-daemon[882]: time=2026-09-22T11:32:56.515Z level=INFO msg="Upload complete. (196ms)" lb # [ 37.320060] niks3-server[949]: 2026/09/22 11:32:55 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker2 # [ 37.356453] nix-grpc-daemon[783]: ts=2026-09-22T11:32:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker2 # [ 37.372123] nix-daemon[867]: reaped child process 979, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 4.96 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.13 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 5.26 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.13 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: worker1 # [ 38.189786] nix-grpc-daemon[780]: ts=2026-09-22T11:32:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46202 client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 38.192810] nix-grpc-daemon[780]: ts=2026-09-22T11:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker2 # [ 38.215513] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.23 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.80 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 38.724896] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55832 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 38.733535] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 38.743293] nix-grpc-daemon[882]: time=2026-09-22T11:32:57.908Z level=INFO msg="All 2 paths already cached" worker2 # [ 38.755591] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 38.761947] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 38.766925] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 38.777923] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 38.791057] nix-grpc-daemon[882]: time=2026-09-22T11:32:57.957Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker2 # [ 38.799783] nix-grpc-daemon[783]: ts=2026-09-22T11:32:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 38.811497] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 38.906649] nix-daemon[867]: accepted connection from pid 1030, user nix-grpc-daemon (trusted) worker2 # [ 38.920631] nix-daemon[867]: reaped child process 1033, status = succeeded worker2 # [ 39.003976] nix-daemon[867]: accepted connection from pid 1036, user nix-grpc-daemon (trusted) worker2 # [ 39.018894] nix-daemon[867]: reaped child process 1039, status = succeeded lb # [ 38.995721] niks3-server[949]: 2026/09/22 11:32:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.034313] nix-grpc-daemon[882]: time=2026-09-22T11:32:58.200Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 39.036336] nix-grpc-daemon[882]: time=2026-09-22T11:32:58.200Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 39.024707] niks3-server[949]: 2026/09/22 11:32:57 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 39.044099] niks3-server[949]: 2026/09/22 11:32:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 39.050377] niks3-server[949]: 2026/09/22 11:32:57 INFO Signed narinfos id=7 count=1 worker2 # [ 39.084726] nix-grpc-daemon[882]: time=2026-09-22T11:32:58.250Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.056467] niks3-server[949]: 2026/09/22 11:32:57 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 39.068241] niks3-server[949]: 2026/09/22 11:32:57 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 39.072159] niks3-server[949]: 2026/09/22 11:32:57 INFO Completed upload id=7 worker2 # [ 39.103440] nix-grpc-daemon[882]: time=2026-09-22T11:32:58.269Z level=INFO msg="Upload complete. (282ms)" lb # [ 39.075668] niks3-server[949]: 2026/09/22 11:32:57 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker2 # [ 39.107892] nix-grpc-daemon[783]: ts=2026-09-22T11:32:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 39.112505] nix-grpc-daemon[783]: ts=2026-09-22T11:32:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 39.123103] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 39.133165] nix-daemon[867]: reaped child process 1028, status = succeeded worker2 # [ 39.135929] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 39.757728] nix-daemon[867]: reaped child process 1043, status = succeeded worker2 # [ 39.843865] nix-daemon[867]: accepted connection from pid 1059, user nix-grpc-daemon (trusted) worker2 # [ 39.856368] nix-daemon[867]: reaped child process 1062, status = succeeded lb # [ 39.833597] niks3-server[949]: 2026/09/22 11:32:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.874438] nix-grpc-daemon[882]: time=2026-09-22T11:32:59.040Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 39.876168] nix-grpc-daemon[882]: time=2026-09-22T11:32:59.042Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 39.880345] niks3-server[949]: 2026/09/22 11:32:58 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 39.890577] niks3-server[949]: 2026/09/22 11:32:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 39.897259] niks3-server[949]: 2026/09/22 11:32:58 INFO Signed narinfos id=8 count=1 worker2 # [ 39.932109] nix-grpc-daemon[882]: time=2026-09-22T11:32:59.098Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.901519] niks3-server[949]: 2026/09/22 11:32:58 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 39.905085] niks3-server[949]: 2026/09/22 11:32:58 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 39.914379] niks3-server[949]: 2026/09/22 11:32:58 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 39.919127] niks3-server[949]: 2026/09/22 11:32:58 INFO Completed upload id=8 lb # [ 39.921640] niks3-server[949]: 2026/09/22 11:32:58 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker2 # [ 39.952197] nix-grpc-daemon[882]: time=2026-09-22T11:32:59.118Z level=INFO msg="Upload complete. (208ms)" worker2 # [ 39.958628] nix-grpc-daemon[783]: ts=2026-09-22T11:32:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker2 # [ 39.971168] nix-daemon[867]: reaped child process 1041, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.41 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 1.71 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 worker1 # [ 40.352079] nix-grpc-daemon[780]: ts=2026-09-22T11:32:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46202 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 40.352799] nix-grpc-daemon[783]: ts=2026-09-22T11:32:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 40.364308] nix-grpc-daemon[783]: ts=2026-09-22T11:32:59Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 40.366275] nix-grpc-daemon[783]: ts=2026-09-22T11:32:59Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 40.373668] nix-grpc-daemon[780]: ts=2026-09-22T11:32:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 40.381320] nix-grpc-daemon[780]: ts=2026-09-22T11:32:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker1 # [ 40.388514] nix-grpc-daemon[780]: ts=2026-09-22T11:32:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 40.395510] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 40.406883] nix-grpc-daemon[780]: ts=2026-09-22T11:32:58Z level=info event=niks3_push_started pid=872 worker1 # [ 40.532524] nix-grpc-daemon[872]: time=2026-09-22T11:32:58.896Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 40.623972] nix-daemon[844]: accepted connection from pid 884, user nix-grpc-daemon (trusted) worker1 # [ 40.637677] nix-daemon[844]: reaped child process 888, status = succeeded worker1 # [ 40.712328] nix-daemon[844]: accepted connection from pid 890, user nix-grpc-daemon (trusted) worker1 # [ 40.727214] nix-daemon[844]: reaped child process 893, status = succeeded lb # [ 40.691827] niks3-server[949]: 2026/09/22 11:32:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.737859] nix-grpc-daemon[872]: time=2026-09-22T11:32:59.102Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 40.740803] nix-grpc-daemon[872]: time=2026-09-22T11:32:59.103Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 40.723658] niks3-server[949]: 2026/09/22 11:32:59 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 40.735650] niks3-server[949]: 2026/09/22 11:32:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker1 # [ 40.782902] nix-grpc-daemon[872]: time=2026-09-22T11:32:59.147Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.746960] niks3-server[949]: 2026/09/22 11:32:59 INFO Signed narinfos id=9 count=1 lb # [ 40.756124] niks3-server[949]: 2026/09/22 11:32:59 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 40.773947] niks3-server[949]: 2026/09/22 11:32:59 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 40.778510] niks3-server[949]: 2026/09/22 11:32:59 INFO Completed upload id=9 lb # [ 40.781649] niks3-server[949]: 2026/09/22 11:32:59 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 40.817550] nix-grpc-daemon[872]: time=2026-09-22T11:32:59.181Z level=INFO msg="Upload complete. (280ms)" worker1 # [ 40.822821] nix-grpc-daemon[780]: ts=2026-09-22T11:32:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 40.833223] nix-grpc-daemon[780]: ts=2026-09-22T11:32:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 40.844109] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 40.848931] nix-daemon[844]: reaped child process 870, status = succeeded worker1 # [ 40.856896] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 42.096662] nix-daemon[844]: reaped child process 897, status = succeeded worker1 # [ 42.178566] nix-daemon[844]: accepted connection from pid 913, user nix-grpc-daemon (trusted) worker1 # [ 42.190852] nix-daemon[844]: reaped child process 916, status = succeeded lb # [ 42.162801] niks3-server[949]: 2026/09/22 11:33:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.208990] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.573Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 42.210697] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.575Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 42.205860] niks3-server[949]: 2026/09/22 11:33:00 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 42.210835] niks3-server[949]: 2026/09/22 11:33:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 42.214069] niks3-server[949]: 2026/09/22 11:33:00 INFO Signed narinfos id=10 count=1 worker1 # [ 42.252631] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.616Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.219064] niks3-server[949]: 2026/09/22 11:33:00 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 42.223123] niks3-server[949]: 2026/09/22 11:33:00 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 42.225384] niks3-server[949]: 2026/09/22 11:33:00 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 42.230971] niks3-server[949]: 2026/09/22 11:33:00 INFO Completed upload id=10 worker1 # [ 42.267695] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.632Z level=INFO msg="Upload complete. (202ms)" lb # [ 42.235076] niks3-server[949]: 2026/09/22 11:33:00 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker1 # [ 42.270258] nix-grpc-daemon[780]: ts=2026-09-22T11:33:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 42.271858] nix-grpc-daemon[783]: ts=2026-09-22T11:33:01Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker1 # [ 42.280212] nix-daemon[844]: reaped child process 895, status = succeeded worker2 # [ 42.273879] nix-grpc-daemon[783]: ts=2026-09-22T11:33:01Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 42.323326] nix-grpc-daemon[780]: ts=2026-09-22T11:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 42.334128] nix-grpc-daemon[780]: ts=2026-09-22T11:33:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 42.344411] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.708Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker1 # [ 42.352945] nix-grpc-daemon[780]: ts=2026-09-22T11:33:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 42.362368] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 42.461242] nix-daemon[844]: accepted connection from pid 920, user nix-grpc-daemon (trusted) worker1 # [ 42.475079] nix-daemon[844]: reaped child process 923, status = succeeded worker1 # [ 42.557763] nix-daemon[844]: accepted connection from pid 925, user nix-grpc-daemon (trusted) worker1 # [ 42.570088] nix-daemon[844]: reaped child process 928, status = succeeded lb # [ 42.540917] niks3-server[949]: 2026/09/22 11:33:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.582504] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.946Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 42.583899] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.946Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 42.555152] niks3-server[949]: 2026/09/22 11:33:00 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 42.558977] niks3-server[949]: 2026/09/22 11:33:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 42.561341] niks3-server[949]: 2026/09/22 11:33:00 INFO Signed narinfos id=11 count=1 worker1 # [ 42.598409] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.962Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.563775] niks3-server[949]: 2026/09/22 11:33:00 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 42.568771] niks3-server[949]: 2026/09/22 11:33:00 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 42.572631] niks3-server[949]: 2026/09/22 11:33:00 INFO Completed upload id=11 worker1 # [ 42.609446] nix-grpc-daemon[872]: time=2026-09-22T11:33:00.973Z level=INFO msg="Upload complete. (235ms)" lb # [ 42.574391] niks3-server[949]: 2026/09/22 11:33:00 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker1 # [ 42.611599] nix-grpc-daemon[780]: ts=2026-09-22T11:33:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 42.616391] nix-grpc-daemon[780]: ts=2026-09-22T11:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 42.620874] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 42.622965] nix-daemon[844]: reaped child process 918, status = succeeded worker1 # [ 42.627929] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 43.456445] nix-daemon[844]: reaped child process 932, status = succeeded worker1 # [ 43.531557] nix-daemon[844]: accepted connection from pid 948, user nix-grpc-daemon (trusted) worker1 # [ 43.542671] nix-daemon[844]: reaped child process 951, status = succeeded lb # [ 43.514899] niks3-server[949]: 2026/09/22 11:33:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.561188] nix-grpc-daemon[872]: time=2026-09-22T11:33:01.925Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 43.562655] nix-grpc-daemon[872]: time=2026-09-22T11:33:01.927Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 43.554187] niks3-server[949]: 2026/09/22 11:33:01 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 43.564853] niks3-server[949]: 2026/09/22 11:33:01 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 43.571139] niks3-server[949]: 2026/09/22 11:33:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 43.576930] niks3-server[949]: 2026/09/22 11:33:01 INFO Signed narinfos id=12 count=1 worker1 # [ 43.617194] nix-grpc-daemon[872]: time=2026-09-22T11:33:01.981Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.590806] niks3-server[949]: 2026/09/22 11:33:01 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 43.597171] niks3-server[949]: 2026/09/22 11:33:01 INFO Completed upload id=12 worker1 # [ 43.634496] nix-grpc-daemon[872]: time=2026-09-22T11:33:01.998Z level=INFO msg="Upload complete. (200ms)" lb # [ 43.599786] niks3-server[949]: 2026/09/22 11:33:01 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 43.602107] niks3-server[949]: 2026/09/22 11:33:01 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 43.641049] nix-grpc-daemon[783]: ts=2026-09-22T11:33:02Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 43.641137] nix-grpc-daemon[780]: ts=2026-09-22T11:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 43.642948] nix-grpc-daemon[783]: ts=2026-09-22T11:33:02Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 43.656970] nix-daemon[844]: reaped child process 930, status = succeeded worker1 # [ 43.690884] nix-grpc-daemon[780]: ts=2026-09-22T11:33:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 43.703458] nix-grpc-daemon[780]: ts=2026-09-22T11:33:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 43.717487] nix-grpc-daemon[872]: time=2026-09-22T11:33:02.081Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker1 # [ 43.726651] nix-grpc-daemon[780]: ts=2026-09-22T11:33:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 43.735318] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 43.834511] nix-daemon[844]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker1 # [ 43.847707] nix-daemon[844]: reaped child process 958, status = succeeded worker1 # [ 43.932553] nix-daemon[844]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker1 # [ 43.944327] nix-daemon[844]: reaped child process 963, status = succeeded lb # [ 43.916389] niks3-server[949]: 2026/09/22 11:33:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.962781] nix-grpc-daemon[872]: time=2026-09-22T11:33:02.327Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.964182] nix-grpc-daemon[872]: time=2026-09-22T11:33:02.327Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 43.945468] niks3-server[949]: 2026/09/22 11:33:02 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 43.957146] niks3-server[949]: 2026/09/22 11:33:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 43.961712] niks3-server[949]: 2026/09/22 11:33:02 INFO Signed narinfos id=13 count=1 worker1 # [ 44.001132] nix-grpc-daemon[872]: time=2026-09-22T11:33:02.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.973188] niks3-server[949]: 2026/09/22 11:33:02 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 43.979326] niks3-server[949]: 2026/09/22 11:33:02 INFO Completed upload id=13 worker1 # [ 44.016181] nix-grpc-daemon[872]: time=2026-09-22T11:33:02.380Z level=INFO msg="Upload complete. (267ms)" worker1 # [ 44.018165] nix-grpc-daemon[780]: ts=2026-09-22T11:33:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 43.984479] niks3-server[949]: 2026/09/22 11:33:02 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls worker1 # [ 44.021443] nix-grpc-daemon[780]: ts=2026-09-22T11:33:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 lb # [ 43.987873] niks3-server[949]: 2026/09/22 11:33:02 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker1 # [ 44.029063] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 44.030991] nix-daemon[844]: reaped child process 953, status = succeeded worker1 # [ 44.036169] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 45.275979] nix-daemon[844]: reaped child process 967, status = succeeded worker1 # [ 45.356613] nix-daemon[844]: accepted connection from pid 983, user nix-grpc-daemon (trusted) worker1 # [ 45.368951] nix-daemon[844]: reaped child process 986, status = succeeded lb # [ 45.340394] niks3-server[949]: 2026/09/22 11:33:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.385791] nix-grpc-daemon[872]: time=2026-09-22T11:33:03.750Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.387306] nix-grpc-daemon[872]: time=2026-09-22T11:33:03.751Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 45.379724] niks3-server[949]: 2026/09/22 11:33:03 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 45.390520] niks3-server[949]: 2026/09/22 11:33:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 45.397735] niks3-server[949]: 2026/09/22 11:33:03 INFO Signed narinfos id=14 count=1 worker1 # [ 45.437461] nix-grpc-daemon[872]: time=2026-09-22T11:33:03.801Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.405230] niks3-server[949]: 2026/09/22 11:33:03 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 45.410196] niks3-server[949]: 2026/09/22 11:33:03 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 45.418476] niks3-server[949]: 2026/09/22 11:33:03 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 45.423355] niks3-server[949]: 2026/09/22 11:33:03 INFO Completed upload id=14 worker1 # [ 45.460493] nix-grpc-daemon[872]: time=2026-09-22T11:33:03.824Z level=INFO msg="Upload complete. (215ms)" lb # [ 45.427463] niks3-server[949]: 2026/09/22 11:33:03 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker1 # [ 45.466504] nix-grpc-daemon[780]: ts=2026-09-22T11:33:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker1 # [ 45.481350] nix-daemon[844]: reaped child process 965, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.28 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.10 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 45.688501] nix-grpc-daemon[780]: ts=2026-09-22T11:33:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:51072 worker1 # [ 45.730063] nix-grpc-daemon[780]: ts=2026-09-22T11:33:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:51072 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.21 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 45.902982] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:46892 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 45.947161] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:46892 worker2 # [ 45.950251] nix-grpc-daemon[783]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker2 # [ 45.959559] nix-grpc-daemon[783]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker2 # [ 45.967165] nix-grpc-daemon[783]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.20 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/837" client # removing stale temporary roots file "/nix/var/nix/temproots/800" client # removing stale temporary roots file "/nix/var/nix/temproots/879" client # removing stale temporary roots file "/nix/var/nix/temproots/858" client # removing stale temporary roots file "/nix/var/nix/temproots/850" client # removing stale temporary roots file "/nix/var/nix/temproots/816" client # removing stale temporary roots file "/nix/var/nix/temproots/871" client # removing stale temporary roots file "/nix/var/nix/temproots/895" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 46.236852] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55832 worker1 # [ 46.246399] nix-grpc-daemon[780]: ts=2026-09-22T11:33:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 46.255596] nix-grpc-daemon[872]: time=2026-09-22T11:33:04.620Z level=INFO msg="All 1 paths already cached" worker1 # [ 46.262541] nix-grpc-daemon[780]: ts=2026-09-22T11:33:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46202 worker2 # [ 46.264243] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55832 client # copying 3 paths... worker2 # [ 46.271456] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55832 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 46.290455] nix-grpc-daemon[780]: ts=2026-09-22T11:33:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 worker2 # [ 46.291627] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 worker1 # [ 46.295825] nix-grpc-daemon[780]: ts=2026-09-22T11:33:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 46.294166] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 46.298256] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 46.300221] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.39 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 6.17 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 46.401292] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 88862faeaa5942f8a1aae7e39693c871 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 46.541096] nix[948]: don't know how to build these paths: client # [ 46.542022] nix[948]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 46.543688] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 46.554898] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 46.560331] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.599282] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 46.611337] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 client # [ 46.617204] nix[948]: copying 1 paths to 'lb:50051'... worker2 # [ 46.622777] nix-grpc-daemon[783]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 client # [ 46.620109] nix[948]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 46.636256] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 46.734457] nix-daemon[867]: accepted connection from pid 1083, user nix-grpc-daemon (trusted) worker2 # [ 46.749754] nix-daemon[867]: reaped child process 1086, status = succeeded worker2 # [ 46.826635] nix-daemon[867]: accepted connection from pid 1088, user nix-grpc-daemon (trusted) worker2 # [ 46.840762] nix-daemon[867]: reaped child process 1091, status = succeeded lb # [ 46.814950] niks3-server[949]: 2026/09/22 11:33:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.855285] nix-grpc-daemon[882]: time=2026-09-22T11:33:06.021Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 46.856666] nix-grpc-daemon[882]: time=2026-09-22T11:33:06.021Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 46.843213] niks3-server[949]: 2026/09/22 11:33:05 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 46.855607] niks3-server[949]: 2026/09/22 11:33:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker2 # [ 46.895185] nix-grpc-daemon[882]: time=2026-09-22T11:33:06.061Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.863638] niks3-server[949]: 2026/09/22 11:33:05 INFO Signed narinfos id=15 count=1 lb # [ 46.867919] niks3-server[949]: 2026/09/22 11:33:05 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 46.879554] niks3-server[949]: 2026/09/22 11:33:05 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 46.886395] niks3-server[949]: 2026/09/22 11:33:05 INFO Completed upload id=15 worker2 # [ 46.917948] nix-grpc-daemon[882]: time=2026-09-22T11:33:06.084Z level=INFO msg="Upload complete. (270ms)" lb # [ 46.891108] niks3-server[949]: 2026/09/22 11:33:05 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 46.922482] nix-grpc-daemon[783]: ts=2026-09-22T11:33:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 46.927340] nix-grpc-daemon[783]: ts=2026-09-22T11:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 46.936823] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 46.944199] nix-daemon[867]: reaped child process 1081, status = succeeded worker2 # [ 46.947726] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # [ 46.942431] nix[948]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... lb # [ 47.037819] envoy[918]: conn peer=[2001:db8:1::1]:47444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9425 tx=4383 ms=4813 lb # [ 47.041708] envoy[918]: conn peer=[2001:db8:1::1]:42436 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=45 lb # [ 47.045199] envoy[918]: conn peer=[2001:db8:1::1]:42446 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4139 tx=1901 ms=1252 lb # [ 47.048693] envoy[918]: conn peer=[2001:db8:1::1]:42458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=4331 ms=5124 lb # [ 47.052217] envoy[918]: conn peer=[2001:db8:1::1]:42542 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2889 ms=131 lb # [ 47.056505] envoy[918]: conn peer=[2001:db8:1::1]:42554 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=82 lb # [ 47.059935] envoy[918]: conn peer=[2001:db8:1::1]:42580 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=68 lb # [ 47.063474] envoy[918]: conn peer=[2001:db8:1::1]:42570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=75 client # [ 47.455935] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: afbdb6aae3f4466397d23e8984e001fd client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.06 seconds) worker1 # [ 47.625756] nix-grpc-daemon[780]: ts=2026-09-22T11:33:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46202 client # [ 47.621804] nix[964]: don't know how to build these paths: client # [ 47.622675] nix[964]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 47.632267] nix-grpc-daemon[783]: ts=2026-09-22T11:33:06Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 client # [ 47.634059] nix[964]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker2 # [ 47.638076] nix-grpc-daemon[783]: ts=2026-09-22T11:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.03 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 50.985736] nix-daemon[867]: reaped child process 1095, status = succeeded worker2 # [ 51.072103] nix-daemon[867]: accepted connection from pid 1127, user nix-grpc-daemon (trusted) worker2 # [ 51.085946] nix-daemon[867]: reaped child process 1130, status = succeeded lb # [ 51.061471] niks3-server[949]: 2026/09/22 11:33:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.353353] nix-grpc-daemon[882]: time=2026-09-22T11:33:10.519Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 51.356802] nix-grpc-daemon[882]: time=2026-09-22T11:33:10.521Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 51.343851] niks3-server[949]: 2026/09/22 11:33:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 51.346903] niks3-server[949]: 2026/09/22 11:33:09 INFO Signed narinfos id=16 count=1 worker2 # [ 51.378327] nix-grpc-daemon[882]: time=2026-09-22T11:33:10.544Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.352373] niks3-server[949]: 2026/09/22 11:33:09 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 51.380331] niks3-server[949]: 2026/09/22 11:33:09 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 51.393928] niks3-server[949]: 2026/09/22 11:33:09 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 51.433135] niks3-server[949]: 2026/09/22 11:33:09 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls worker2 # [ 51.481355] nix-grpc-daemon[882]: time=2026-09-22T11:33:10.647Z level=INFO msg="Upload complete. (522ms)" lb # [ 51.449809] niks3-server[949]: 2026/09/22 11:33:09 INFO Completed upload id=16 worker2 # [ 51.484692] nix-grpc-daemon[783]: ts=2026-09-22T11:33:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 51.488138] nix-grpc-daemon[783]: ts=2026-09-22T11:33:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 51.495611] nix-daemon[867]: reaped child process 1093, status = succeeded lb # [ 51.477232] niks3-server[949]: 2026/09/22 11:33:09 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo client # [ 51.515493] systemd[1]: dedup2.service: Deactivated successfully. client # [ 51.519696] systemd[1]: dedup2.service: Consumed 142ms CPU time over 4.062s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.6K outgoing IP traffic. client # [ 51.554673] systemd[1]: dedup1.service: Deactivated successfully. client # [ 51.557664] systemd[1]: dedup1.service: Consumed 127ms CPU time over 5.155s wall clock time, 39.5M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.65 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 52.171650] nix-grpc-daemon[783]: ts=2026-09-22T11:33:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 52.179355] nix-grpc-daemon[783]: ts=2026-09-22T11:33:11Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 52.181431] nix-grpc-daemon[783]: ts=2026-09-22T11:33:11Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.188920] nix-grpc-daemon[780]: ts=2026-09-22T11:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 52.195243] nix-grpc-daemon[780]: ts=2026-09-22T11:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 52.200294] nix-grpc-daemon[780]: ts=2026-09-22T11:33:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 52.205419] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 52.287742] nix-daemon[844]: accepted connection from pid 1011, user nix-grpc-daemon (trusted) worker1 # [ 52.301044] nix-daemon[844]: reaped child process 1014, status = succeeded worker1 # [ 52.379955] nix-daemon[844]: accepted connection from pid 1016, user nix-grpc-daemon (trusted) worker1 # [ 52.394122] nix-daemon[844]: reaped child process 1019, status = succeeded lb # [ 52.360071] niks3-server[949]: 2026/09/22 11:33:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.401938] nix-grpc-daemon[872]: time=2026-09-22T11:33:10.766Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.403238] nix-grpc-daemon[872]: time=2026-09-22T11:33:10.766Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 52.372582] niks3-server[949]: 2026/09/22 11:33:10 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 52.381637] niks3-server[949]: 2026/09/22 11:33:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 52.386828] niks3-server[949]: 2026/09/22 11:33:10 INFO Signed narinfos id=17 count=1 worker1 # [ 52.428056] nix-grpc-daemon[872]: time=2026-09-22T11:33:10.792Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.393158] niks3-server[949]: 2026/09/22 11:33:10 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 52.399921] niks3-server[949]: 2026/09/22 11:33:10 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 52.404356] niks3-server[949]: 2026/09/22 11:33:10 INFO Completed upload id=17 worker1 # [ 52.441335] nix-grpc-daemon[872]: time=2026-09-22T11:33:10.805Z level=INFO msg="Upload complete. (231ms)" lb # [ 52.406362] niks3-server[949]: 2026/09/22 11:33:10 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker1 # [ 52.443489] nix-grpc-daemon[780]: ts=2026-09-22T11:33:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 52.447540] nix-grpc-daemon[780]: ts=2026-09-22T11:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 52.453179] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 52.455422] nix-daemon[844]: reaped child process 1009, status = succeeded worker1 # [ 52.460310] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) lb # [ 57.036875] envoy[918]: conn peer=[2001:db8:1::1]:42602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=3883 lb # [ 57.039478] envoy[918]: conn peer=[2001:db8:1::1]:42588 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3015 tx=1556 ms=5002 worker1 # [ 58.472177] nix-grpc-daemon[780]: ts=2026-09-22T11:33:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker1 # [ 58.483250] nix-daemon[844]: reaped child process 1021, status = succeeded worker1 # [ 58.484425] nix-daemon[844]: reaped child process 1023, status = succeeded worker2 # [ 58.671384] nix-grpc-daemon[783]: ts=2026-09-22T11:33:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 58.684913] nix-grpc-daemon[783]: ts=2026-09-22T11:33:17Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 58.691617] nix-grpc-daemon[783]: ts=2026-09-22T11:33:17Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 58.696460] nix-grpc-daemon[783]: ts=2026-09-22T11:33:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 58.704518] nix-grpc-daemon[783]: ts=2026-09-22T11:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 58.716142] nix-grpc-daemon[783]: ts=2026-09-22T11:33:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 58.726736] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 58.829182] nix-daemon[867]: accepted connection from pid 1147, user nix-grpc-daemon (trusted) worker2 # [ 58.843995] nix-daemon[867]: reaped child process 1150, status = succeeded worker2 # [ 58.927952] nix-daemon[867]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) worker2 # [ 58.940970] nix-daemon[867]: reaped child process 1155, status = succeeded lb # [ 58.916648] niks3-server[949]: 2026/09/22 11:33:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 58.953261] nix-grpc-daemon[882]: time=2026-09-22T11:33:18.119Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 58.954742] nix-grpc-daemon[882]: time=2026-09-22T11:33:18.121Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 58.940913] niks3-server[949]: 2026/09/22 11:33:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 58.943720] niks3-server[949]: 2026/09/22 11:33:17 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 58.947065] niks3-server[949]: 2026/09/22 11:33:17 INFO Signed narinfos id=18 count=1 worker2 # [ 58.978688] nix-grpc-daemon[882]: time=2026-09-22T11:33:18.144Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.952386] niks3-server[949]: 2026/09/22 11:33:17 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 58.958679] niks3-server[949]: 2026/09/22 11:33:17 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 58.962664] niks3-server[949]: 2026/09/22 11:33:17 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo lb # [ 58.965777] niks3-server[949]: 2026/09/22 11:33:17 INFO Completed upload id=18 worker2 # [ 58.997267] nix-grpc-daemon[882]: time=2026-09-22T11:33:18.163Z level=INFO msg="Upload complete. (260ms)" worker2 # [ 58.999310] nix-grpc-daemon[783]: ts=2026-09-22T11:33:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 59.002688] nix-grpc-daemon[783]: ts=2026-09-22T11:33:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 59.009732] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 59.012097] nix-daemon[867]: reaped child process 1145, status = succeeded worker2 # [ 59.017092] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 65.432579] nix-grpc-daemon[783]: ts=2026-09-22T11:33:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker2 # [ 65.457868] nix-daemon[867]: reaped child process 1157, status = succeeded worker2 # [ 65.459933] nix-daemon[867]: reaped child process 1159, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.53 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 65.576912] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 4c70e241e3c84141a160726b72688e2d client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 65.704171] nix[1037]: don't know how to build these paths: client # [ 65.705072] nix[1037]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 65.713622] nix-grpc-daemon[780]: ts=2026-09-22T11:33:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46202 worker2 # [ 65.716297] nix-grpc-daemon[783]: ts=2026-09-22T11:33:24Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 65.724170] nix-grpc-daemon[780]: ts=2026-09-22T11:33:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker2 # [ 65.720975] nix-grpc-daemon[783]: ts=2026-09-22T11:33:24Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 65.736375] nix-grpc-daemon[780]: ts=2026-09-22T11:33:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 client # [ 65.736708] nix[1037]: copying 1 paths to 'lb:50051'... client # [ 65.737556] nix[1037]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker1 # [ 65.747363] nix-grpc-daemon[780]: ts=2026-09-22T11:33:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 65.757932] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 65.855485] nix-daemon[844]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker1 # [ 65.867445] nix-daemon[844]: reaped child process 1049, status = succeeded worker1 # [ 65.947729] nix-daemon[844]: accepted connection from pid 1051, user nix-grpc-daemon (trusted) worker1 # [ 65.960511] nix-daemon[844]: reaped child process 1054, status = succeeded lb # [ 65.930819] niks3-server[949]: 2026/09/22 11:33:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.977745] nix-grpc-daemon[872]: time=2026-09-22T11:33:24.341Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 65.979162] nix-grpc-daemon[872]: time=2026-09-22T11:33:24.341Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 65.965861] niks3-server[949]: 2026/09/22 11:33:24 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 65.977824] niks3-server[949]: 2026/09/22 11:33:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 65.983736] niks3-server[949]: 2026/09/22 11:33:24 INFO Signed narinfos id=19 count=1 worker1 # [ 66.023631] nix-grpc-daemon[872]: time=2026-09-22T11:33:24.388Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.991878] niks3-server[949]: 2026/09/22 11:33:24 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 66.004274] niks3-server[949]: 2026/09/22 11:33:24 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 66.007816] niks3-server[949]: 2026/09/22 11:33:24 INFO Completed upload id=19 worker1 # [ 66.045975] nix-grpc-daemon[872]: time=2026-09-22T11:33:24.410Z level=INFO msg="Upload complete. (276ms)" lb # [ 66.010159] niks3-server[949]: 2026/09/22 11:33:24 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker1 # [ 66.048062] nix-grpc-daemon[780]: ts=2026-09-22T11:33:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 66.051431] nix-grpc-daemon[780]: ts=2026-09-22T11:33:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 66.059708] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 66.061573] nix-daemon[844]: reaped child process 1044, status = succeeded client # [ 66.056033] nix[1037]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker1 # [ 66.066156] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # [ 66.630087] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: ac83e25dadf24afb92d2abedf0efdad5 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) client: must succeed: sleep 2; systemctl kill -s INT share1 worker2 # [ 66.783529] nix-grpc-daemon[783]: ts=2026-09-22T11:33:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55832 client # [ 66.784924] nix[1053]: don't know how to build these paths: client # [ 66.785864] nix[1053]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 66.795687] nix-grpc-daemon[783]: ts=2026-09-22T11:33:25Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 66.806223] nix-grpc-daemon[780]: ts=2026-09-22T11:33:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 client # [ 66.799189] nix[1053]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... lb # [ 67.038259] envoy[918]: conn peer=[2001:db8:1::1]:42612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=933 ms=6350 lb # [ 67.042079] envoy[918]: conn peer=[2001:db8:1::1]:36670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=936 ms=6773 client # [ 68.777971] systemd[1]: share1.service: Sent signal SIGINT to main process 1037 (nix) on client request. client # [ 68.780827] nix[1037]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 68.784136] nix[1037]: error: interrupted by the user client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.04 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 68.811814] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 68.813438] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 68.815401] systemd[1]: share1.service: Consumed 102ms CPU time over 3.236s wall clock time, 43.5M memory peak, 6K incoming IP traffic, 8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.06 seconds) client: waiting for success: ! systemctl is-active share2 worker1 # [ 70.102695] nix-daemon[844]: reaped child process 1058, status = succeeded worker1 # [ 70.171894] nix-daemon[844]: accepted connection from pid 1089, user nix-grpc-daemon (trusted) worker1 # [ 70.184348] nix-daemon[844]: reaped child process 1092, status = succeeded lb # [ 70.154580] niks3-server[949]: 2026/09/22 11:33:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.202434] nix-grpc-daemon[872]: time=2026-09-22T11:33:28.566Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 70.204537] nix-grpc-daemon[872]: time=2026-09-22T11:33:28.568Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 70.198148] niks3-server[949]: 2026/09/22 11:33:28 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 70.203431] niks3-server[949]: 2026/09/22 11:33:28 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 70.217100] niks3-server[949]: 2026/09/22 11:33:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 70.224735] niks3-server[949]: 2026/09/22 11:33:28 INFO Signed narinfos id=20 count=1 worker1 # [ 70.261224] nix-grpc-daemon[872]: time=2026-09-22T11:33:28.625Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.229432] niks3-server[949]: 2026/09/22 11:33:28 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 70.240435] niks3-server[949]: 2026/09/22 11:33:28 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 70.245321] niks3-server[949]: 2026/09/22 11:33:28 INFO Completed upload id=20 lb # [ 70.247616] niks3-server[949]: 2026/09/22 11:33:28 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker1 # [ 70.283774] nix-grpc-daemon[872]: time=2026-09-22T11:33:28.648Z level=INFO msg="Upload complete. (208ms)" worker1 # [ 70.291149] nix-grpc-daemon[780]: ts=2026-09-22T11:33:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker1 # [ 70.296822] nix-grpc-daemon[780]: ts=2026-09-22T11:33:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker1 # [ 70.309859] nix-daemon[844]: reaped child process 1056, status = succeeded client # [ 70.353955] systemd[1]: share2.service: Deactivated successfully. client # [ 70.357778] systemd[1]: share2.service: Consumed 122ms CPU time over 3.727s wall clock time, 35.4M memory peak, 5.9K incoming IP traffic, 5.8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 5.53 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 71.177517] systemd[1]: Started Nix Daemon. client # [ 71.268764] nix-daemon[1103]: accepted connection from pid 1100, user root (trusted) worker1 # [ 71.401810] nix-grpc-daemon[780]: ts=2026-09-22T11:33:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46202 worker2 # [ 71.400319] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 71.416152] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 71.421634] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 71.428077] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 71.435925] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 71.448421] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 71.458848] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 71.553949] nix-daemon[867]: accepted connection from pid 1200, user nix-grpc-daemon (trusted) worker2 # [ 71.567585] nix-daemon[867]: reaped child process 1203, status = succeeded worker2 # [ 71.649097] nix-daemon[867]: accepted connection from pid 1205, user nix-grpc-daemon (trusted) worker2 # [ 71.660860] nix-daemon[867]: reaped child process 1208, status = succeeded lb # [ 71.636819] niks3-server[949]: 2026/09/22 11:33:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.677517] nix-grpc-daemon[882]: time=2026-09-22T11:33:30.843Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 71.678972] nix-grpc-daemon[882]: time=2026-09-22T11:33:30.845Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 71.666584] niks3-server[949]: 2026/09/22 11:33:30 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 71.679949] niks3-server[949]: 2026/09/22 11:33:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 71.686282] niks3-server[949]: 2026/09/22 11:33:30 INFO Signed narinfos id=21 count=1 worker2 # [ 71.720447] nix-grpc-daemon[882]: time=2026-09-22T11:33:30.886Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.697092] niks3-server[949]: 2026/09/22 11:33:30 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 71.702759] niks3-server[949]: 2026/09/22 11:33:30 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 71.707719] niks3-server[949]: 2026/09/22 11:33:30 INFO Completed upload id=21 worker2 # [ 71.740343] nix-grpc-daemon[882]: time=2026-09-22T11:33:30.906Z level=INFO msg="Upload complete. (270ms)" lb # [ 71.710910] niks3-server[949]: 2026/09/22 11:33:30 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker2 # [ 71.743251] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 71.748472] nix-grpc-daemon[783]: ts=2026-09-22T11:33:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 71.759149] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 71.764156] nix-daemon[867]: reaped child process 1198, status = succeeded worker2 # [ 71.767694] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 72.984344] nix-daemon[867]: reaped child process 1212, status = succeeded worker2 # [ 73.058159] nix-daemon[867]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker2 # [ 73.071713] nix-daemon[867]: reaped child process 1231, status = succeeded lb # [ 73.049955] niks3-server[949]: 2026/09/22 11:33:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 73.087725] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.253Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 73.089274] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.255Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 73.080362] niks3-server[949]: 2026/09/22 11:33:31 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 73.098994] niks3-server[949]: 2026/09/22 11:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 73.104394] niks3-server[949]: 2026/09/22 11:33:31 INFO Signed narinfos id=22 count=1 worker2 # [ 73.139142] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.305Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.112646] niks3-server[949]: 2026/09/22 11:33:31 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 73.122935] niks3-server[949]: 2026/09/22 11:33:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 73.129118] niks3-server[949]: 2026/09/22 11:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 73.134226] niks3-server[949]: 2026/09/22 11:33:31 INFO Completed upload id=22 lb # [ 73.136424] niks3-server[949]: 2026/09/22 11:33:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker2 # [ 73.165934] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.332Z level=INFO msg="Upload complete. (190ms)" worker2 # [ 73.173964] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker2 # [ 73.182153] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.193327] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.196571] nix-daemon[867]: reaped child process 1210, status = succeeded worker2 # [ 73.199271] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 73.383588] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.390175] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.397390] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.562Z level=INFO msg="All 1 paths already cached" worker2 # [ 73.406439] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 73.412970] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 73.417897] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.427544] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.437900] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.604Z level=INFO msg="All 1 paths already cached" worker2 # [ 73.444427] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.454143] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 73.546800] nix-daemon[867]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker2 # [ 73.560679] nix-daemon[867]: reaped child process 1240, status = succeeded worker2 # [ 73.643297] nix-daemon[867]: accepted connection from pid 1242, user nix-grpc-daemon (trusted) worker2 # [ 73.657963] nix-daemon[867]: reaped child process 1245, status = succeeded lb # [ 73.631714] niks3-server[949]: 2026/09/22 11:33:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 73.667827] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.833Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 73.669192] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.833Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 73.646545] niks3-server[949]: 2026/09/22 11:33:31 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 73.649914] niks3-server[949]: 2026/09/22 11:33:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 73.652246] niks3-server[949]: 2026/09/22 11:33:32 INFO Signed narinfos id=23 count=1 worker2 # [ 73.683619] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.849Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.655199] niks3-server[949]: 2026/09/22 11:33:32 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 73.659894] niks3-server[949]: 2026/09/22 11:33:32 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 73.664652] niks3-server[949]: 2026/09/22 11:33:32 INFO Completed upload id=23 worker2 # [ 73.696126] nix-grpc-daemon[882]: time=2026-09-22T11:33:32.862Z level=INFO msg="Upload complete. (231ms)" lb # [ 73.665855] niks3-server[949]: 2026/09/22 11:33:32 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker2 # [ 73.698278] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 73.701666] nix-grpc-daemon[783]: ts=2026-09-22T11:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 73.707503] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 73.713149] nix-daemon[867]: reaped child process 1235, status = succeeded worker2 # [ 73.718085] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 74.738270] nix-daemon[867]: reaped child process 1249, status = succeeded worker2 # [ 74.809870] nix-daemon[867]: accepted connection from pid 1265, user nix-grpc-daemon (trusted) worker2 # [ 74.824522] nix-daemon[867]: reaped child process 1268, status = succeeded lb # [ 74.799251] niks3-server[949]: 2026/09/22 11:33:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.836751] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.002Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 74.840059] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.004Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 74.824175] niks3-server[949]: 2026/09/22 11:33:33 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 74.829272] niks3-server[949]: 2026/09/22 11:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 74.832462] niks3-server[949]: 2026/09/22 11:33:33 INFO Signed narinfos id=24 count=1 worker2 # [ 74.863807] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.029Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.836506] niks3-server[949]: 2026/09/22 11:33:33 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 74.839213] niks3-server[949]: 2026/09/22 11:33:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 74.842865] niks3-server[949]: 2026/09/22 11:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 74.845551] niks3-server[949]: 2026/09/22 11:33:33 INFO Completed upload id=24 worker2 # [ 74.877047] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.043Z level=INFO msg="Upload complete. (152ms)" lb # [ 74.848520] niks3-server[949]: 2026/09/22 11:33:33 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker2 # [ 74.881061] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker2 # [ 74.889294] nix-daemon[867]: reaped child process 1247, status = succeeded worker1 # [ 74.935659] nix-grpc-daemon[780]: ts=2026-09-22T11:33:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 74.949678] nix-grpc-daemon[780]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 74.960870] nix-grpc-daemon[780]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 74.974134] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 74.979523] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 75.127149] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 75.134534] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 75.142775] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.308Z level=INFO msg="All 2 paths already cached" worker2 # [ 75.157154] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 75.162967] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 75.167935] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 75.177379] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 75.187796] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.353Z level=INFO msg="All 2 paths already cached" worker2 # [ 75.194923] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 75.203335] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 75.301974] nix-daemon[867]: accepted connection from pid 1274, user nix-grpc-daemon (trusted) worker2 # [ 75.317861] nix-daemon[867]: reaped child process 1277, status = succeeded worker2 # [ 75.396934] nix-daemon[867]: accepted connection from pid 1279, user nix-grpc-daemon (trusted) worker2 # [ 75.412231] nix-daemon[867]: reaped child process 1282, status = succeeded lb # [ 75.385449] niks3-server[949]: 2026/09/22 11:33:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 75.421151] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.587Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 75.422680] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.588Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 75.403433] niks3-server[949]: 2026/09/22 11:33:33 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 75.406168] niks3-server[949]: 2026/09/22 11:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 75.408432] niks3-server[949]: 2026/09/22 11:33:33 INFO Signed narinfos id=25 count=1 worker2 # [ 75.441119] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.607Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.412322] niks3-server[949]: 2026/09/22 11:33:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 75.418294] niks3-server[949]: 2026/09/22 11:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 75.420624] niks3-server[949]: 2026/09/22 11:33:33 INFO Completed upload id=25 worker2 # [ 75.453368] nix-grpc-daemon[882]: time=2026-09-22T11:33:34.619Z level=INFO msg="Upload complete. (237ms)" lb # [ 75.423539] niks3-server[949]: 2026/09/22 11:33:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker2 # [ 75.455569] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 75.459313] nix-grpc-daemon[783]: ts=2026-09-22T11:33:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 75.466054] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 75.468339] nix-daemon[867]: reaped child process 1272, status = succeeded worker2 # [ 75.473630] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 76.719652] nix-daemon[867]: reaped child process 1286, status = succeeded worker2 # [ 76.794870] nix-daemon[867]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 76.809596] nix-daemon[867]: reaped child process 1305, status = succeeded lb # [ 76.784643] niks3-server[949]: 2026/09/22 11:33:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 76.821244] nix-grpc-daemon[882]: time=2026-09-22T11:33:35.987Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 76.822819] nix-grpc-daemon[882]: time=2026-09-22T11:33:35.989Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 76.819339] niks3-server[949]: 2026/09/22 11:33:35 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 76.831621] niks3-server[949]: 2026/09/22 11:33:35 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 76.840860] niks3-server[949]: 2026/09/22 11:33:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 76.845771] niks3-server[949]: 2026/09/22 11:33:35 INFO Signed narinfos id=26 count=1 worker2 # [ 76.879982] nix-grpc-daemon[882]: time=2026-09-22T11:33:36.045Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.851236] niks3-server[949]: 2026/09/22 11:33:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 76.861063] niks3-server[949]: 2026/09/22 11:33:35 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 76.864792] niks3-server[949]: 2026/09/22 11:33:35 INFO Completed upload id=26 worker2 # [ 76.896600] nix-grpc-daemon[882]: time=2026-09-22T11:33:36.062Z level=INFO msg="Upload complete. (215ms)" lb # [ 76.869809] niks3-server[949]: 2026/09/22 11:33:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker2 # [ 76.904568] nix-grpc-daemon[783]: ts=2026-09-22T11:33:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker2 # [ 76.914594] nix-grpc-daemon[783]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 76.924732] nix-daemon[867]: reaped child process 1284, status = succeeded worker2 # [ 76.928685] nix-grpc-daemon[783]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 76.932894] nix-grpc-daemon[783]: ts=2026-09-22T11:33:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=0 paths=1 nar_bytes_out=232 client # [ 77.039527] nix-daemon[1103]: reaped child process 1105, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.97 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top lb # [ 77.039579] envoy[918]: conn peer=[2001:db8:1::1]:37922 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=770 ms=3089 lb # [ 77.043277] envoy[918]: conn peer=[2001:db8:1::1]:37924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1197 ms=3556 client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } lb # [ 77.046824] envoy[918]: conn peer=[2001:db8:1::1]:37936 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3447 tx=1941 ms=1858 lb # [ 77.050485] envoy[918]: conn peer=[2001:db8:1::1]:58672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=56 lb # [ 77.053926] envoy[918]: conn peer=[2001:db8:1::1]:58688 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=461 tx=378 ms=11 lb # [ 77.057363] envoy[918]: conn peer=[2001:db8:1::1]:58684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3876 tx=2140 ms=1603 lb # [ 77.060862] envoy[918]: conn peer=[2001:db8:1::1]:58700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4365 tx=2389 ms=1856 lb # [ 77.065101] envoy[918]: conn peer=[2001:db8:1::1]:58714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=54 client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.03 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 77.707687] nix-daemon[1103]: accepted connection from pid 1186, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 77.832799] nix-grpc-daemon[783]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55832 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 77.845161] nix-grpc-daemon[780]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 77.953282] nix-daemon[844]: accepted connection from pid 1101, user nix-grpc-daemon (trusted) worker1 # [ 77.964694] nix-daemon[844]: reaped child process 1104, status = succeeded lb # [ 77.935886] niks3-server[949]: 2026/09/22 11:33:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 77.982148] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.346Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 77.983483] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.346Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 77.966590] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 77.975741] niks3-server[949]: 2026/09/22 11:33:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 78.019574] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.383Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.982672] niks3-server[949]: 2026/09/22 11:33:36 INFO Signed narinfos id=27 count=1 lb # [ 77.988653] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 78.003121] niks3-server[949]: 2026/09/22 11:33:36 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 78.008381] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo lb # [ 78.010943] niks3-server[949]: 2026/09/22 11:33:36 INFO Completed upload id=27 worker1 # [ 78.048105] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.412Z level=INFO msg="Upload complete. (198ms)" worker2 # [ 78.061859] nix-grpc-daemon[783]: ts=2026-09-22T11:33:37Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 78.066911] nix-grpc-daemon[783]: ts=2026-09-22T11:33:37Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 78.074804] nix-grpc-daemon[780]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 78.085370] nix-grpc-daemon[780]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 78.098756] nix-grpc-daemon[780]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 78.110136] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 78.206746] nix-daemon[844]: accepted connection from pid 1108, user nix-grpc-daemon (trusted) worker1 # [ 78.220358] nix-daemon[844]: reaped child process 1111, status = succeeded worker1 # [ 78.302106] nix-daemon[844]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) worker1 # [ 78.316809] nix-daemon[844]: reaped child process 1116, status = succeeded lb # [ 78.286698] niks3-server[949]: 2026/09/22 11:33:36 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 78.294693] niks3-server[949]: 2026/09/22 11:33:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.340648] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.705Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 78.342046] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.706Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker1 # [ 78.344423] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.708Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 78.328766] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 78.351477] niks3-server[949]: 2026/09/22 11:33:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 78.353993] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 78.357052] niks3-server[949]: 2026/09/22 11:33:36 INFO Signed narinfos id=29 count=2 lb # [ 78.358704] niks3-server[949]: 2026/09/22 11:33:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 78.360631] niks3-server[949]: 2026/09/22 11:33:36 INFO Signed narinfos id=28 count=1 worker1 # [ 78.398421] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.762Z level=INFO msg="Uploading 3 narinfos" lb # [ 78.362968] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 78.375156] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 78.378175] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 78.383420] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 78.386488] niks3-server[949]: 2026/09/22 11:33:36 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 78.390141] niks3-server[949]: 2026/09/22 11:33:36 INFO Completed upload id=28 lb # [ 78.391806] niks3-server[949]: 2026/09/22 11:33:36 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 78.394273] niks3-server[949]: 2026/09/22 11:33:36 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 78.396709] niks3-server[949]: 2026/09/22 11:33:36 INFO Completed upload id=29 worker1 # [ 78.435075] nix-grpc-daemon[872]: time=2026-09-22T11:33:36.799Z level=INFO msg="Upload complete. (311ms)" worker1 # [ 78.439941] nix-grpc-daemon[780]: ts=2026-09-22T11:33:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=2 nar_bytes_in=976 worker1 # [ 78.445553] nix-grpc-daemon[780]: ts=2026-09-22T11:33:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 78.457124] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 78.468288] nix-daemon[844]: reaped child process 1106, status = succeeded worker1 # [ 78.472577] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 79.508942] nix-daemon[844]: reaped child process 1120, status = succeeded worker1 # [ 79.585942] nix-daemon[844]: accepted connection from pid 1136, user nix-grpc-daemon (trusted) worker1 # [ 79.598729] nix-daemon[844]: reaped child process 1139, status = succeeded lb # [ 79.569455] niks3-server[949]: 2026/09/22 11:33:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.614716] nix-grpc-daemon[872]: time=2026-09-22T11:33:37.979Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 79.599103] niks3-server[949]: 2026/09/22 11:33:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 79.607970] niks3-server[949]: 2026/09/22 11:33:37 INFO Signed narinfos id=30 count=1 worker1 # [ 79.648433] nix-grpc-daemon[872]: time=2026-09-22T11:33:38.012Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.614926] niks3-server[949]: 2026/09/22 11:33:37 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 79.621121] niks3-server[949]: 2026/09/22 11:33:37 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 79.632972] niks3-server[949]: 2026/09/22 11:33:37 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete worker1 # [ 79.678377] nix-grpc-daemon[872]: time=2026-09-22T11:33:38.042Z level=INFO msg="Upload complete. (197ms)" lb # [ 79.641598] niks3-server[949]: 2026/09/22 11:33:37 INFO Completed upload id=30 worker1 # [ 79.680876] nix-grpc-daemon[780]: ts=2026-09-22T11:33:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 lb # [ 79.644814] niks3-server[949]: 2026/09/22 11:33:37 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker1 # [ 79.688077] nix-daemon[844]: reaped child process 1118, status = succeeded client # copying 1 paths... worker1 # [ 79.728853] nix-grpc-daemon[780]: ts=2026-09-22T11:33:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46202 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 79.749801] nix-grpc-daemon[780]: ts=2026-09-22T11:33:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 79.754793] nix-grpc-daemon[780]: ts=2026-09-22T11:33:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_out=120 client # [ 79.846905] nix-daemon[1103]: reaped child process 1189, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.26 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 79.946197] nix-daemon[1103]: accepted connection from pid 1208, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 80.080678] nix-grpc-daemon[780]: ts=2026-09-22T11:33:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46202 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 80.079811] nix-grpc-daemon[783]: ts=2026-09-22T11:33:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 80.101206] nix-grpc-daemon[783]: ts=2026-09-22T11:33:39Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 80.106722] nix-grpc-daemon[783]: ts=2026-09-22T11:33:39Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 80.112519] nix-grpc-daemon[783]: ts=2026-09-22T11:33:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 80.123416] nix-grpc-daemon[783]: ts=2026-09-22T11:33:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55832 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 80.139086] nix-grpc-daemon[783]: ts=2026-09-22T11:33:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 80.147726] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 80.164914] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5) worker2 # [ 80.215477] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 174 ms (attempt 2/5) worker2 # [ 80.391609] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 3/5) worker2 # [ 80.529993] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 763 ms (attempt 4/5) worker2 # [ 81.295203] nix-grpc-daemon[783]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 81.296788] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 81.298971] nix-grpc-daemon[783]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 81.392204] nix-daemon[867]: accepted connection from pid 1321, user nix-grpc-daemon (trusted) worker2 # [ 81.408483] nix-daemon[867]: reaped child process 1324, status = succeeded worker2 # [ 81.489866] nix-daemon[867]: accepted connection from pid 1326, user nix-grpc-daemon (trusted) worker2 # [ 81.506610] nix-daemon[867]: reaped child process 1329, status = succeeded lb # [ 81.482615] niks3-server[949]: 2026/09/22 11:33:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.522908] nix-grpc-daemon[882]: time=2026-09-22T11:33:40.688Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 81.524861] nix-grpc-daemon[882]: time=2026-09-22T11:33:40.690Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 81.513981] niks3-server[949]: 2026/09/22 11:33:39 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 81.525790] niks3-server[949]: 2026/09/22 11:33:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker2 # [ 81.562286] nix-grpc-daemon[882]: time=2026-09-22T11:33:40.728Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.530616] niks3-server[949]: 2026/09/22 11:33:39 INFO Signed narinfos id=31 count=1 lb # [ 81.538290] niks3-server[949]: 2026/09/22 11:33:39 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 81.548294] niks3-server[949]: 2026/09/22 11:33:39 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker2 # [ 81.587325] nix-grpc-daemon[882]: time=2026-09-22T11:33:40.753Z level=INFO msg="Upload complete. (275ms)" lb # [ 81.555844] niks3-server[949]: 2026/09/22 11:33:39 INFO Completed upload id=31 worker2 # [ 81.589907] nix-grpc-daemon[783]: ts=2026-09-22T11:33:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 81.560874] niks3-server[949]: 2026/09/22 11:33:39 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker2 # [ 81.594847] nix-grpc-daemon[783]: ts=2026-09-22T11:33:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 81.604124] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) worker2 # [ 81.614829] nix-daemon[867]: reaped child process 1314, status = succeeded worker2 # [ 81.616558] nix-grpc-daemon[783]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 81.624404] nix-daemon[867]: accepted connection from pid 783, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 82.647222] nix-daemon[867]: reaped child process 1334, status = succeeded worker2 # [ 82.727370] nix-daemon[867]: accepted connection from pid 1350, user nix-grpc-daemon (trusted) worker2 # [ 82.741087] nix-daemon[867]: reaped child process 1353, status = succeeded lb # [ 82.718401] niks3-server[949]: 2026/09/22 11:33:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 82.758144] nix-grpc-daemon[882]: time=2026-09-22T11:33:41.924Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 82.757688] niks3-server[949]: 2026/09/22 11:33:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 82.794696] nix-grpc-daemon[882]: time=2026-09-22T11:33:41.960Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.763263] niks3-server[949]: 2026/09/22 11:33:41 INFO Signed narinfos id=32 count=1 lb # [ 82.770842] niks3-server[949]: 2026/09/22 11:33:41 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 82.780360] niks3-server[949]: 2026/09/22 11:33:41 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 82.790800] niks3-server[949]: 2026/09/22 11:33:41 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 82.799123] niks3-server[949]: 2026/09/22 11:33:41 INFO Completed upload id=32 worker2 # [ 82.830781] nix-grpc-daemon[882]: time=2026-09-22T11:33:41.996Z level=INFO msg="Upload complete. (197ms)" lb # [ 82.801304] niks3-server[949]: 2026/09/22 11:33:41 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo client # copying 1 paths... worker2 # [ 82.839452] nix-grpc-daemon[783]: ts=2026-09-22T11:33:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55832 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 worker1 # [ 82.851221] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 82.856794] nix-grpc-daemon[780]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 82.853553] nix-daemon[867]: reaped child process 1331, status = succeeded client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 82.882347] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 82.887382] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_out=120 client # [ 82.987268] nix-daemon[1103]: reaped child process 1211, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.14 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 83.088873] nix-daemon[1103]: accepted connection from pid 1230, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 83.215144] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46202 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 83.218288] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 83.222629] nix-grpc-daemon[872]: time=2026-09-22T11:33:41.586Z level=INFO msg="All 1 paths already cached" worker2 # [ 83.231258] nix-grpc-daemon[783]: ts=2026-09-22T11:33:42Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 83.235570] nix-grpc-daemon[783]: ts=2026-09-22T11:33:42Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 83.248596] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 83.256927] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 83.265964] nix-grpc-daemon[872]: time=2026-09-22T11:33:41.630Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 83.273473] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 83.284328] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 83.382429] nix-daemon[844]: accepted connection from pid 1144, user nix-grpc-daemon (trusted) worker1 # [ 83.395221] nix-daemon[844]: reaped child process 1147, status = succeeded worker1 # [ 83.478036] nix-daemon[844]: accepted connection from pid 1149, user nix-grpc-daemon (trusted) worker1 # [ 83.490340] nix-daemon[844]: reaped child process 1152, status = succeeded lb # [ 83.461176] niks3-server[949]: 2026/09/22 11:33:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 83.509691] nix-grpc-daemon[872]: time=2026-09-22T11:33:41.874Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 83.511235] nix-grpc-daemon[872]: time=2026-09-22T11:33:41.875Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 83.497130] niks3-server[949]: 2026/09/22 11:33:41 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 83.509129] niks3-server[949]: 2026/09/22 11:33:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 83.513499] niks3-server[949]: 2026/09/22 11:33:41 INFO Signed narinfos id=33 count=1 worker1 # [ 83.554603] nix-grpc-daemon[872]: time=2026-09-22T11:33:41.919Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.521973] niks3-server[949]: 2026/09/22 11:33:41 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 83.527805] niks3-server[949]: 2026/09/22 11:33:41 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 83.531372] niks3-server[949]: 2026/09/22 11:33:41 INFO Completed upload id=33 worker1 # [ 83.568527] nix-grpc-daemon[872]: time=2026-09-22T11:33:41.932Z level=INFO msg="Upload complete. (272ms)" lb # [ 83.533347] niks3-server[949]: 2026/09/22 11:33:41 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker1 # [ 83.572602] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_in=560 worker1 # [ 83.577380] nix-grpc-daemon[780]: ts=2026-09-22T11:33:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 83.588277] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 83.591911] nix-daemon[844]: reaped child process 1142, status = succeeded worker1 # [ 83.596505] nix-daemon[844]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 84.229562] nix-daemon[844]: reaped child process 1156, status = succeeded worker1 # [ 84.300481] nix-daemon[844]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker1 # [ 84.312547] nix-daemon[844]: reaped child process 1175, status = succeeded lb # [ 84.283831] niks3-server[949]: 2026/09/22 11:33:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.329359] nix-grpc-daemon[872]: time=2026-09-22T11:33:42.693Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 84.313254] niks3-server[949]: 2026/09/22 11:33:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker1 # [ 84.355692] nix-grpc-daemon[872]: time=2026-09-22T11:33:42.720Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.318500] niks3-server[949]: 2026/09/22 11:33:42 INFO Signed narinfos id=34 count=1 lb # [ 84.329410] niks3-server[949]: 2026/09/22 11:33:42 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 84.339977] niks3-server[949]: 2026/09/22 11:33:42 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 84.347118] niks3-server[949]: 2026/09/22 11:33:42 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 84.353665] niks3-server[949]: 2026/09/22 11:33:42 INFO Completed upload id=34 worker1 # [ 84.390816] nix-grpc-daemon[872]: time=2026-09-22T11:33:42.755Z level=INFO msg="Upload complete. (188ms)" lb # [ 84.358093] niks3-server[949]: 2026/09/22 11:33:42 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker1 # [ 84.396921] nix-grpc-daemon[780]: ts=2026-09-22T11:33:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 client # copying 1 paths... worker1 # [ 84.410193] nix-daemon[844]: reaped child process 1154, status = succeeded worker2 # [ 84.404993] nix-grpc-daemon[783]: ts=2026-09-22T11:33:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55832 worker2 # [ 84.415536] nix-grpc-daemon[783]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 84.452822] nix-grpc-daemon[780]: ts=2026-09-22T11:33:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 worker1 # [ 84.458488] nix-grpc-daemon[780]: ts=2026-09-22T11:33:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46202 duration_s=0 paths=1 nar_bytes_out=120 client # [ 84.515837] nix-daemon[1103]: reaped child process 1233, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.53 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.41 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.25 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.25 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.10 seconds) worker2 # [ 85.276686] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 85.305083] nix-grpc-daemon[783]: ts=2026-09-22T11:33:44Z level=info event=signal_exit lb # [ 85.344620] niks3-server[949]: 2026/09/22 11:33:43 INFO lead: released remote=192.168.1.4:38022 worker1 # [ 86.380822] nix-grpc-daemon[780]: ts=2026-09-22T11:33:44Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 86.381255] nix-grpc-daemon[783]: ts=2026-09-22T11:33:45Z level=info event=scheduler_restarting worker2 # [ 86.384879] nix-grpc-daemon[783]: ts=2026-09-22T11:33:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55828 worker2 # [ 86.389094] nix-grpc-daemon[783]: ts=2026-09-22T11:33:45Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 86.392612] nix-grpc-daemon[783]: ts=2026-09-22T11:33:45Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 86.394249] nix-grpc-daemon[783]: ts=2026-09-22T11:33:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55828 worker2 # [ 86.395670] nix-grpc-daemon[783]: ts=2026-09-22T11:33:45Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 86.407233] nix-daemon[867]: reaped child process 869, status = succeeded worker2 # [ 86.422896] nix-grpc-daemon[783]: E0000 00:00:1790076825.589097 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 86.424832] nix-grpc-daemon[783]: E0000 00:00:1790076825.589174 828 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker1 # [ 86.581563] nix-grpc-daemon[780]: ts=2026-09-22T11:33:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.585633] nix-grpc-daemon[780]: ts=2026-09-22T11:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.594524] nix-grpc-daemon[783]: ts=2026-09-22T11:33:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 86.785960] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.787767] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.988300] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.990360] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 87.040674] envoy[918]: conn peer=[2001:db8:1::1]:58728 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3861 tx=2065 ms=1969 lb # [ 87.044415] envoy[918]: conn peer=[2001:db8:1::1]:58738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=57 lb # [ 87.047884] envoy[918]: conn peer=[2001:db8:1::1]:53222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=56 lb # [ 87.051441] envoy[918]: conn peer=[2001:db8:1::1]:58740 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3727 tx=2148 ms=2860 lb # [ 87.055154] envoy[918]: conn peer=[2001:db8:1::1]:53230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=2080 ms=1253 lb # [ 87.058666] envoy[918]: conn peer=[2001:db8:1::1]:53232 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=18 lb # [ 87.062119] envoy[918]: conn peer=[2001:db8:1::4]:60902 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=47646 tx=2927 ms=69255 worker1 # [ 87.190994] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.192806] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.372540] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_take_over lb # [ 87.335951] niks3-server[949]: 2026/09/22 11:33:45 INFO lead: acquired remote=192.168.1.3:42584 worker1 # [ 87.393598] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.398654] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45394 worker1 # [ 87.400145] nix-grpc-daemon[780]: ts=2026-09-22T11:33:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 88.093689] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 88.097573] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 88.101189] systemd[1]: nix-grpc-daemon.service: Consumed 3.001s CPU time over 1min 10.938s wall clock time, 70.4M memory peak, 106.5K incoming IP traffic, 268K outgoing IP traffic. worker2 # [ 88.112894] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 88.117093] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 88.119882] systemd[1]: nix-grpc-daemon.socket: Consumed 355us CPU time over 1min 20.516s wall clock time, 256K memory peak, 116.3K incoming IP traffic, 98.3K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 88.303814] nix-grpc-daemon[780]: ts=2026-09-22T11:33:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46202 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 88.306165] nix-grpc-daemon[780]: ts=2026-09-22T11:33:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46202 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 88.379781] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 88.411265] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 89.088644] systemd[1]: Starting scheduler-token.service... worker2 # [ 89.153106] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 89.156131] systemd[1]: Finished scheduler-token.service. worker2 # [ 89.159453] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 64ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 89.167739] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 89.246861] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 89.249227] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 89.258128] nix-grpc-daemon[780]: ts=2026-09-22T11:33:47Z level=info event=signal_exit worker2 # [ 89.252646] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 89.257092] nix-grpc-daemon[1380]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 89.259039] nix-grpc-daemon[1380]: E0000 00:00:1790076828.423193 1380 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 89.266068] nix-grpc-daemon[1380]: E0000 00:00:1790076828.429234 1380 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 89.268520] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 89.273027] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 89.277831] nix-grpc-daemon[1380]: E0000 00:00:1790076828.443402 1422 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 89.291546] nix-grpc-daemon[1380]: E0000 00:00:1790076828.457774 1422 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 89.296128] nix-grpc-daemon[1380]: E0000 00:00:1790076828.460381 1422 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 89.306468] nix-grpc-daemon[1380]: E0000 00:00:1790076828.472712 1422 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 89.314796] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.321847] nix-grpc-daemon[780]: ts=2026-09-22T11:33:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45394 worker1 # [ 89.323776] nix-grpc-daemon[780]: ts=2026-09-22T11:33:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 89.341925] niks3-server[949]: 2026/09/22 11:33:47 INFO lead: released remote=192.168.1.3:42584 worker2 # [ 90.374231] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:49Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 90.376795] nix-grpc-daemon[780]: ts=2026-09-22T11:33:48Z level=info event=scheduler_restarting worker1 # [ 90.386554] nix-grpc-daemon[780]: ts=2026-09-22T11:33:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45394 worker1 # [ 90.390881] nix-grpc-daemon[780]: ts=2026-09-22T11:33:48Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 90.394304] nix-grpc-daemon[780]: ts=2026-09-22T11:33:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 90.397594] nix-grpc-daemon[780]: ts=2026-09-22T11:33:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45394 worker1 # [ 90.401288] nix-grpc-daemon[780]: ts=2026-09-22T11:33:48Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 90.404713] nix-grpc-daemon[780]: E0000 00:00:1790076828.755248 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 90.422550] nix-daemon[844]: reaped child process 846, status = succeeded worker2 # [ 90.574431] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.578937] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.595399] nix-grpc-daemon[780]: ts=2026-09-22T11:33:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 90.780218] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.784615] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.985975] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.990543] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.192059] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.196610] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.386537] nix-grpc-daemon[780]: E0000 00:00:1790076829.750338 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 91.399247] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.402917] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.600466] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.605353] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.806332] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.810713] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.012119] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.016702] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.054898] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 92.056492] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 92.058101] systemd[1]: nix-grpc-daemon.service: Consumed 2.227s CPU time over 1min 14.984s wall clock time, 61.1M memory peak, 81.7K incoming IP traffic, 148.5K outgoing IP traffic. worker1 # [ 92.062881] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 92.064629] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 92.066084] systemd[1]: nix-grpc-daemon.socket: Consumed 295us CPU time over 1min 24.253s wall clock time, 256K memory peak, 91.8K incoming IP traffic, 80.7K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 92.211874] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 92.219312] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.223191] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.230788] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 92.249858] nix-grpc-daemon[1380]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5) worker2 # [ 92.293185] nix-grpc-daemon[1380]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 2/5) worker2 # [ 92.296528] nix-grpc-daemon[1380]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 387 ms (attempt 3/5) worker2 # [ 92.421396] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.425162] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.622070] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.623877] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.687476] nix-grpc-daemon[1380]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 594 ms (attempt 4/5) worker2 # [ 92.824625] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.826522] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.027340] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.029233] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.229938] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.233468] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.284326] nix-grpc-daemon[1380]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 93.287925] nix-grpc-daemon[1380]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 93.308645] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 93.322505] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 93.343675] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=niks3_push_started pid=1440 worker2 # [ 93.436524] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.440116] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.447352] nix-grpc-daemon[1440]: time=2026-09-22T11:33:52.613Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 93.530404] nix-daemon[867]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) worker2 # [ 93.545618] nix-daemon[867]: reaped child process 1456, status = succeeded lb # [ 93.520807] niks3-server[949]: 2026/09/22 11:33:51 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 93.526649] niks3-server[949]: 2026/09/22 11:33:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 93.561377] nix-grpc-daemon[1440]: time=2026-09-22T11:33:52.727Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 93.562853] nix-grpc-daemon[1440]: time=2026-09-22T11:33:52.729Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 93.565324] nix-grpc-daemon[1440]: time=2026-09-22T11:33:52.730Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" lb # [ 93.553472] niks3-server[949]: 2026/09/22 11:33:51 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 93.558127] niks3-server[949]: 2026/09/22 11:33:51 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 93.564678] niks3-server[949]: 2026/09/22 11:33:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 93.567564] niks3-server[949]: 2026/09/22 11:33:51 INFO Signed narinfos id=35 count=1 lb # [ 93.570183] niks3-server[949]: 2026/09/22 11:33:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 93.572594] niks3-server[949]: 2026/09/22 11:33:51 INFO Signed narinfos id=36 count=2 worker2 # [ 93.604805] nix-grpc-daemon[1440]: time=2026-09-22T11:33:52.770Z level=INFO msg="Uploading 3 narinfos" lb # [ 93.577150] niks3-server[949]: 2026/09/22 11:33:51 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 93.579512] niks3-server[949]: 2026/09/22 11:33:51 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 93.592190] niks3-server[949]: 2026/09/22 11:33:51 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 93.599713] niks3-server[949]: 2026/09/22 11:33:51 INFO Completed upload id=35 lb # [ 93.603630] niks3-server[949]: 2026/09/22 11:33:51 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 93.605166] niks3-server[949]: 2026/09/22 11:33:51 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo worker2 # [ 93.639827] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.641620] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.643415] nix-grpc-daemon[1440]: time=2026-09-22T11:33:52.809Z level=INFO msg="Upload complete. (192ms)" lb # [ 93.612808] niks3-server[949]: 2026/09/22 11:33:51 INFO Completed upload id=36 worker2 # [ 93.645753] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 93.652749] nix-daemon[867]: reaped child process 1438, status = succeeded lb # [ 93.622855] niks3-server[949]: 2026/09/22 11:33:51 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 93.625442] niks3-server[949]: 2026/09/22 11:33:51 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.58 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.01 seconds) worker1 # [ 93.730849] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 93.736313] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 93.830979] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 93.835596] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 93.837590] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 93.840923] nix-grpc-daemon[1198]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 93.842198] nix-grpc-daemon[1198]: E0000 00:00:1790076832.202998 1198 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 93.842459] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.844617] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.849967] nix-grpc-daemon[1198]: E0000 00:00:1790076832.210143 1198 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 93.854110] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 93.856331] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 93.857831] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=scheduler_take_over lb # [ 93.819723] niks3-server[949]: 2026/09/22 11:33:52 INFO lead: acquired remote=192.168.1.3:56778 worker1 # [ 93.862286] nix-grpc-daemon[1198]: E0000 00:00:1790076832.221096 1240 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 93.873072] nix-grpc-daemon[1198]: E0000 00:00:1790076832.236743 1240 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 93.875187] nix-grpc-daemon[1198]: E0000 00:00:1790076832.236892 1240 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 93.887921] nix-grpc-daemon[1198]: E0000 00:00:1790076832.252376 1240 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 93.902942] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.904812] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 94.045642] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.048075] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.106292] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.113106] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:51926 worker1 # [ 94.116684] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 94.249553] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.264189] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 94.268434] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:51926 worker1 # [ 94.272365] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.45 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 95.023077] systemd[1]: Stopping niks3 server... lb # [ 95.025450] niks3-server[949]: 2026/09/22 11:33:53 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 95.028832] niks3-server[949]: 2026/09/22 11:33:53 INFO lead: released remote=192.168.1.3:56778 worker2 # [ 95.061380] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:54Z level=info event=scheduler_lock_lost status=200 worker1 # [ 95.067288] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:53Z level=info event=scheduler_lock_lost status=200 lb # [ 95.043975] systemd[1]: niks3.service: Deactivated successfully. lb # [ 95.046105] systemd[1]: Stopped niks3 server. lb # [ 95.046799] systemd[1]: niks3.service: Consumed 672ms CPU time over 1min 17.941s wall clock time, 28.6M memory peak, 94.1K incoming IP traffic, 136.2K outgoing IP traffic. lb # [ 95.054141] systemd[1]: Starting niks3 server... lb # [ 95.105438] niks3-server[1092]: 2026/09/22 11:33:53 goose: no migrations to run. current version: 20260920000000 lb # [ 95.111727] niks3-server[1092]: 2026/09/22 11:33:53 OK 1_commit_pending_closure.sql (4.39ms) lb # [ 95.115447] niks3-server[1092]: 2026/09/22 11:33:53 OK 2_object_stats_trigger.sql (2.05ms) lb # [ 95.116610] niks3-server[1092]: 2026/09/22 11:33:53 goose: up to current file version: 2 lb # [ 95.118140] niks3-server[1092]: 2026/09/22 11:33:53 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 95.129922] niks3-server[1092]: 2026/09/22 11:33:53 INFO Read proxy enabled — serving cache objects from S3 lb # [ 95.131209] niks3-server[1092]: 2026/09/22 11:33:53 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 95.133367] niks3-server[1092]: 2026/09/22 11:33:53 INFO systemd watchdog enabled interval=15s lb # [ 95.134672] systemd[1]: Started niks3 server. lb # [ 95.136813] niks3-server[1092]: 2026/09/22 11:33:53 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 95.481440] nix-grpc-daemon[1380]: ts=2026-09-22T11:33:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53054 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 95.501485] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 95.512752] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker1 # [ 95.529264] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5) worker1 # [ 95.548329] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 2/5) worker1 # [ 95.603305] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 356 ms (attempt 3/5) worker1 # [ 95.961554] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 665 ms (attempt 4/5) lb # [ 96.037460] niks3-server[1092]: 2026/09/22 11:33:54 INFO lead: acquired remote=192.168.1.3:56786 worker1 # [ 96.629967] nix-grpc-daemon[1198]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 96.633924] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 96.668574] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 96.670901] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 96.712942] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 96.722150] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51938 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker1 # [ 96.729577] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 96.735962] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker1 # [ 96.746221] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=info event=niks3_push_started pid=1270 worker1 # [ 96.844791] nix-grpc-daemon[1270]: time=2026-09-22T11:33:55.208Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 96.936858] nix-daemon[844]: accepted connection from pid 1283, user nix-grpc-daemon (trusted) worker1 # [ 96.952080] nix-daemon[844]: reaped child process 1286, status = succeeded worker1 # [ 97.041540] nix-daemon[844]: accepted connection from pid 1288, user nix-grpc-daemon (trusted) worker1 # [ 97.057079] nix-daemon[844]: reaped child process 1291, status = succeeded lb # [ 97.026813] niks3-server[1092]: 2026/09/22 11:33:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.077079] nix-grpc-daemon[1270]: time=2026-09-22T11:33:55.440Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 97.078481] nix-grpc-daemon[1270]: time=2026-09-22T11:33:55.440Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 97.040449] envoy[918]: conn peer=[2001:db8:1::1]:53244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=9 lb # [ 97.044941] envoy[918]: conn peer=[2001:db8:1::3]:43530 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=13892 tx=2867 ms=73298 lb # [ 97.050452] envoy[918]: conn peer=[2001:db8:1::1]:53254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1002 tx=282 ms=1444 lb # [ 97.079892] niks3-server[1092]: 2026/09/22 11:33:55 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 97.086621] niks3-server[1092]: 2026/09/22 11:33:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 97.101308] niks3-server[1092]: 2026/09/22 11:33:55 INFO Signed narinfos id=37 count=1 worker1 # [ 97.138648] nix-grpc-daemon[1270]: time=2026-09-22T11:33:55.502Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.108056] niks3-server[1092]: 2026/09/22 11:33:55 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 97.117403] niks3-server[1092]: 2026/09/22 11:33:55 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 97.125735] niks3-server[1092]: 2026/09/22 11:33:55 INFO Completed upload id=37 worker1 # [ 97.164308] nix-grpc-daemon[1270]: time=2026-09-22T11:33:55.528Z level=INFO msg="Upload complete. (315ms)" lb # [ 97.129950] niks3-server[1092]: 2026/09/22 11:33:55 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker1 # [ 97.166936] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51938 duration_s=0 paths=1 nar_bytes_in=536 worker1 # [ 97.171654] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 97.178956] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker1 # [ 97.181523] nix-daemon[844]: reaped child process 1268, status = succeeded worker1 # [ 97.187099] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 97.803577] nix-daemon[844]: reaped child process 1295, status = succeeded worker1 # [ 97.884643] nix-daemon[844]: accepted connection from pid 1312, user nix-grpc-daemon (trusted) worker1 # [ 97.899969] nix-daemon[844]: reaped child process 1315, status = succeeded lb # [ 97.869287] niks3-server[1092]: 2026/09/22 11:33:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.918056] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.282Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 97.920051] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.284Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 97.908473] niks3-server[1092]: 2026/09/22 11:33:56 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 97.922697] niks3-server[1092]: 2026/09/22 11:33:56 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 97.935511] niks3-server[1092]: 2026/09/22 11:33:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 97.941447] niks3-server[1092]: 2026/09/22 11:33:56 INFO Signed narinfos id=38 count=1 worker1 # [ 97.978512] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.342Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.947652] niks3-server[1092]: 2026/09/22 11:33:56 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 97.954241] niks3-server[1092]: 2026/09/22 11:33:56 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 97.957142] niks3-server[1092]: 2026/09/22 11:33:56 INFO Completed upload id=38 worker1 # [ 97.995507] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.359Z level=INFO msg="Upload complete. (201ms)" lb # [ 97.960284] niks3-server[1092]: 2026/09/22 11:33:56 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker1 # [ 98.001759] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 duration_s=0 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker1 # [ 98.016896] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 98.022092] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 98.031229] nix-daemon[844]: reaped child process 1293, status = succeeded worker1 # [ 98.060797] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 98.073828] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 98.088393] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.452Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker1 # [ 98.098191] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 98.108175] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker1 # [ 98.208100] nix-daemon[844]: accepted connection from pid 1321, user nix-grpc-daemon (trusted) worker1 # [ 98.222933] nix-daemon[844]: reaped child process 1324, status = succeeded worker1 # [ 98.310969] nix-daemon[844]: accepted connection from pid 1326, user nix-grpc-daemon (trusted) worker1 # [ 98.326045] nix-daemon[844]: reaped child process 1329, status = succeeded lb # [ 98.296294] niks3-server[1092]: 2026/09/22 11:33:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.343881] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.707Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 98.345283] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.708Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 98.324572] niks3-server[1092]: 2026/09/22 11:33:56 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 98.337718] niks3-server[1092]: 2026/09/22 11:33:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 98.345956] niks3-server[1092]: 2026/09/22 11:33:56 INFO Signed narinfos id=39 count=1 worker1 # [ 98.385905] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.750Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.351333] niks3-server[1092]: 2026/09/22 11:33:56 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 98.363896] niks3-server[1092]: 2026/09/22 11:33:56 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 98.372664] niks3-server[1092]: 2026/09/22 11:33:56 INFO Completed upload id=39 worker1 # [ 98.409761] nix-grpc-daemon[1270]: time=2026-09-22T11:33:56.774Z level=INFO msg="Upload complete. (291ms)" lb # [ 98.375579] niks3-server[1092]: 2026/09/22 11:33:56 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker1 # [ 98.414532] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51938 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 98.420546] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 98.432111] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker1 # [ 98.437934] nix-daemon[844]: reaped child process 1319, status = succeeded worker1 # [ 98.442864] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 99.878896] nix-daemon[844]: reaped child process 1333, status = succeeded worker1 # [ 99.970608] nix-daemon[844]: accepted connection from pid 1349, user nix-grpc-daemon (trusted) worker1 # [ 99.986036] nix-daemon[844]: reaped child process 1352, status = succeeded lb # [ 99.956406] niks3-server[1092]: 2026/09/22 11:33:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 100.003065] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.367Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 100.004994] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.369Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 100.001556] niks3-server[1092]: 2026/09/22 11:33:58 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 100.014827] niks3-server[1092]: 2026/09/22 11:33:58 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 100.023513] niks3-server[1092]: 2026/09/22 11:33:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 100.027299] niks3-server[1092]: 2026/09/22 11:33:58 INFO Signed narinfos id=40 count=1 worker1 # [ 100.067196] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.431Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.033733] niks3-server[1092]: 2026/09/22 11:33:58 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 100.038237] niks3-server[1092]: 2026/09/22 11:33:58 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 100.043281] niks3-server[1092]: 2026/09/22 11:33:58 INFO Completed upload id=40 worker1 # [ 100.080450] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.444Z level=INFO msg="Upload complete. (227ms)" lb # [ 100.045773] niks3-server[1092]: 2026/09/22 11:33:58 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker1 # [ 100.086997] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker1 # [ 100.102556] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 100.105865] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 100.117560] nix-daemon[844]: reaped child process 1331, status = succeeded worker1 # [ 100.145730] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 100.158760] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 100.172398] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.536Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker1 # [ 100.180559] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 100.188720] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker1 # [ 100.292850] nix-daemon[844]: accepted connection from pid 1358, user nix-grpc-daemon (trusted) worker1 # [ 100.308388] nix-daemon[844]: reaped child process 1361, status = succeeded worker1 # [ 100.395199] nix-daemon[844]: accepted connection from pid 1363, user nix-grpc-daemon (trusted) worker1 # [ 100.409977] nix-daemon[844]: reaped child process 1366, status = succeeded lb # [ 100.379945] niks3-server[1092]: 2026/09/22 11:33:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 100.426805] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.791Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 100.428844] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.792Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 100.411661] niks3-server[1092]: 2026/09/22 11:33:58 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 100.419193] niks3-server[1092]: 2026/09/22 11:33:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 100.464439] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.828Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.427323] niks3-server[1092]: 2026/09/22 11:33:58 INFO Signed narinfos id=41 count=1 lb # [ 100.433894] niks3-server[1092]: 2026/09/22 11:33:58 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 100.444775] niks3-server[1092]: 2026/09/22 11:33:58 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 100.449191] niks3-server[1092]: 2026/09/22 11:33:58 INFO Completed upload id=41 worker1 # [ 100.486124] nix-grpc-daemon[1270]: time=2026-09-22T11:33:58.850Z level=INFO msg="Upload complete. (284ms)" lb # [ 100.451404] niks3-server[1092]: 2026/09/22 11:33:58 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker1 # [ 100.489416] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51938 duration_s=0 paths=1 nar_bytes_in=784 worker1 # [ 100.494346] nix-grpc-daemon[1198]: ts=2026-09-22T11:33:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 worker1 # [ 100.503581] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker1 # [ 100.510209] nix-daemon[844]: reaped child process 1356, status = succeeded client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... worker1 # [ 100.516342] nix-daemon[844]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 101.532953] nix-daemon[844]: reaped child process 1370, status = succeeded worker1 # [ 101.614300] nix-daemon[844]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker1 # [ 101.629769] nix-daemon[844]: reaped child process 1389, status = succeeded lb # [ 101.601257] niks3-server[1092]: 2026/09/22 11:33:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 101.647442] nix-grpc-daemon[1270]: time=2026-09-22T11:34:00.011Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 101.648992] nix-grpc-daemon[1270]: time=2026-09-22T11:34:00.013Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 101.638265] niks3-server[1092]: 2026/09/22 11:33:59 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 101.646853] niks3-server[1092]: 2026/09/22 11:33:59 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 101.661568] niks3-server[1092]: 2026/09/22 11:34:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 101.668452] niks3-server[1092]: 2026/09/22 11:34:00 INFO Signed narinfos id=42 count=1 worker1 # [ 101.708173] nix-grpc-daemon[1270]: time=2026-09-22T11:34:00.072Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.671424] niks3-server[1092]: 2026/09/22 11:34:00 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 101.682206] niks3-server[1092]: 2026/09/22 11:34:00 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 101.685880] niks3-server[1092]: 2026/09/22 11:34:00 INFO Completed upload id=42 worker1 # [ 101.722971] nix-grpc-daemon[1270]: time=2026-09-22T11:34:00.087Z level=INFO msg="Upload complete. (200ms)" lb # [ 101.687717] niks3-server[1092]: 2026/09/22 11:34:00 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker1 # [ 101.731942] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51938 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker1 # [ 101.746932] nix-daemon[844]: reaped child process 1368, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 6.40 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.91 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 102.024622] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 102.852071] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:01Z level=info event=signal_exit lb # [ 103.041872] niks3-server[1092]: 2026/09/22 11:34:01 INFO lead: released remote=192.168.1.3:56786 worker1 # [ 104.077208] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:02Z level=info event=scheduler_restarting worker2 # [ 104.074469] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:03Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 104.080626] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:51926 worker1 # [ 104.083781] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:02Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 104.085323] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:02Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 104.086644] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:51926 worker1 # [ 104.088143] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:02Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 104.101437] nix-grpc-daemon[1198]: E0000 00:00:1790076842.465812 1243 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker1 # [ 104.107220] nix-grpc-daemon[1198]: E0000 00:00:1790076842.471166 1243 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 104.119371] nix-daemon[844]: reaped child process 1258, status = succeeded worker2 # [ 104.274513] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.278779] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.294922] nix-grpc-daemon[1198]: ts=2026-09-22T11:34:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 104.480069] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.484137] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.685313] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.689352] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.890445] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.894515] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.096499] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.100242] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.291471] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 105.293335] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 105.295333] systemd[1]: nix-grpc-daemon.service: Consumed 1.033s CPU time over 11.557s wall clock time, 38.8M memory peak, 35.2K incoming IP traffic, 58.4K outgoing IP traffic. worker1 # [ 105.299876] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 105.302181] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 105.305835] systemd[1]: nix-grpc-daemon.socket: Consumed 563us CPU time over 11.578s wall clock time, 256K memory peak, 33.4K incoming IP traffic, 24.3K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 105.301183] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.305168] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 105.506304] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.510315] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.710927] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.712714] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.914161] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.918192] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.070483] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=scheduler_take_over lb # [ 106.038973] niks3-server[1092]: 2026/09/22 11:34:04 INFO lead: acquired remote=192.168.1.4:43384 worker2 # [ 106.120372] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.123466] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.320858] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.335132] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 106.338858] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:39748 worker2 # [ 106.342678] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker2 # [ 106.575275] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53054 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 106.584127] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 106.609919] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 106.615516] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 106.654659] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 106.669084] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53054 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 106.682057] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 106.693208] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 106.803115] nix-daemon[867]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker2 # [ 106.817831] nix-daemon[867]: reaped child process 1482, status = succeeded worker2 # [ 106.906522] nix-daemon[867]: accepted connection from pid 1484, user nix-grpc-daemon (trusted) worker2 # [ 106.920700] nix-daemon[867]: reaped child process 1487, status = succeeded lb # [ 106.896039] niks3-server[1092]: 2026/09/22 11:34:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 106.933068] nix-grpc-daemon[1440]: time=2026-09-22T11:34:06.098Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 106.934432] nix-grpc-daemon[1440]: time=2026-09-22T11:34:06.098Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 106.909298] niks3-server[1092]: 2026/09/22 11:34:05 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 106.912829] niks3-server[1092]: 2026/09/22 11:34:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 106.944473] nix-grpc-daemon[1440]: time=2026-09-22T11:34:06.110Z level=INFO msg="Uploading 1 narinfos" lb # [ 106.914452] niks3-server[1092]: 2026/09/22 11:34:05 INFO Signed narinfos id=43 count=1 lb # [ 106.922558] niks3-server[1092]: 2026/09/22 11:34:05 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker2 # [ 106.958575] nix-grpc-daemon[1440]: time=2026-09-22T11:34:06.124Z level=INFO msg="Upload complete. (254ms)" lb # [ 106.928245] niks3-server[1092]: 2026/09/22 11:34:05 INFO Completed upload id=43 worker2 # [ 106.960841] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=0 paths=1 nar_bytes_in=520 lb # [ 106.930778] niks3-server[1092]: 2026/09/22 11:34:05 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls worker2 # [ 106.965975] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 106.972873] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 106.975200] nix-daemon[867]: reaped child process 1477, status = succeeded client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker2 # [ 106.980659] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) lb # [ 107.040790] envoy[918]: conn peer=[2001:db8:1::1]:44050 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9666 tx=4426 ms=6259 lb # [ 107.045302] envoy[918]: conn peer=[2001:db8:1::3]:47754 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1328 tx=513 ms=10390 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 108.197249] nix-daemon[867]: reaped child process 1491, status = succeeded worker2 # [ 108.277336] nix-daemon[867]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker2 # [ 108.290946] nix-daemon[867]: reaped child process 1510, status = succeeded lb # [ 108.269584] niks3-server[1092]: 2026/09/22 11:34:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 108.311231] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.477Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 108.312862] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.479Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 108.313270] niks3-server[1092]: 2026/09/22 11:34:06 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 108.327614] niks3-server[1092]: 2026/09/22 11:34:06 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 108.332636] niks3-server[1092]: 2026/09/22 11:34:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 108.338102] niks3-server[1092]: 2026/09/22 11:34:06 INFO Signed narinfos id=44 count=1 worker2 # [ 108.369360] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.535Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.347056] niks3-server[1092]: 2026/09/22 11:34:06 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 108.350896] niks3-server[1092]: 2026/09/22 11:34:06 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 108.356221] niks3-server[1092]: 2026/09/22 11:34:06 INFO Completed upload id=44 worker2 # [ 108.388099] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.554Z level=INFO msg="Upload complete. (199ms)" lb # [ 108.358972] niks3-server[1092]: 2026/09/22 11:34:06 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker2 # [ 108.395650] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker2 # [ 108.407944] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 108.411984] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 108.422416] nix-daemon[867]: reaped child process 1489, status = succeeded worker2 # [ 108.452405] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 108.464528] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 108.479093] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.645Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 108.487742] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 108.497321] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 108.599759] nix-daemon[867]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 108.613755] nix-daemon[867]: reaped child process 1519, status = succeeded worker2 # [ 108.703386] nix-daemon[867]: accepted connection from pid 1521, user nix-grpc-daemon (trusted) worker2 # [ 108.717629] nix-daemon[867]: reaped child process 1524, status = succeeded lb # [ 108.692066] niks3-server[1092]: 2026/09/22 11:34:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 108.732024] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.898Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 108.733513] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.899Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 108.725257] niks3-server[1092]: 2026/09/22 11:34:07 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 108.734104] niks3-server[1092]: 2026/09/22 11:34:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 108.742458] niks3-server[1092]: 2026/09/22 11:34:07 INFO Signed narinfos id=45 count=1 worker2 # [ 108.777937] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.944Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.750807] niks3-server[1092]: 2026/09/22 11:34:07 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 108.761977] niks3-server[1092]: 2026/09/22 11:34:07 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 108.768260] niks3-server[1092]: 2026/09/22 11:34:07 INFO Completed upload id=45 worker2 # [ 108.799825] nix-grpc-daemon[1440]: time=2026-09-22T11:34:07.966Z level=INFO msg="Upload complete. (290ms)" lb # [ 108.772657] niks3-server[1092]: 2026/09/22 11:34:07 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 108.804485] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 108.810764] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 108.820116] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 108.828603] nix-daemon[867]: reaped child process 1514, status = succeeded worker2 # [ 108.833738] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 109.878779] nix-daemon[867]: reaped child process 1528, status = succeeded worker2 # [ 109.956890] nix-daemon[867]: accepted connection from pid 1544, user nix-grpc-daemon (trusted) worker2 # [ 109.969645] nix-daemon[867]: reaped child process 1547, status = succeeded lb # [ 109.944704] niks3-server[1092]: 2026/09/22 11:34:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 109.984513] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.150Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 109.986763] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.152Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 109.981202] niks3-server[1092]: 2026/09/22 11:34:08 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 109.991182] niks3-server[1092]: 2026/09/22 11:34:08 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 109.999845] niks3-server[1092]: 2026/09/22 11:34:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 110.006206] niks3-server[1092]: 2026/09/22 11:34:08 INFO Signed narinfos id=46 count=1 worker2 # [ 110.040284] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.206Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.016744] niks3-server[1092]: 2026/09/22 11:34:08 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 110.021331] niks3-server[1092]: 2026/09/22 11:34:08 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 110.027984] niks3-server[1092]: 2026/09/22 11:34:08 INFO Completed upload id=46 worker2 # [ 110.059683] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.225Z level=INFO msg="Upload complete. (218ms)" lb # [ 110.030096] niks3-server[1092]: 2026/09/22 11:34:08 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 110.066640] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker2 # [ 110.078524] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 110.082182] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 110.092821] nix-daemon[867]: reaped child process 1526, status = succeeded worker2 # [ 110.122738] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 110.134683] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 110.148520] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.314Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 110.157452] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 110.165733] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 110.269245] nix-daemon[867]: accepted connection from pid 1553, user nix-grpc-daemon (trusted) worker2 # [ 110.283190] nix-daemon[867]: reaped child process 1556, status = succeeded worker2 # [ 110.373350] nix-daemon[867]: accepted connection from pid 1558, user nix-grpc-daemon (trusted) worker2 # [ 110.387060] nix-daemon[867]: reaped child process 1561, status = succeeded lb # [ 110.362739] niks3-server[1092]: 2026/09/22 11:34:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 110.402243] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.568Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 110.404119] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.569Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 110.392457] niks3-server[1092]: 2026/09/22 11:34:08 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 110.398621] niks3-server[1092]: 2026/09/22 11:34:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 110.403504] niks3-server[1092]: 2026/09/22 11:34:08 INFO Signed narinfos id=47 count=1 worker2 # [ 110.438137] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.604Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.411094] niks3-server[1092]: 2026/09/22 11:34:08 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 110.425363] niks3-server[1092]: 2026/09/22 11:34:08 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete worker2 # [ 110.462183] nix-grpc-daemon[1440]: time=2026-09-22T11:34:09.628Z level=INFO msg="Upload complete. (283ms)" lb # [ 110.431146] niks3-server[1092]: 2026/09/22 11:34:08 INFO Completed upload id=47 worker2 # [ 110.464433] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 110.467610] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 lb # [ 110.436240] niks3-server[1092]: 2026/09/22 11:34:08 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 110.475476] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 110.477780] nix-daemon[867]: reaped child process 1551, status = succeeded client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 110.483217] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 111.499696] nix-daemon[867]: reaped child process 1565, status = succeeded worker2 # [ 111.580471] nix-daemon[867]: accepted connection from pid 1581, user nix-grpc-daemon (trusted) worker2 # [ 111.594637] nix-daemon[867]: reaped child process 1584, status = succeeded lb # [ 111.570316] niks3-server[1092]: 2026/09/22 11:34:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 111.612414] nix-grpc-daemon[1440]: time=2026-09-22T11:34:10.778Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 111.613899] nix-grpc-daemon[1440]: time=2026-09-22T11:34:10.780Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 111.612460] niks3-server[1092]: 2026/09/22 11:34:09 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 111.618685] niks3-server[1092]: 2026/09/22 11:34:09 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 111.626388] niks3-server[1092]: 2026/09/22 11:34:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker2 # [ 111.663638] nix-grpc-daemon[1440]: time=2026-09-22T11:34:10.829Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.633142] niks3-server[1092]: 2026/09/22 11:34:09 INFO Signed narinfos id=48 count=1 lb # [ 111.643214] niks3-server[1092]: 2026/09/22 11:34:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 111.649544] niks3-server[1092]: 2026/09/22 11:34:10 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 111.656350] niks3-server[1092]: 2026/09/22 11:34:10 INFO Completed upload id=48 worker2 # [ 111.687978] nix-grpc-daemon[1440]: time=2026-09-22T11:34:10.854Z level=INFO msg="Upload complete. (197ms)" lb # [ 111.659255] niks3-server[1092]: 2026/09/22 11:34:10 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 111.696385] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker2 # [ 111.710071] nix-daemon[867]: reaped child process 1563, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.30 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.12 seconds) worker1 # [ 111.878295] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 111.880821] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 111.965378] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:10Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 111.967505] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 111.971190] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 111.975056] nix-grpc-daemon[1407]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 111.976380] nix-grpc-daemon[1407]: E0000 00:00:1790076850.339409 1407 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 111.982552] nix-grpc-daemon[1407]: E0000 00:00:1790076850.344660 1407 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 111.986915] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 111.988442] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 111.995066] nix-grpc-daemon[1407]: E0000 00:00:1790076850.356637 1449 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 112.007084] nix-grpc-daemon[1407]: E0000 00:00:1790076850.370315 1449 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 112.010167] nix-grpc-daemon[1407]: E0000 00:00:1790076850.370730 1449 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 112.020675] nix-grpc-daemon[1407]: E0000 00:00:1790076850.385195 1449 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 112.032745] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.029555] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39748 worker2 # [ 112.033315] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 10.30 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 112.226754] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: e7e05586ac714dcd9e7acfec0c7b90ba client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) client # [ 112.370856] nix[1357]: don't know how to build these paths: client # [ 112.371859] nix[1357]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 112.373826] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 112.384145] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 112.389459] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 112.428595] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 112.440914] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53054 client # [ 112.447182] nix[1357]: copying 1 paths to 'lb:50051'... worker2 # [ 112.451920] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 client # [ 112.449100] nix[1357]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 112.463129] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 112.567271] nix-daemon[867]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker2 # [ 112.582357] nix-daemon[867]: reaped child process 1600, status = succeeded worker2 # [ 112.668616] nix-daemon[867]: accepted connection from pid 1602, user nix-grpc-daemon (trusted) worker2 # [ 112.681995] nix-daemon[867]: reaped child process 1605, status = succeeded lb # [ 112.658518] niks3-server[1092]: 2026/09/22 11:34:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 112.698957] nix-grpc-daemon[1440]: time=2026-09-22T11:34:11.864Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 112.700369] nix-grpc-daemon[1440]: time=2026-09-22T11:34:11.864Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 112.689323] niks3-server[1092]: 2026/09/22 11:34:11 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 112.702960] niks3-server[1092]: 2026/09/22 11:34:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker2 # [ 112.739617] nix-grpc-daemon[1440]: time=2026-09-22T11:34:11.905Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.708151] niks3-server[1092]: 2026/09/22 11:34:11 INFO Signed narinfos id=49 count=1 lb # [ 112.718118] niks3-server[1092]: 2026/09/22 11:34:11 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 112.729118] niks3-server[1092]: 2026/09/22 11:34:11 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 112.735284] niks3-server[1092]: 2026/09/22 11:34:11 INFO Completed upload id=49 lb # [ 112.737036] niks3-server[1092]: 2026/09/22 11:34:11 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 112.768197] nix-grpc-daemon[1440]: time=2026-09-22T11:34:11.934Z level=INFO msg="Upload complete. (293ms)" worker2 # [ 112.772601] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 112.777852] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 worker2 # [ 112.789105] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 112.794135] nix-daemon[867]: reaped child process 1595, status = succeeded worker2 # [ 112.798705] nix-daemon[867]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) client # [ 112.794244] nix[1357]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 114.863279] systemd-journald[284]: Received client request to rotate journal, rotating. worker1 # [ 114.879978] systemd-journald[284]: Vacuuming done, freed 0B of archived journals from /var/log/journal/3601fef59206499596e6cc623bbc8868. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 114.785331] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker2 # [ 115.275918] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:14Z level=info event=draining lb # [ 117.040295] envoy[918]: conn peer=[2001:db8:1::1]:59990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9603 tx=4395 ms=5132 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 120.019512] nix-daemon[867]: reaped child process 1609, status = succeeded worker2 # [ 120.098080] nix-daemon[867]: accepted connection from pid 1650, user nix-grpc-daemon (trusted) worker2 # [ 120.109827] nix-daemon[867]: reaped child process 1653, status = succeeded lb # [ 120.087341] niks3-server[1092]: 2026/09/22 11:34:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.127606] nix-grpc-daemon[1440]: time=2026-09-22T11:34:19.293Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.129082] nix-grpc-daemon[1440]: time=2026-09-22T11:34:19.295Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 120.121205] niks3-server[1092]: 2026/09/22 11:34:18 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 120.138136] niks3-server[1092]: 2026/09/22 11:34:18 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 120.149511] niks3-server[1092]: 2026/09/22 11:34:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker2 # [ 120.185914] nix-grpc-daemon[1440]: time=2026-09-22T11:34:19.352Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.154834] niks3-server[1092]: 2026/09/22 11:34:18 INFO Signed narinfos id=50 count=1 lb # [ 120.159853] niks3-server[1092]: 2026/09/22 11:34:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 120.168602] niks3-server[1092]: 2026/09/22 11:34:18 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 120.172190] niks3-server[1092]: 2026/09/22 11:34:18 INFO Completed upload id=50 worker2 # [ 120.203787] nix-grpc-daemon[1440]: time=2026-09-22T11:34:19.370Z level=INFO msg="Upload complete. (192ms)" lb # [ 120.175054] niks3-server[1092]: 2026/09/22 11:34:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 120.211426] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53054 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 120.224541] nix-daemon[867]: reaped child process 1607, status = succeeded client # [ 120.234954] systemd[1]: rs.service: Deactivated successfully. client # [ 120.238687] systemd[1]: rs.service: Consumed 131ms CPU time over 8.011s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 120.277496] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:19Z level=info event=signal_exit lb # [ 121.040226] niks3-server[1092]: 2026/09/22 11:34:19 INFO lead: released remote=192.168.1.4:43384 lb # [ 121.957986] niks3-server[1092]: 2026/09/22 11:34:20 INFO lead: acquired remote=192.168.1.3:36290 worker1 # [ 121.995137] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:20Z level=info event=scheduler_take_over worker1 # [ 122.077851] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:20Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 122.074732] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:21Z level=info event=scheduler_restarting worker2 # [ 122.079967] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:21Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 122.083806] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39748 worker2 # [ 122.087798] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:21Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 122.090987] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39748 worker2 # [ 122.094493] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:21Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 122.110451] nix-daemon[867]: reaped child process 1432, status = succeeded worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.13 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1 # [ 122.279305] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.283369] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 122.286849] nix-grpc-daemon[1380]: ts=2026-09-22T11:34:21Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 122.344911] nix-grpc-daemon[1380]: E0000 00:00:1790076861.510633 1425 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker2 # [ 122.349947] nix-grpc-daemon[1380]: E0000 00:00:1790076861.510932 1425 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 122.484077] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.491173] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60566 worker1 # [ 122.494879] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 124.135964] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 124.139091] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 124.142448] systemd[1]: nix-grpc-daemon.service: Consumed 1.482s CPU time over 34.967s wall clock time, 39.5M memory peak, 60.3K incoming IP traffic, 145.2K outgoing IP traffic. worker2 # [ 124.157151] systemd[1]: Starting scheduler-token.service... worker2 # [ 124.202456] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 124.204238] systemd[1]: Finished scheduler-token.service. worker2 # [ 124.206100] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 47ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 124.210086] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 124.286785] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 124.288888] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 124.292629] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 124.297063] nix-grpc-daemon[1663]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 124.298413] nix-grpc-daemon[1663]: E0000 00:00:1790076863.462652 1663 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 124.303764] nix-grpc-daemon[1663]: E0000 00:00:1790076863.467843 1663 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 124.306300] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 124.307831] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 124.312063] nix-grpc-daemon[1663]: E0000 00:00:1790076863.478102 1705 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 124.323984] nix-grpc-daemon[1663]: E0000 00:00:1790076863.490266 1705 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 124.327205] nix-grpc-daemon[1663]: E0000 00:00:1790076863.490488 1705 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 124.338247] nix-grpc-daemon[1663]: E0000 00:00:1790076863.504489 1705 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 124.347412] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:23Z level=info event=scheduler_connected addr=lb:50051 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 124.363109] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:22Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 124.366204] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:22Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60566 worker1 # [ 124.370149] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:22Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.24 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 124.466564] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 59f3f172c8dc44c2a3100061f9dfa07f client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker1 # [ 124.619253] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45026 worker1 # [ 124.630687] nix-daemon[844]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # [ 124.633076] nix[1393]: don't know how to build these paths: client # [ 124.634213] nix[1393]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 124.648920] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:23Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 124.653526] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:23Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 124.697691] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45026 worker1 # [ 124.708257] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5) worker1 # [ 124.737177] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 129 ms (attempt 2/5) worker1 # [ 124.868360] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 317 ms (attempt 3/5) worker1 # [ 125.187221] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 659 ms (attempt 4/5) worker1 # [ 125.855317] nix-grpc-daemon[1407]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 125.858502] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 125.875332] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45026 client # [ 125.876309] nix[1393]: copying 1 paths to 'lb:50051'... client # [ 125.879737] nix[1393]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 125.889784] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45026 worker1 # [ 125.900296] nix-daemon[844]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 125.919774] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:24Z level=info event=niks3_push_started pid=1533 worker1 # [ 126.017724] nix-grpc-daemon[1533]: time=2026-09-22T11:34:24.381Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 126.101890] nix-daemon[844]: accepted connection from pid 1546, user nix-grpc-daemon (trusted) worker1 # [ 126.113583] nix-daemon[844]: reaped child process 1549, status = succeeded worker1 # [ 126.191295] nix-daemon[844]: accepted connection from pid 1551, user nix-grpc-daemon (trusted) worker1 # [ 126.204305] nix-daemon[844]: reaped child process 1554, status = succeeded lb # [ 126.173837] niks3-server[1092]: 2026/09/22 11:34:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 126.217718] nix-grpc-daemon[1533]: time=2026-09-22T11:34:24.582Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 126.220771] nix-grpc-daemon[1533]: time=2026-09-22T11:34:24.583Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 126.212642] niks3-server[1092]: 2026/09/22 11:34:24 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 126.224659] niks3-server[1092]: 2026/09/22 11:34:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 126.232492] niks3-server[1092]: 2026/09/22 11:34:24 INFO Signed narinfos id=51 count=1 worker1 # [ 126.272601] nix-grpc-daemon[1533]: time=2026-09-22T11:34:24.636Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.243834] niks3-server[1092]: 2026/09/22 11:34:24 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 126.252885] niks3-server[1092]: 2026/09/22 11:34:24 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 126.256535] niks3-server[1092]: 2026/09/22 11:34:24 INFO Completed upload id=51 worker1 # [ 126.293615] nix-grpc-daemon[1533]: time=2026-09-22T11:34:24.658Z level=INFO msg="Upload complete. (272ms)" lb # [ 126.259950] niks3-server[1092]: 2026/09/22 11:34:24 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 126.297543] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45026 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 126.303953] nix-grpc-daemon[1407]: ts=2026-09-22T11:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45026 worker1 # [ 126.313124] nix-daemon[844]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 126.323130] nix-daemon[844]: reaped child process 1531, status = succeeded worker1 # [ 126.326734] nix-daemon[844]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # [ 126.316866] nix[1393]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb # [ 127.041281] envoy[918]: conn peer=[2001:db8:1::1]:60004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2960 tx=1517 ms=7846 lb # [ 127.042817] envoy[918]: conn peer=[2001:db8:1::4]:33332 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=26829 tx=1588 ms=32964 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 128.020262] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1407 (nix-grpc-daemon) on client request. worker1 # [ 128.022320] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 127.993121] niks3-server[1092]: 2026/09/22 11:34:26 INFO lead: released remote=192.168.1.3:36290 worker1 # [ 128.035760] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 128.037282] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. client # [ 128.024220] nix[1393]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 128.028349] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker1 # [ 128.039132] systemd[1]: nix-grpc-daemon.service: Consumed 416ms CPU time over 16.152s wall clock time, 35.6M memory peak, 14.5K incoming IP traffic, 26.6K outgoing IP traffic. client # [ 128.029147] nix[1393]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 128.049351] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 128.050915] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 128.074379] nix-daemon[844]: reaped child process 1556, status = succeeded worker1 # [ 128.081729] nix-daemon[844]: reaped child process 1519, status = succeeded worker1 # [ 128.090784] nix-daemon[1558]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 128.099206] nix-daemon[844]: reaped child process 1558, status = failed with exit code 1 worker1 # [ 128.141512] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 128.143630] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 128.146820] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 128.151395] nix-grpc-daemon[1594]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 128.154189] nix-grpc-daemon[1594]: E0000 00:00:1790076866.515927 1594 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.160796] nix-grpc-daemon[1594]: E0000 00:00:1790076866.521092 1594 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.163852] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 128.166370] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 128.131434] niks3-server[1092]: 2026/09/22 11:34:26 INFO lead: acquired remote=192.168.1.3:55106 worker1 # [ 128.171174] nix-grpc-daemon[1594]: E0000 00:00:1790076866.531792 1636 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.174106] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=scheduler_take_over worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.19 seconds) client: must succeed: sleep 5.0 worker1 # [ 128.182068] nix-grpc-daemon[1594]: E0000 00:00:1790076866.546512 1636 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.185159] nix-grpc-daemon[1594]: E0000 00:00:1790076866.548771 1636 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.196150] nix-grpc-daemon[1594]: E0000 00:00:1790076866.560643 1636 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.205372] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.211874] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45034 worker1 # [ 128.213560] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 128.229186] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.239459] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 128.240817] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45034 worker1 # [ 128.242461] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 128.546562] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 128.552369] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 128.593140] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45046 worker1 # [ 128.601685] nix-daemon[844]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) worker1 # [ 128.617200] nix-daemon[844]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) client # [ 128.620300] nix[1393]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 128.631672] nix-daemon[844]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 133.449523] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:31Z level=info event=niks3_push_started pid=1678 worker1 # [ 133.481613] nix-daemon[844]: reaped child process 1653, status = succeeded worker1 # [ 133.557631] nix-grpc-daemon[1678]: time=2026-09-22T11:34:31.921Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 133.640203] nix-daemon[844]: accepted connection from pid 1691, user nix-grpc-daemon (trusted) worker1 # [ 133.652975] nix-daemon[844]: reaped child process 1694, status = succeeded lb # [ 133.625712] niks3-server[1092]: 2026/09/22 11:34:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.668796] nix-grpc-daemon[1678]: time=2026-09-22T11:34:32.033Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.670464] nix-grpc-daemon[1678]: time=2026-09-22T11:34:32.034Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 133.668676] niks3-server[1092]: 2026/09/22 11:34:32 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 133.726072] nix-grpc-daemon[1678]: time=2026-09-22T11:34:32.090Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.688447] niks3-server[1092]: 2026/09/22 11:34:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 133.692731] niks3-server[1092]: 2026/09/22 11:34:32 INFO Signed narinfos id=52 count=1 lb # [ 133.701279] niks3-server[1092]: 2026/09/22 11:34:32 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 133.704512] niks3-server[1092]: 2026/09/22 11:34:32 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 133.707770] niks3-server[1092]: 2026/09/22 11:34:32 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 133.713461] niks3-server[1092]: 2026/09/22 11:34:32 INFO Completed upload id=52 worker1 # [ 133.750550] nix-grpc-daemon[1678]: time=2026-09-22T11:34:32.114Z level=INFO msg="Upload complete. (189ms)" lb # [ 133.716905] niks3-server[1092]: 2026/09/22 11:34:32 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 133.758912] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45046 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 133.770869] nix-daemon[844]: reaped child process 1651, status = succeeded client # [ 133.772935] systemd[1]: mid.service: Deactivated successfully. client # [ 133.774754] systemd[1]: mid.service: Consumed 141ms CPU time over 9.308s wall clock time, 41.4M memory peak, 8.5K incoming IP traffic, 10.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.04 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.02 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.01 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 134.452025] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: b82dfccd2934450abb860fd5a734fb56 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker1 # [ 134.581620] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45046 client # [ 134.578089] nix[1429]: don't know how to build these paths: client # [ 134.579065] nix[1429]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 134.599893] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:32Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 134.603850] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:32Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 134.648858] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 134.660281] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 134.676607] nix-grpc-daemon[1663]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5) worker2 # [ 134.756453] nix-grpc-daemon[1663]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5) worker2 # [ 134.929637] nix-grpc-daemon[1663]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 225 ms (attempt 3/5) worker2 # [ 135.159276] nix-grpc-daemon[1663]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 362 ms (attempt 4/5) worker2 # [ 135.529264] nix-grpc-daemon[1663]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 135.532215] nix-grpc-daemon[1663]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 135.546529] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 client # [ 135.551168] nix[1429]: copying 1 paths to 'lb:50051'... client # [ 135.555142] nix[1429]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 135.559424] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 135.567634] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 135.589718] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:34Z level=info event=niks3_push_started pid=1755 worker2 # [ 135.696378] nix-grpc-daemon[1755]: time=2026-09-22T11:34:34.862Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 135.779580] nix-daemon[867]: accepted connection from pid 1771, user nix-grpc-daemon (trusted) worker2 # [ 135.793388] nix-daemon[867]: reaped child process 1774, status = succeeded worker2 # [ 135.867124] nix-daemon[867]: accepted connection from pid 1776, user nix-grpc-daemon (trusted) worker2 # [ 135.881236] nix-daemon[867]: reaped child process 1779, status = succeeded lb # [ 135.854904] niks3-server[1092]: 2026/09/22 11:34:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.897067] nix-grpc-daemon[1755]: time=2026-09-22T11:34:35.062Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 135.898416] nix-grpc-daemon[1755]: time=2026-09-22T11:34:35.062Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 135.879844] niks3-server[1092]: 2026/09/22 11:34:34 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 135.883925] niks3-server[1092]: 2026/09/22 11:34:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 135.886609] niks3-server[1092]: 2026/09/22 11:34:34 INFO Signed narinfos id=53 count=1 worker2 # [ 135.918377] nix-grpc-daemon[1755]: time=2026-09-22T11:34:35.084Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.894125] niks3-server[1092]: 2026/09/22 11:34:34 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 135.897357] niks3-server[1092]: 2026/09/22 11:34:34 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 135.900972] niks3-server[1092]: 2026/09/22 11:34:34 INFO Completed upload id=53 worker2 # [ 135.932539] nix-grpc-daemon[1755]: time=2026-09-22T11:34:35.098Z level=INFO msg="Upload complete. (233ms)" lb # [ 135.902810] niks3-server[1092]: 2026/09/22 11:34:34 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 135.934944] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 135.938711] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 135.943459] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 135.948470] nix-daemon[867]: reaped child process 1753, status = succeeded worker2 # [ 135.952912] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) client # [ 135.949225] nix[1429]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 136.808605] systemd[1]: intr.service: Sent signal SIGINT to main process 1429 (nix) on client request. worker2 # [ 136.818768] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:35Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 136.814448] nix[1429]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds) client # [ 136.822372] nix[1429]: error: interrupted by the user client # [ 136.848510] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 136.851325] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 136.854724] systemd[1]: intr.service: Consumed 120ms CPU time over 2.399s wall clock time, 43.4M memory peak, 6.4K incoming IP traffic, 8.2K outgoing IP traffic. worker2 # [ 136.971814] nix-daemon[867]: reaped child process 1781, status = succeeded worker2 # [ 136.974260] nix-daemon[1783]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 136.978281] nix-daemon[867]: reaped child process 1783, status = failed with exit code 1 lb # [ 137.041560] envoy[918]: conn peer=[2001:db8:1::3]:51860 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=993 tx=399 ms=16007 lb # [ 137.045487] envoy[918]: conn peer=[2001:db8:1::1]:59138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3878 tx=1946 ms=9155 lb # [ 137.048956] envoy[918]: conn peer=[2001:db8:1::1]:59018 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2967 tx=828 ms=2258 (finished: subtest: interrupting the client stops the build on the worker, in 3.49 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 137.945408] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: d2880e256a894b859dbdd600906a6850 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.03 seconds) worker1 # [ 138.073778] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45046 client # [ 138.070040] nix[1449]: don't know how to build these paths: client # [ 138.071027] nix[1449]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 138.087248] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:36Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 138.092563] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:36Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 138.131124] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45046 worker1 # [ 138.141641] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5) worker1 # [ 138.224066] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 119 ms (attempt 2/5) worker1 # [ 138.344127] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 241 ms (attempt 3/5) worker1 # [ 138.588635] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 594 ms (attempt 4/5) worker1 # [ 139.185822] nix-grpc-daemon[1594]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 139.189808] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 139.206396] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45046 client # [ 139.207411] nix[1449]: copying 1 paths to 'lb:50051'... client # [ 139.208254] nix[1449]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 139.217558] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45046 worker1 # [ 139.228244] nix-daemon[844]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) worker1 # [ 139.327423] nix-daemon[844]: accepted connection from pid 1734, user nix-grpc-daemon (trusted) worker1 # [ 139.340310] nix-daemon[844]: reaped child process 1737, status = succeeded worker1 # [ 139.420637] nix-daemon[844]: accepted connection from pid 1739, user nix-grpc-daemon (trusted) worker1 # [ 139.435599] nix-daemon[844]: reaped child process 1742, status = succeeded lb # [ 139.398756] niks3-server[1092]: 2026/09/22 11:34:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.444721] nix-grpc-daemon[1678]: time=2026-09-22T11:34:37.808Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.446176] nix-grpc-daemon[1678]: time=2026-09-22T11:34:37.808Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 139.425555] niks3-server[1092]: 2026/09/22 11:34:37 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 139.437873] niks3-server[1092]: 2026/09/22 11:34:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 139.479636] nix-grpc-daemon[1678]: time=2026-09-22T11:34:37.843Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.443132] niks3-server[1092]: 2026/09/22 11:34:37 INFO Signed narinfos id=54 count=1 lb # [ 139.452136] niks3-server[1092]: 2026/09/22 11:34:37 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 139.460240] niks3-server[1092]: 2026/09/22 11:34:37 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 139.504350] nix-grpc-daemon[1678]: time=2026-09-22T11:34:37.868Z level=INFO msg="Upload complete. (265ms)" lb # [ 139.467487] niks3-server[1092]: 2026/09/22 11:34:37 INFO Completed upload id=54 worker1 # [ 139.506360] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45046 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 139.472620] niks3-server[1092]: 2026/09/22 11:34:37 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 139.511657] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45046 worker1 # [ 139.519807] nix-daemon[844]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) worker1 # [ 139.523375] nix-daemon[844]: reaped child process 1732, status = succeeded worker1 # [ 139.527722] nix-daemon[844]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) client # [ 139.517885] nix[1449]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 141.338932] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 141.364254] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker2 # [ 141.545383] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44980 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 141.550241] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 worker1 # [ 141.573341] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:39Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 141.575206] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:39Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 141.621873] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 141.630662] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 client # copying 1 paths to 'lb:50051'... worker2 # [ 141.639368] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 141.659942] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 141.739803] nix-daemon[867]: accepted connection from pid 1834, user nix-grpc-daemon (trusted) worker2 # [ 141.754469] nix-daemon[867]: reaped child process 1837, status = succeeded worker2 # [ 141.828287] nix-daemon[867]: accepted connection from pid 1839, user nix-grpc-daemon (trusted) worker2 # [ 141.843124] nix-daemon[867]: reaped child process 1842, status = succeeded lb # [ 141.815954] niks3-server[1092]: 2026/09/22 11:34:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.856161] nix-grpc-daemon[1755]: time=2026-09-22T11:34:41.021Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 141.857515] nix-grpc-daemon[1755]: time=2026-09-22T11:34:41.021Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 141.851839] niks3-server[1092]: 2026/09/22 11:34:40 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 141.869175] niks3-server[1092]: 2026/09/22 11:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker2 # [ 141.905855] nix-grpc-daemon[1755]: time=2026-09-22T11:34:41.071Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.874491] niks3-server[1092]: 2026/09/22 11:34:40 INFO Signed narinfos id=55 count=1 lb # [ 141.881222] niks3-server[1092]: 2026/09/22 11:34:40 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 141.891634] niks3-server[1092]: 2026/09/22 11:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 141.895879] niks3-server[1092]: 2026/09/22 11:34:40 INFO Completed upload id=55 worker2 # [ 141.927152] nix-grpc-daemon[1755]: time=2026-09-22T11:34:41.093Z level=INFO msg="Upload complete. (262ms)" lb # [ 141.897254] niks3-server[1092]: 2026/09/22 11:34:40 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 141.929392] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 141.933401] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 141.939273] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 141.945156] nix-daemon[867]: reaped child process 1832, status = succeeded worker2 # [ 141.947821] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 142.164831] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:40Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 142.963875] nix-daemon[867]: reaped child process 1846, status = succeeded worker2 # [ 143.034555] nix-daemon[867]: accepted connection from pid 1862, user nix-grpc-daemon (trusted) worker2 # [ 143.047082] nix-daemon[867]: reaped child process 1865, status = succeeded lb # [ 143.021497] niks3-server[1092]: 2026/09/22 11:34:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.063409] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.229Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 143.064874] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.231Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 143.053936] niks3-server[1092]: 2026/09/22 11:34:41 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 143.072177] niks3-server[1092]: 2026/09/22 11:34:41 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 143.075933] niks3-server[1092]: 2026/09/22 11:34:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 143.078814] niks3-server[1092]: 2026/09/22 11:34:41 INFO Signed narinfos id=56 count=1 worker2 # [ 143.111094] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.276Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.084939] niks3-server[1092]: 2026/09/22 11:34:41 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 143.089153] niks3-server[1092]: 2026/09/22 11:34:41 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 143.092623] niks3-server[1092]: 2026/09/22 11:34:41 INFO Completed upload id=56 worker2 # [ 143.124143] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.290Z level=INFO msg="Upload complete. (170ms)" lb # [ 143.096556] niks3-server[1092]: 2026/09/22 11:34:41 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 143.127546] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker1 # [ 143.138815] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:41Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 143.140610] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:41Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 143.139366] nix-daemon[867]: reaped child process 1844, status = succeeded worker2 # [ 143.176932] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 143.187392] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 143.197700] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.363Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 143.206157] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 143.217075] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 143.306798] nix-daemon[867]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker2 # [ 143.321978] nix-daemon[867]: reaped child process 1872, status = succeeded worker2 # [ 143.402136] nix-daemon[867]: accepted connection from pid 1874, user nix-grpc-daemon (trusted) worker2 # [ 143.415641] nix-daemon[867]: reaped child process 1877, status = succeeded lb # [ 143.390700] niks3-server[1092]: 2026/09/22 11:34:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.430367] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.596Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 143.432048] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.598Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 143.428194] niks3-server[1092]: 2026/09/22 11:34:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker2 # [ 143.464831] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.630Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.433812] niks3-server[1092]: 2026/09/22 11:34:41 INFO Signed narinfos id=57 count=1 lb # [ 143.437376] niks3-server[1092]: 2026/09/22 11:34:41 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 143.442193] niks3-server[1092]: 2026/09/22 11:34:41 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 143.453649] niks3-server[1092]: 2026/09/22 11:34:41 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 143.459477] niks3-server[1092]: 2026/09/22 11:34:41 INFO Completed upload id=57 worker2 # [ 143.492721] nix-grpc-daemon[1755]: time=2026-09-22T11:34:42.658Z level=INFO msg="Upload complete. (266ms)" lb # [ 143.462674] niks3-server[1092]: 2026/09/22 11:34:41 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 143.496433] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 143.501288] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 143.511436] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 143.516137] nix-daemon[867]: reaped child process 1867, status = succeeded worker2 # [ 143.521321] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 144.763116] nix-daemon[867]: reaped child process 1881, status = succeeded worker2 # [ 144.839097] nix-daemon[867]: accepted connection from pid 1897, user nix-grpc-daemon (trusted) worker2 # [ 144.851069] nix-daemon[867]: reaped child process 1900, status = succeeded lb # [ 144.827659] niks3-server[1092]: 2026/09/22 11:34:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 144.867624] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 144.869105] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.035Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 144.859852] niks3-server[1092]: 2026/09/22 11:34:43 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 144.877434] niks3-server[1092]: 2026/09/22 11:34:43 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 144.886804] niks3-server[1092]: 2026/09/22 11:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 144.891439] niks3-server[1092]: 2026/09/22 11:34:43 INFO Signed narinfos id=58 count=1 worker2 # [ 144.923101] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.089Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.899727] niks3-server[1092]: 2026/09/22 11:34:43 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 144.908075] niks3-server[1092]: 2026/09/22 11:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 144.912122] niks3-server[1092]: 2026/09/22 11:34:43 INFO Completed upload id=58 worker2 # [ 144.943776] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.109Z level=INFO msg="Upload complete. (214ms)" lb # [ 144.914227] niks3-server[1092]: 2026/09/22 11:34:43 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 144.949827] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker1 # [ 144.959521] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:43Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 144.962238] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:43Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 144.965704] nix-daemon[867]: reaped child process 1879, status = succeeded worker2 # [ 144.997909] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 145.010948] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 145.023694] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.189Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 145.033127] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 145.045530] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 145.140661] nix-daemon[867]: accepted connection from pid 1905, user nix-grpc-daemon (trusted) worker2 # [ 145.155508] nix-daemon[867]: reaped child process 1908, status = succeeded worker2 # [ 145.229662] nix-daemon[867]: accepted connection from pid 1910, user nix-grpc-daemon (trusted) worker2 # [ 145.243876] nix-daemon[867]: reaped child process 1913, status = succeeded lb # [ 145.216730] niks3-server[1092]: 2026/09/22 11:34:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 145.252298] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.418Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 145.254093] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.420Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 145.242768] niks3-server[1092]: 2026/09/22 11:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 145.248129] niks3-server[1092]: 2026/09/22 11:34:43 INFO Signed narinfos id=59 count=1 worker2 # [ 145.283056] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.449Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.257822] niks3-server[1092]: 2026/09/22 11:34:43 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 145.267729] niks3-server[1092]: 2026/09/22 11:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete worker2 # [ 145.306195] nix-grpc-daemon[1755]: time=2026-09-22T11:34:44.472Z level=INFO msg="Upload complete. (246ms)" lb # [ 145.274764] niks3-server[1092]: 2026/09/22 11:34:43 INFO Completed upload id=59 worker2 # [ 145.308282] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 145.312338] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 lb # [ 145.281107] niks3-server[1092]: 2026/09/22 11:34:43 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 145.287136] niks3-server[1092]: 2026/09/22 11:34:43 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 145.319453] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 145.321851] nix-daemon[867]: reaped child process 1903, status = succeeded worker2 # [ 145.327130] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 146.797905] nix-daemon[867]: reaped child process 1917, status = succeeded worker2 # [ 146.839854] nix-daemon[867]: accepted connection from pid 1933, user nix-grpc-daemon (trusted) lb # [ 146.822760] niks3-server[1092]: 2026/09/22 11:34:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 146.854702] nix-daemon[867]: reaped child process 1936, status = succeeded worker2 # [ 146.858822] nix-grpc-daemon[1755]: time=2026-09-22T11:34:46.024Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 146.860291] nix-grpc-daemon[1755]: time=2026-09-22T11:34:46.026Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 146.842694] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 146.847408] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 146.849902] niks3-server[1092]: 2026/09/22 11:34:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 146.851683] niks3-server[1092]: 2026/09/22 11:34:45 INFO Signed narinfos id=60 count=1 worker2 # [ 146.884460] nix-grpc-daemon[1755]: time=2026-09-22T11:34:46.050Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.858572] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 146.861304] niks3-server[1092]: 2026/09/22 11:34:45 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 146.864837] niks3-server[1092]: 2026/09/22 11:34:45 INFO Completed upload id=60 worker2 # [ 146.896298] nix-grpc-daemon[1755]: time=2026-09-22T11:34:46.062Z level=INFO msg="Upload complete. (160ms)" lb # [ 146.868175] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 146.899035] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 146.906209] nix-daemon[867]: reaped child process 1915, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 5.54 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' lb # [ 147.041267] envoy[918]: conn peer=[2001:db8:1::1]:59026 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9598 tx=4384 ms=5368 worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 147.148509] nix-daemon[844]: reaped child process 1746, status = succeeded worker1 # [ 147.221922] nix-daemon[844]: accepted connection from pid 1793, user nix-grpc-daemon (trusted) worker1 # [ 147.234520] nix-daemon[844]: reaped child process 1796, status = succeeded lb # [ 147.204310] niks3-server[1092]: 2026/09/22 11:34:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.249773] nix-grpc-daemon[1678]: time=2026-09-22T11:34:45.614Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.251437] nix-grpc-daemon[1678]: time=2026-09-22T11:34:45.615Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 147.243547] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 147.254097] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 147.258470] niks3-server[1092]: 2026/09/22 11:34:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 147.263920] niks3-server[1092]: 2026/09/22 11:34:45 INFO Signed narinfos id=61 count=1 worker1 # [ 147.304234] nix-grpc-daemon[1678]: time=2026-09-22T11:34:45.668Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.278771] niks3-server[1092]: 2026/09/22 11:34:45 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 147.283329] niks3-server[1092]: 2026/09/22 11:34:45 INFO Completed upload id=61 worker1 # [ 147.320076] nix-grpc-daemon[1678]: time=2026-09-22T11:34:45.684Z level=INFO msg="Upload complete. (179ms)" lb # [ 147.285703] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 147.323194] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45046 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 lb # [ 147.289265] niks3-server[1092]: 2026/09/22 11:34:45 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls worker1 # [ 147.330897] nix-daemon[844]: reaped child process 1744, status = succeeded client # [ 147.349226] systemd[1]: sw.service: Deactivated successfully. client # [ 147.353220] systemd[1]: sw.service: Consumed 123ms CPU time over 9.407s wall clock time, 39.4M memory peak, 7.5K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.05 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.02 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1 # [ 148.166859] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:46Z level=info event=signal_exit lb # [ 148.134511] niks3-server[1092]: 2026/09/22 11:34:46 INFO lead: released remote=192.168.1.3:55106 worker2 # [ 149.166869] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 149.177307] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:47Z level=info event=scheduler_restarting worker1 # [ 149.180844] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45034 worker1 # [ 149.185233] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:47Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 149.188616] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:47Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 149.192424] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45034 worker1 # [ 149.196125] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 149.212248] nix-daemon[844]: reaped child process 1649, status = succeeded worker2 # [ 149.313362] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_take_over lb # [ 149.282392] niks3-server[1092]: 2026/09/22 11:34:47 INFO lead: acquired remote=192.168.1.4:51392 worker2 # [ 149.367305] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 149.369313] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 149.375565] nix-grpc-daemon[1594]: E0000 00:00:1790076887.739985 1640 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 149.377797] nix-grpc-daemon[1594]: E0000 00:00:1790076887.740068 1640 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 149.385145] nix-grpc-daemon[1594]: ts=2026-09-22T11:34:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 149.570228] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 149.572128] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 149.772886] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 149.774772] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 149.975663] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 149.977555] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 150.178801] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 150.180443] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 150.189246] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 150.193154] systemd[1]: nix-grpc-daemon.service: Consumed 607ms CPU time over 22.155s wall clock time, 36.3M memory peak, 24.6K incoming IP traffic, 31.7K outgoing IP traffic. worker1 # [ 150.207868] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 150.293459] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 150.295993] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 150.300343] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 150.304127] nix-grpc-daemon[1810]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 150.307695] nix-grpc-daemon[1810]: E0000 00:00:1790076888.664735 1810 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 150.311690] nix-grpc-daemon[1810]: E0000 00:00:1790076888.668477 1810 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 150.315169] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 150.319127] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 150.319939] nix-grpc-daemon[1810]: E0000 00:00:1790076888.682148 1851 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 150.331577] nix-grpc-daemon[1810]: E0000 00:00:1790076888.696104 1851 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 150.336147] nix-grpc-daemon[1810]: E0000 00:00:1790076888.698268 1851 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.18 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 150.346799] nix-grpc-daemon[1810]: E0000 00:00:1790076888.711285 1851 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 150.356721] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 150.362443] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:47608 worker2 # [ 150.364108] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 150.380796] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 150.388068] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 150.389587] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:47608 worker2 # [ 150.391218] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.57 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 151.639825] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 151.651331] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker2 # [ 151.661820] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 151.701456] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:50Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 151.703490] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:50Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 151.705369] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:50Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 151.706881] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:50Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 151.751764] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 151.764723] nix-grpc-daemon[1810]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5) worker1 # [ 151.831085] nix-grpc-daemon[1810]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5) worker1 # [ 151.902236] nix-grpc-daemon[1810]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 3/5) worker1 # [ 152.057307] nix-grpc-daemon[1810]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 4/5) worker1 # [ 152.112364] nix-grpc-daemon[1810]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 152.114033] nix-grpc-daemon[1810]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 152.125455] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 152.132825] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 152.137843] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 152.148365] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:50Z level=info event=niks3_push_started pid=1870 worker1 # [ 152.231945] nix-grpc-daemon[1870]: time=2026-09-22T11:34:50.596Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 152.310316] nix-daemon[844]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker1 # [ 152.327114] nix-daemon[844]: reaped child process 1886, status = succeeded worker1 # [ 152.396286] nix-daemon[844]: accepted connection from pid 1888, user nix-grpc-daemon (trusted) worker1 # [ 152.409643] nix-daemon[844]: reaped child process 1891, status = succeeded lb # [ 152.377696] niks3-server[1092]: 2026/09/22 11:34:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.424721] nix-grpc-daemon[1870]: time=2026-09-22T11:34:50.789Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.427900] nix-grpc-daemon[1870]: time=2026-09-22T11:34:50.790Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 152.427164] niks3-server[1092]: 2026/09/22 11:34:50 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 152.432663] niks3-server[1092]: 2026/09/22 11:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 152.438061] niks3-server[1092]: 2026/09/22 11:34:50 INFO Signed narinfos id=62 count=1 worker1 # [ 152.477527] nix-grpc-daemon[1870]: time=2026-09-22T11:34:50.841Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.453333] niks3-server[1092]: 2026/09/22 11:34:50 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 152.454827] niks3-server[1092]: 2026/09/22 11:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete worker1 # [ 152.495403] nix-grpc-daemon[1870]: time=2026-09-22T11:34:50.859Z level=INFO msg="Upload complete. (260ms)" lb # [ 152.459296] niks3-server[1092]: 2026/09/22 11:34:50 INFO Completed upload id=62 worker1 # [ 152.497627] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 152.501814] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 152.507703] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 152.509960] nix-daemon[844]: reaped child process 1868, status = succeeded worker1 # [ 152.514941] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 153.529571] nix-daemon[844]: reaped child process 1895, status = succeeded worker1 # [ 153.602720] nix-daemon[844]: accepted connection from pid 1911, user nix-grpc-daemon (trusted) worker1 # [ 153.615086] nix-daemon[844]: reaped child process 1914, status = succeeded lb # [ 153.585951] niks3-server[1092]: 2026/09/22 11:34:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.635965] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.000Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.637662] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.001Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 153.632615] niks3-server[1092]: 2026/09/22 11:34:51 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 153.639459] niks3-server[1092]: 2026/09/22 11:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 153.683740] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.047Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.646694] niks3-server[1092]: 2026/09/22 11:34:51 INFO Signed narinfos id=63 count=1 lb # [ 153.650089] niks3-server[1092]: 2026/09/22 11:34:52 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 153.656321] niks3-server[1092]: 2026/09/22 11:34:52 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 153.659437] niks3-server[1092]: 2026/09/22 11:34:52 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 153.665211] niks3-server[1092]: 2026/09/22 11:34:52 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo lb # [ 153.674164] niks3-server[1092]: 2026/09/22 11:34:52 INFO Completed upload id=63 worker1 # [ 153.712650] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.077Z level=INFO msg="Upload complete. (191ms)" worker1 # [ 153.717945] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker2 # [ 153.718804] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:52Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.733211] nix-daemon[844]: reaped child process 1893, status = succeeded worker2 # [ 153.726736] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:52Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 153.774508] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 153.786684] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 153.798655] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 153.806694] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 153.899452] nix-daemon[844]: accepted connection from pid 1918, user nix-grpc-daemon (trusted) worker1 # [ 153.911636] nix-daemon[844]: reaped child process 1921, status = succeeded worker1 # [ 153.985491] nix-daemon[844]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker1 # [ 153.998041] nix-daemon[844]: reaped child process 1926, status = succeeded lb # [ 153.966428] niks3-server[1092]: 2026/09/22 11:34:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.013743] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.378Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 154.015729] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.379Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 153.998145] niks3-server[1092]: 2026/09/22 11:34:52 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 154.010424] niks3-server[1092]: 2026/09/22 11:34:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 154.052897] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.417Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.015639] niks3-server[1092]: 2026/09/22 11:34:52 INFO Signed narinfos id=64 count=1 lb # [ 154.029978] niks3-server[1092]: 2026/09/22 11:34:52 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 154.037626] niks3-server[1092]: 2026/09/22 11:34:52 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 154.042097] niks3-server[1092]: 2026/09/22 11:34:52 INFO Completed upload id=64 worker1 # [ 154.079092] nix-grpc-daemon[1870]: time=2026-09-22T11:34:52.443Z level=INFO msg="Upload complete. (259ms)" worker1 # [ 154.081174] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 154.045258] niks3-server[1092]: 2026/09/22 11:34:52 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 154.087401] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 154.091506] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 154.093653] nix-daemon[844]: reaped child process 1916, status = succeeded worker1 # [ 154.098652] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 154.964036] nix-daemon[844]: reaped child process 1930, status = succeeded worker1 # [ 155.004184] nix-daemon[844]: accepted connection from pid 1946, user nix-grpc-daemon (trusted) worker1 # [ 155.016456] nix-daemon[844]: reaped child process 1949, status = succeeded lb # [ 154.985808] niks3-server[1092]: 2026/09/22 11:34:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.031044] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.395Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.032728] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.397Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 155.024696] niks3-server[1092]: 2026/09/22 11:34:53 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 155.031164] niks3-server[1092]: 2026/09/22 11:34:53 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 155.041795] niks3-server[1092]: 2026/09/22 11:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 155.047849] niks3-server[1092]: 2026/09/22 11:34:53 INFO Signed narinfos id=65 count=1 worker1 # [ 155.087771] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.056786] niks3-server[1092]: 2026/09/22 11:34:53 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 155.065130] niks3-server[1092]: 2026/09/22 11:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 155.072155] niks3-server[1092]: 2026/09/22 11:34:53 INFO Completed upload id=65 lb # [ 155.073730] niks3-server[1092]: 2026/09/22 11:34:53 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 155.109369] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.473Z level=INFO msg="Upload complete. (203ms)" worker1 # [ 155.115661] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker2 # [ 155.111708] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:54Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.124373] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker2 # [ 155.120391] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:54Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 155.135843] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 155.143705] nix-daemon[844]: reaped child process 1928, status = succeeded worker1 # [ 155.146885] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 155.152739] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 155.233275] nix-daemon[844]: accepted connection from pid 1953, user nix-grpc-daemon (trusted) worker1 # [ 155.245644] nix-daemon[844]: reaped child process 1956, status = succeeded worker1 # [ 155.320108] nix-daemon[844]: accepted connection from pid 1958, user nix-grpc-daemon (trusted) worker1 # [ 155.333240] nix-daemon[844]: reaped child process 1961, status = succeeded lb # [ 155.300482] niks3-server[1092]: 2026/09/22 11:34:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.345072] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.709Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.346505] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.709Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 155.325457] niks3-server[1092]: 2026/09/22 11:34:53 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 155.338818] niks3-server[1092]: 2026/09/22 11:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker1 # [ 155.380743] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.745Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.343801] niks3-server[1092]: 2026/09/22 11:34:53 INFO Signed narinfos id=66 count=1 lb # [ 155.349919] niks3-server[1092]: 2026/09/22 11:34:53 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 155.364761] niks3-server[1092]: 2026/09/22 11:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker1 # [ 155.406911] nix-grpc-daemon[1870]: time=2026-09-22T11:34:53.771Z level=INFO msg="Upload complete. (246ms)" lb # [ 155.370580] niks3-server[1092]: 2026/09/22 11:34:53 INFO Completed upload id=66 worker1 # [ 155.409165] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 155.374154] niks3-server[1092]: 2026/09/22 11:34:53 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 155.413335] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 155.417508] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 155.422224] nix-daemon[844]: reaped child process 1951, status = succeeded worker1 # [ 155.427526] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 156.243132] nix-daemon[844]: reaped child process 1965, status = succeeded worker1 # [ 156.310478] nix-daemon[844]: accepted connection from pid 1981, user nix-grpc-daemon (trusted) worker1 # [ 156.321681] nix-daemon[844]: reaped child process 1984, status = succeeded lb # [ 156.291459] niks3-server[1092]: 2026/09/22 11:34:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.336586] nix-grpc-daemon[1870]: time=2026-09-22T11:34:54.700Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 156.338199] nix-grpc-daemon[1870]: time=2026-09-22T11:34:54.702Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 156.322939] niks3-server[1092]: 2026/09/22 11:34:54 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 156.337170] niks3-server[1092]: 2026/09/22 11:34:54 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker1 # [ 156.384963] nix-grpc-daemon[1870]: time=2026-09-22T11:34:54.749Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.348042] niks3-server[1092]: 2026/09/22 11:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 156.349539] niks3-server[1092]: 2026/09/22 11:34:54 INFO Signed narinfos id=67 count=1 lb # [ 156.353641] niks3-server[1092]: 2026/09/22 11:34:54 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 156.357467] niks3-server[1092]: 2026/09/22 11:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 156.361244] niks3-server[1092]: 2026/09/22 11:34:54 INFO Completed upload id=67 worker1 # [ 156.397951] nix-grpc-daemon[1870]: time=2026-09-22T11:34:54.762Z level=INFO msg="Upload complete. (165ms)" lb # [ 156.362657] niks3-server[1092]: 2026/09/22 11:34:54 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 156.400499] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker1 # [ 156.407856] nix-daemon[844]: reaped child process 1963, status = succeeded worker2 # [ 156.397897] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:55Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 156.407822] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:55Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 156.453790] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 156.460139] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 156.466168] nix-grpc-daemon[1870]: time=2026-09-22T11:34:54.830Z level=INFO msg="All 1 paths already cached" worker1 # [ 156.470037] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 156.473714] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 156.551350] nix-daemon[844]: accepted connection from pid 1988, user nix-grpc-daemon (trusted) worker1 # [ 156.563902] nix-daemon[844]: reaped child process 1991, status = succeeded worker1 # [ 156.637109] nix-daemon[844]: accepted connection from pid 1993, user nix-grpc-daemon (trusted) worker1 # [ 156.650630] nix-daemon[844]: reaped child process 1996, status = succeeded lb # [ 156.617356] niks3-server[1092]: 2026/09/22 11:34:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.658855] nix-grpc-daemon[1870]: time=2026-09-22T11:34:55.023Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.660256] nix-grpc-daemon[1870]: time=2026-09-22T11:34:55.023Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 156.629174] niks3-server[1092]: 2026/09/22 11:34:54 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 156.634334] niks3-server[1092]: 2026/09/22 11:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 156.641465] niks3-server[1092]: 2026/09/22 11:34:54 INFO Signed narinfos id=68 count=1 worker1 # [ 156.680930] nix-grpc-daemon[1870]: time=2026-09-22T11:34:55.045Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.645334] niks3-server[1092]: 2026/09/22 11:34:54 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 156.656317] niks3-server[1092]: 2026/09/22 11:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 156.660802] niks3-server[1092]: 2026/09/22 11:34:55 INFO Completed upload id=68 worker1 # [ 156.697751] nix-grpc-daemon[1870]: time=2026-09-22T11:34:55.062Z level=INFO msg="Upload complete. (218ms)" lb # [ 156.662933] niks3-server[1092]: 2026/09/22 11:34:55 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 156.699924] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 156.705386] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 156.709967] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 156.712254] nix-daemon[844]: reaped child process 1986, status = succeeded worker1 # [ 156.717225] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) lb # [ 157.042552] envoy[918]: conn peer=[2001:db8:1::1]:59020 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1558 ms=9268 lb # [ 157.046245] envoy[918]: conn peer=[2001:db8:1::3]:56854 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=958 tx=344 ms=21180 worker1 # [ 158.186321] nix-daemon[844]: reaped child process 2000, status = succeeded worker1 # [ 158.230228] nix-daemon[844]: accepted connection from pid 2016, user nix-grpc-daemon (trusted) worker1 # [ 158.244453] nix-daemon[844]: reaped child process 2019, status = succeeded lb # [ 158.212990] niks3-server[1092]: 2026/09/22 11:34:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.254416] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.618Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.255881] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.620Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 158.235578] niks3-server[1092]: 2026/09/22 11:34:56 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 158.238355] niks3-server[1092]: 2026/09/22 11:34:56 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 158.244439] niks3-server[1092]: 2026/09/22 11:34:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 158.248681] niks3-server[1092]: 2026/09/22 11:34:56 INFO Signed narinfos id=69 count=1 worker1 # [ 158.289237] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.653Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.255767] niks3-server[1092]: 2026/09/22 11:34:56 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 158.259818] niks3-server[1092]: 2026/09/22 11:34:56 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 158.263411] niks3-server[1092]: 2026/09/22 11:34:56 INFO Completed upload id=69 worker1 # [ 158.300402] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.664Z level=INFO msg="Upload complete. (175ms)" lb # [ 158.265250] niks3-server[1092]: 2026/09/22 11:34:56 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 158.303033] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker1 # [ 158.310839] nix-daemon[844]: reaped child process 1998, status = succeeded worker2 # [ 158.300831] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:57Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 158.312719] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker2 # [ 158.310292] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:57Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 158.318949] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 158.324505] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.689Z level=INFO msg="All 1 paths already cached" worker1 # [ 158.328415] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 158.333236] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 158.416171] nix-daemon[844]: accepted connection from pid 2023, user nix-grpc-daemon (trusted) worker1 # [ 158.430366] nix-daemon[844]: reaped child process 2026, status = succeeded worker1 # [ 158.509877] nix-daemon[844]: accepted connection from pid 2028, user nix-grpc-daemon (trusted) worker1 # [ 158.523659] nix-daemon[844]: reaped child process 2031, status = succeeded lb # [ 158.491560] niks3-server[1092]: 2026/09/22 11:34:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.536604] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.900Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.538031] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.900Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 158.514706] niks3-server[1092]: 2026/09/22 11:34:56 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 158.531124] niks3-server[1092]: 2026/09/22 11:34:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 158.573401] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.937Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.536277] niks3-server[1092]: 2026/09/22 11:34:56 INFO Signed narinfos id=70 count=1 lb # [ 158.542096] niks3-server[1092]: 2026/09/22 11:34:56 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 158.552771] niks3-server[1092]: 2026/09/22 11:34:56 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete worker1 # [ 158.597568] nix-grpc-daemon[1870]: time=2026-09-22T11:34:56.962Z level=INFO msg="Upload complete. (259ms)" lb # [ 158.560721] niks3-server[1092]: 2026/09/22 11:34:56 INFO Completed upload id=70 worker1 # [ 158.599609] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 158.564053] niks3-server[1092]: 2026/09/22 11:34:56 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 158.605695] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 158.614907] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 158.616284] nix-daemon[844]: reaped child process 2021, status = succeeded worker1 # [ 158.621493] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 159.836369] nix-daemon[844]: reaped child process 2035, status = succeeded worker1 # [ 159.909766] nix-daemon[844]: accepted connection from pid 2051, user nix-grpc-daemon (trusted) worker1 # [ 159.921931] nix-daemon[844]: reaped child process 2054, status = succeeded lb # [ 159.892604] niks3-server[1092]: 2026/09/22 11:34:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.938478] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.302Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.940142] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.304Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 159.933116] niks3-server[1092]: 2026/09/22 11:34:58 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 159.941911] niks3-server[1092]: 2026/09/22 11:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign worker1 # [ 159.984083] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.348Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.947466] niks3-server[1092]: 2026/09/22 11:34:58 INFO Signed narinfos id=71 count=1 lb # [ 159.953180] niks3-server[1092]: 2026/09/22 11:34:58 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 159.961259] niks3-server[1092]: 2026/09/22 11:34:58 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 159.963169] niks3-server[1092]: 2026/09/22 11:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 159.966841] niks3-server[1092]: 2026/09/22 11:34:58 INFO Completed upload id=71 worker1 # [ 160.003551] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.368Z level=INFO msg="Upload complete. (174ms)" lb # [ 159.970051] niks3-server[1092]: 2026/09/22 11:34:58 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 160.006125] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker1 # [ 160.013289] nix-daemon[844]: reaped child process 2033, status = succeeded worker2 # [ 160.002820] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:59Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 160.012507] nix-grpc-daemon[1663]: ts=2026-09-22T11:34:59Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 160.057655] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 160.065236] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 160.073573] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.438Z level=INFO msg="All 1 paths already cached" worker1 # [ 160.077448] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 160.081158] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 160.167515] nix-daemon[844]: accepted connection from pid 2058, user nix-grpc-daemon (trusted) worker1 # [ 160.182315] nix-daemon[844]: reaped child process 2061, status = succeeded worker1 # [ 160.260916] nix-daemon[844]: accepted connection from pid 2063, user nix-grpc-daemon (trusted) worker1 # [ 160.273223] nix-daemon[844]: reaped child process 2066, status = succeeded lb # [ 160.242855] niks3-server[1092]: 2026/09/22 11:34:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.289066] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.653Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 160.290493] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.653Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 160.270799] niks3-server[1092]: 2026/09/22 11:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 160.276319] niks3-server[1092]: 2026/09/22 11:34:58 INFO Signed narinfos id=72 count=1 worker1 # [ 160.319300] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.683Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.285335] niks3-server[1092]: 2026/09/22 11:34:58 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 160.289220] niks3-server[1092]: 2026/09/22 11:34:58 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 160.299260] niks3-server[1092]: 2026/09/22 11:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 160.302206] niks3-server[1092]: 2026/09/22 11:34:58 INFO Completed upload id=72 worker1 # [ 160.338985] nix-grpc-daemon[1870]: time=2026-09-22T11:34:58.703Z level=INFO msg="Upload complete. (251ms)" worker1 # [ 160.340967] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 160.305642] niks3-server[1092]: 2026/09/22 11:34:58 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 160.344785] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 160.351077] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 160.353352] nix-daemon[844]: reaped child process 2056, status = succeeded worker1 # [ 160.358324] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 161.376854] nix-daemon[844]: reaped child process 2070, status = succeeded worker1 # [ 161.440891] nix-daemon[844]: accepted connection from pid 2086, user nix-grpc-daemon (trusted) worker1 # [ 161.454523] nix-daemon[844]: reaped child process 2089, status = succeeded lb # [ 161.421663] niks3-server[1092]: 2026/09/22 11:34:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.463135] nix-grpc-daemon[1870]: time=2026-09-22T11:34:59.827Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 161.464743] nix-grpc-daemon[1870]: time=2026-09-22T11:34:59.829Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 161.443091] niks3-server[1092]: 2026/09/22 11:34:59 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 161.447996] niks3-server[1092]: 2026/09/22 11:34:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 161.450750] niks3-server[1092]: 2026/09/22 11:34:59 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 161.453566] niks3-server[1092]: 2026/09/22 11:34:59 INFO Signed narinfos id=73 count=1 worker1 # [ 161.490660] nix-grpc-daemon[1870]: time=2026-09-22T11:34:59.855Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.456642] niks3-server[1092]: 2026/09/22 11:34:59 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 161.462662] niks3-server[1092]: 2026/09/22 11:34:59 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 161.465551] niks3-server[1092]: 2026/09/22 11:34:59 INFO Completed upload id=73 worker1 # [ 161.502443] nix-grpc-daemon[1870]: time=2026-09-22T11:34:59.866Z level=INFO msg="Upload complete. (137ms)" lb # [ 161.468234] niks3-server[1092]: 2026/09/22 11:34:59 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 161.504732] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker1 # [ 161.509415] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker2 # [ 161.502601] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:00Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.515096] nix-daemon[844]: reaped child process 2068, status = succeeded worker2 # [ 161.512240] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:00Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 161.552667] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 161.561634] nix-grpc-daemon[1870]: time=2026-09-22T11:34:59.926Z level=INFO msg="All 2 paths already cached" worker1 # [ 161.568175] nix-grpc-daemon[1810]: ts=2026-09-22T11:34:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 161.574688] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 161.660610] nix-daemon[844]: accepted connection from pid 2093, user nix-grpc-daemon (trusted) worker1 # [ 161.673632] nix-daemon[844]: reaped child process 2096, status = succeeded worker1 # [ 161.752970] nix-daemon[844]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 161.765201] nix-daemon[844]: reaped child process 2101, status = succeeded lb # [ 161.735034] niks3-server[1092]: 2026/09/22 11:35:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.776214] nix-grpc-daemon[1870]: time=2026-09-22T11:35:00.140Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.777551] nix-grpc-daemon[1870]: time=2026-09-22T11:35:00.140Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 161.747618] niks3-server[1092]: 2026/09/22 11:35:00 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 161.750747] niks3-server[1092]: 2026/09/22 11:35:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 161.752561] niks3-server[1092]: 2026/09/22 11:35:00 INFO Signed narinfos id=74 count=1 worker1 # [ 161.789745] nix-grpc-daemon[1870]: time=2026-09-22T11:35:00.154Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.758673] niks3-server[1092]: 2026/09/22 11:35:00 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 161.761994] niks3-server[1092]: 2026/09/22 11:35:00 INFO Completed upload id=74 worker1 # [ 161.798903] nix-grpc-daemon[1870]: time=2026-09-22T11:35:00.163Z level=INFO msg="Upload complete. (214ms)" lb # [ 161.763594] niks3-server[1092]: 2026/09/22 11:35:00 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls worker1 # [ 161.800818] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 161.766939] niks3-server[1092]: 2026/09/22 11:35:00 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 161.806385] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 161.810561] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 161.812717] nix-daemon[844]: reaped child process 2091, status = succeeded worker1 # [ 161.817857] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 163.032376] nix-daemon[844]: reaped child process 2105, status = succeeded worker1 # [ 163.105086] nix-daemon[844]: accepted connection from pid 2121, user nix-grpc-daemon (trusted) worker1 # [ 163.118688] nix-daemon[844]: reaped child process 2124, status = succeeded lb # [ 163.086077] niks3-server[1092]: 2026/09/22 11:35:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.132619] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.496Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.135050] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.498Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 163.127499] niks3-server[1092]: 2026/09/22 11:35:01 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 163.138127] niks3-server[1092]: 2026/09/22 11:35:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker1 # [ 163.182535] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.546Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.145700] niks3-server[1092]: 2026/09/22 11:35:01 INFO Signed narinfos id=75 count=1 lb # [ 163.153582] niks3-server[1092]: 2026/09/22 11:35:01 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 163.158224] niks3-server[1092]: 2026/09/22 11:35:01 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 163.170330] niks3-server[1092]: 2026/09/22 11:35:01 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 163.174133] niks3-server[1092]: 2026/09/22 11:35:01 INFO Completed upload id=75 worker1 # [ 163.212630] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.577Z level=INFO msg="Upload complete. (188ms)" lb # [ 163.176578] niks3-server[1092]: 2026/09/22 11:35:01 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 163.215721] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 worker1 # [ 163.219518] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker2 # [ 163.212260] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:02Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.226284] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 163.228152] nix-daemon[844]: reaped child process 2103, status = succeeded worker1 # [ 163.232732] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.597Z level=INFO msg="All 2 paths already cached" worker1 # [ 163.236929] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 163.240475] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 163.326129] nix-daemon[844]: accepted connection from pid 2128, user nix-grpc-daemon (trusted) worker1 # [ 163.340985] nix-daemon[844]: reaped child process 2131, status = succeeded worker1 # [ 163.419167] nix-daemon[844]: accepted connection from pid 2133, user nix-grpc-daemon (trusted) worker1 # [ 163.432871] nix-daemon[844]: reaped child process 2136, status = succeeded lb # [ 163.400450] niks3-server[1092]: 2026/09/22 11:35:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.445526] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.810Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.446999] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.811Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 163.426424] niks3-server[1092]: 2026/09/22 11:35:01 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 163.440203] niks3-server[1092]: 2026/09/22 11:35:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 163.482446] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.846Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.445129] niks3-server[1092]: 2026/09/22 11:35:01 INFO Signed narinfos id=76 count=1 lb # [ 163.456520] niks3-server[1092]: 2026/09/22 11:35:01 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 163.465245] niks3-server[1092]: 2026/09/22 11:35:01 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete worker1 # [ 163.507467] nix-grpc-daemon[1870]: time=2026-09-22T11:35:01.871Z level=INFO msg="Upload complete. (261ms)" lb # [ 163.470624] niks3-server[1092]: 2026/09/22 11:35:01 INFO Completed upload id=76 worker1 # [ 163.509466] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 163.477074] niks3-server[1092]: 2026/09/22 11:35:01 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 163.513934] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 163.519734] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 163.522048] nix-daemon[844]: reaped child process 2126, status = succeeded worker1 # [ 163.527246] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 164.565665] nix-daemon[844]: reaped child process 2140, status = succeeded worker1 # [ 164.645970] nix-daemon[844]: accepted connection from pid 2156, user nix-grpc-daemon (trusted) worker1 # [ 164.658563] nix-daemon[844]: reaped child process 2159, status = succeeded lb # [ 164.629690] niks3-server[1092]: 2026/09/22 11:35:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.677071] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.041Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.678545] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.043Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 164.668483] niks3-server[1092]: 2026/09/22 11:35:03 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 164.673920] niks3-server[1092]: 2026/09/22 11:35:03 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 164.685682] niks3-server[1092]: 2026/09/22 11:35:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 164.687650] niks3-server[1092]: 2026/09/22 11:35:03 INFO Signed narinfos id=77 count=1 worker1 # [ 164.724765] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.691859] niks3-server[1092]: 2026/09/22 11:35:03 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 164.696699] niks3-server[1092]: 2026/09/22 11:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 164.699932] niks3-server[1092]: 2026/09/22 11:35:03 INFO Completed upload id=77 lb # [ 164.701745] niks3-server[1092]: 2026/09/22 11:35:03 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 164.738708] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.103Z level=INFO msg="Upload complete. (203ms)" worker2 # [ 164.739626] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:03Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.743971] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker1 # [ 164.758150] nix-daemon[844]: reaped child process 2138, status = succeeded worker1 # [ 164.788071] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 164.799968] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 164.812457] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.176Z level=INFO msg="All 2 paths already cached" worker1 # [ 164.820214] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 164.829157] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 164.920878] nix-daemon[844]: accepted connection from pid 2163, user nix-grpc-daemon (trusted) worker1 # [ 164.933778] nix-daemon[844]: reaped child process 2166, status = succeeded worker1 # [ 165.012905] nix-daemon[844]: accepted connection from pid 2168, user nix-grpc-daemon (trusted) worker1 # [ 165.026782] nix-daemon[844]: reaped child process 2171, status = succeeded lb # [ 164.993985] niks3-server[1092]: 2026/09/22 11:35:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.039133] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.403Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.040513] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.403Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 165.018903] niks3-server[1092]: 2026/09/22 11:35:03 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 165.030988] niks3-server[1092]: 2026/09/22 11:35:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign worker1 # [ 165.073187] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.437Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.036331] niks3-server[1092]: 2026/09/22 11:35:03 INFO Signed narinfos id=78 count=1 lb # [ 165.041726] niks3-server[1092]: 2026/09/22 11:35:03 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 165.055600] niks3-server[1092]: 2026/09/22 11:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete worker1 # [ 165.098891] nix-grpc-daemon[1870]: time=2026-09-22T11:35:03.463Z level=INFO msg="Upload complete. (258ms)" lb # [ 165.062263] niks3-server[1092]: 2026/09/22 11:35:03 INFO Completed upload id=78 worker1 # [ 165.101426] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 165.066290] niks3-server[1092]: 2026/09/22 11:35:03 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 165.106070] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 worker1 # [ 165.115686] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 165.117836] nix-daemon[844]: reaped child process 2161, status = succeeded worker1 # [ 165.123200] nix-daemon[844]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 166.339288] nix-daemon[844]: reaped child process 2175, status = succeeded worker1 # [ 166.412082] nix-daemon[844]: accepted connection from pid 2191, user nix-grpc-daemon (trusted) worker1 # [ 166.423504] nix-daemon[844]: reaped child process 2194, status = succeeded lb # [ 166.392749] niks3-server[1092]: 2026/09/22 11:35:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.434698] nix-grpc-daemon[1870]: time=2026-09-22T11:35:04.799Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.436304] nix-grpc-daemon[1870]: time=2026-09-22T11:35:04.800Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 166.413329] niks3-server[1092]: 2026/09/22 11:35:04 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 166.419093] niks3-server[1092]: 2026/09/22 11:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 166.421627] niks3-server[1092]: 2026/09/22 11:35:04 INFO Signed narinfos id=79 count=1 worker1 # [ 166.458361] nix-grpc-daemon[1870]: time=2026-09-22T11:35:04.822Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.425189] niks3-server[1092]: 2026/09/22 11:35:04 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 166.428575] niks3-server[1092]: 2026/09/22 11:35:04 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 166.433379] niks3-server[1092]: 2026/09/22 11:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 166.436099] niks3-server[1092]: 2026/09/22 11:35:04 INFO Completed upload id=79 worker1 # [ 166.472988] nix-grpc-daemon[1870]: time=2026-09-22T11:35:04.837Z level=INFO msg="Upload complete. (143ms)" worker1 # [ 166.475484] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48264 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 lb # [ 166.439828] niks3-server[1092]: 2026/09/22 11:35:04 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 166.482349] nix-daemon[844]: reaped child process 2173, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 166.575979] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: a54b3bdb7d9b4973906db387516f0e5f client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 166.721947] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48264 client # [ 166.716078] nix[1529]: don't know how to build these paths: client # [ 166.717086] nix[1529]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 166.729305] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48264 client # [ 166.739664] nix[1529]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 166.743900] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:05Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb # [ 167.043297] envoy[918]: conn peer=[2001:db8:1::1]:46156 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27111 tx=12327 ms=14859 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code client # [ 196.740933] nix[1529]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 196.749408] nix[1529]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 196.781708] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 196.785465] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 196.789421] systemd[1]: gpu.service: Consumed 135ms CPU time over 30.209s wall clock time, 35.6M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.11 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.51 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill lb # [ 197.044748] envoy[918]: conn peer=[2001:db8:1::1]:50810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=30051 worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.90 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 198.321495] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:36Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 199.075990] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 199.082316] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 199.102162] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 199.106988] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 199.151166] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 199.163284] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 199.174901] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 199.186167] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 199.285892] nix-daemon[867]: accepted connection from pid 1970, user nix-grpc-daemon (trusted) worker2 # [ 199.299768] nix-daemon[867]: reaped child process 1973, status = succeeded worker2 # [ 199.381800] nix-daemon[867]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 199.395947] nix-daemon[867]: reaped child process 1978, status = succeeded lb # [ 199.370555] niks3-server[1092]: 2026/09/22 11:35:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.410226] nix-grpc-daemon[1755]: time=2026-09-22T11:35:38.576Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 199.412104] nix-grpc-daemon[1755]: time=2026-09-22T11:35:38.578Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 199.400877] niks3-server[1092]: 2026/09/22 11:35:37 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 199.410356] niks3-server[1092]: 2026/09/22 11:35:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign lb # [ 199.417195] niks3-server[1092]: 2026/09/22 11:35:37 INFO Signed narinfos id=80 count=1 worker2 # [ 199.453145] nix-grpc-daemon[1755]: time=2026-09-22T11:35:38.619Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.429114] niks3-server[1092]: 2026/09/22 11:35:37 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 199.441505] niks3-server[1092]: 2026/09/22 11:35:37 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 199.445408] niks3-server[1092]: 2026/09/22 11:35:37 INFO Completed upload id=80 worker2 # [ 199.476840] nix-grpc-daemon[1755]: time=2026-09-22T11:35:38.643Z level=INFO msg="Upload complete. (278ms)" worker2 # [ 199.480620] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 199.452197] niks3-server[1092]: 2026/09/22 11:35:37 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 199.485931] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 199.495651] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 199.504337] nix-daemon[867]: reaped child process 1968, status = succeeded worker2 # [ 199.509100] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 200.573419] nix-daemon[867]: reaped child process 1982, status = succeeded worker2 # [ 200.617347] nix-daemon[867]: accepted connection from pid 1998, user nix-grpc-daemon (trusted) worker2 # [ 200.630747] nix-daemon[867]: reaped child process 2001, status = succeeded lb # [ 200.605715] niks3-server[1092]: 2026/09/22 11:35:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.646949] nix-grpc-daemon[1755]: time=2026-09-22T11:35:39.812Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 200.648521] nix-grpc-daemon[1755]: time=2026-09-22T11:35:39.814Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 200.647398] niks3-server[1092]: 2026/09/22 11:35:39 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 200.657749] niks3-server[1092]: 2026/09/22 11:35:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 200.662233] niks3-server[1092]: 2026/09/22 11:35:39 INFO Signed narinfos id=81 count=1 worker2 # [ 200.697074] nix-grpc-daemon[1755]: time=2026-09-22T11:35:39.863Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.668441] niks3-server[1092]: 2026/09/22 11:35:39 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 200.674734] niks3-server[1092]: 2026/09/22 11:35:39 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 200.681882] niks3-server[1092]: 2026/09/22 11:35:39 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 200.686056] niks3-server[1092]: 2026/09/22 11:35:39 INFO Completed upload id=81 worker2 # [ 200.718790] nix-grpc-daemon[1755]: time=2026-09-22T11:35:39.885Z level=INFO msg="Upload complete. (202ms)" lb # [ 200.687732] niks3-server[1092]: 2026/09/22 11:35:39 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 200.722206] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker2 # [ 200.728160] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:39Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 200.730140] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:39Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 200.735760] nix-daemon[867]: reaped child process 1980, status = succeeded worker2 # [ 200.771342] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 200.777600] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 200.783571] nix-grpc-daemon[1755]: time=2026-09-22T11:35:39.949Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 200.788861] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 200.793954] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 200.877867] nix-daemon[867]: accepted connection from pid 2007, user nix-grpc-daemon (trusted) worker2 # [ 200.892437] nix-daemon[867]: reaped child process 2010, status = succeeded worker2 # [ 200.971956] nix-daemon[867]: accepted connection from pid 2012, user nix-grpc-daemon (trusted) worker2 # [ 200.986711] nix-daemon[867]: reaped child process 2015, status = succeeded lb # [ 200.959641] niks3-server[1092]: 2026/09/22 11:35:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.996286] nix-grpc-daemon[1755]: time=2026-09-22T11:35:40.162Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 200.997652] nix-grpc-daemon[1755]: time=2026-09-22T11:35:40.162Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 200.973345] niks3-server[1092]: 2026/09/22 11:35:39 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 200.979278] niks3-server[1092]: 2026/09/22 11:35:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 200.983327] niks3-server[1092]: 2026/09/22 11:35:39 INFO Signed narinfos id=82 count=1 worker2 # [ 201.017221] nix-grpc-daemon[1755]: time=2026-09-22T11:35:40.183Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.990450] niks3-server[1092]: 2026/09/22 11:35:39 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 200.994899] niks3-server[1092]: 2026/09/22 11:35:39 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 200.998840] niks3-server[1092]: 2026/09/22 11:35:39 INFO Completed upload id=82 worker2 # [ 201.030372] nix-grpc-daemon[1755]: time=2026-09-22T11:35:40.196Z level=INFO msg="Upload complete. (230ms)" worker2 # [ 201.032379] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 201.002336] niks3-server[1092]: 2026/09/22 11:35:39 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 201.036192] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 201.042678] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 201.045130] nix-daemon[867]: reaped child process 2005, status = succeeded worker2 # [ 201.050179] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 202.281982] nix-daemon[867]: reaped child process 2019, status = succeeded worker2 # [ 202.356751] nix-daemon[867]: accepted connection from pid 2035, user nix-grpc-daemon (trusted) worker2 # [ 202.371943] nix-daemon[867]: reaped child process 2038, status = succeeded lb # [ 202.344151] niks3-server[1092]: 2026/09/22 11:35:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.380947] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.547Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 202.384055] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.548Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 202.367748] niks3-server[1092]: 2026/09/22 11:35:40 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 202.373395] niks3-server[1092]: 2026/09/22 11:35:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 202.375362] niks3-server[1092]: 2026/09/22 11:35:40 INFO Signed narinfos id=83 count=1 worker2 # [ 202.407138] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.573Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.378935] niks3-server[1092]: 2026/09/22 11:35:40 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 202.384581] niks3-server[1092]: 2026/09/22 11:35:40 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 202.388219] niks3-server[1092]: 2026/09/22 11:35:40 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 202.390992] niks3-server[1092]: 2026/09/22 11:35:40 INFO Completed upload id=83 worker2 # [ 202.422447] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.588Z level=INFO msg="Upload complete. (164ms)" lb # [ 202.393146] niks3-server[1092]: 2026/09/22 11:35:40 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 202.425111] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 worker2 # [ 202.431828] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 202.433813] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 202.439102] nix-daemon[867]: reaped child process 2017, status = succeeded worker2 # [ 202.475184] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 202.483642] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 202.492427] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.658Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 202.498501] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 202.507127] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 202.587140] nix-daemon[867]: accepted connection from pid 2044, user nix-grpc-daemon (trusted) worker2 # [ 202.605829] nix-daemon[867]: reaped child process 2047, status = succeeded worker2 # [ 202.675438] nix-daemon[867]: accepted connection from pid 2049, user nix-grpc-daemon (trusted) worker2 # [ 202.689598] nix-daemon[867]: reaped child process 2052, status = succeeded lb # [ 202.662106] niks3-server[1092]: 2026/09/22 11:35:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.697494] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.863Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 202.699342] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.865Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 202.676500] niks3-server[1092]: 2026/09/22 11:35:41 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 202.680893] niks3-server[1092]: 2026/09/22 11:35:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign lb # [ 202.683506] niks3-server[1092]: 2026/09/22 11:35:41 INFO Signed narinfos id=84 count=1 worker2 # [ 202.716316] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.882Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.686649] niks3-server[1092]: 2026/09/22 11:35:41 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 202.691867] niks3-server[1092]: 2026/09/22 11:35:41 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 202.696284] niks3-server[1092]: 2026/09/22 11:35:41 INFO Completed upload id=84 worker2 # [ 202.727763] nix-grpc-daemon[1755]: time=2026-09-22T11:35:41.894Z level=INFO msg="Upload complete. (213ms)" lb # [ 202.698301] niks3-server[1092]: 2026/09/22 11:35:41 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 202.729849] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 202.734244] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 worker2 # [ 202.739898] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker2 # [ 202.742270] nix-daemon[867]: reaped child process 2042, status = succeeded client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... worker2 # [ 202.748085] nix-daemon[867]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 204.186143] nix-daemon[867]: reaped child process 2056, status = succeeded worker2 # [ 204.269061] nix-daemon[867]: accepted connection from pid 2072, user nix-grpc-daemon (trusted) worker2 # [ 204.282882] nix-daemon[867]: reaped child process 2075, status = succeeded lb # [ 204.258595] niks3-server[1092]: 2026/09/22 11:35:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 204.300188] nix-grpc-daemon[1755]: time=2026-09-22T11:35:43.466Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 204.301713] nix-grpc-daemon[1755]: time=2026-09-22T11:35:43.467Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 204.298147] niks3-server[1092]: 2026/09/22 11:35:42 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 204.305346] niks3-server[1092]: 2026/09/22 11:35:42 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 204.320861] niks3-server[1092]: 2026/09/22 11:35:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign lb # [ 204.325665] niks3-server[1092]: 2026/09/22 11:35:42 INFO Signed narinfos id=85 count=1 worker2 # [ 204.359698] nix-grpc-daemon[1755]: time=2026-09-22T11:35:43.525Z level=INFO msg="Uploading 1 narinfos" lb # [ 204.337740] niks3-server[1092]: 2026/09/22 11:35:42 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 204.339299] niks3-server[1092]: 2026/09/22 11:35:42 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 204.343390] niks3-server[1092]: 2026/09/22 11:35:42 INFO Completed upload id=85 worker2 # [ 204.375184] nix-grpc-daemon[1755]: time=2026-09-22T11:35:43.541Z level=INFO msg="Upload complete. (219ms)" lb # [ 204.345578] niks3-server[1092]: 2026/09/22 11:35:42 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 204.381965] nix-grpc-daemon[1663]: ts=2026-09-22T11:35:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44980 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 worker2 # [ 204.397272] nix-daemon[867]: reaped child process 2054, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.46 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.12 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 205.324221] nix-grpc-daemon[1810]: ts=2026-09-22T11:35:43Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.76 seconds) (finished: run the VM test script, in 206.67 seconds) test script finished in 206.85s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T11:35:45Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T11:35:46Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T11:35:46Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T11:35:46Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.09 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh