tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.RQhQzuTa25', fmt=raw size=1073741824 client: QEMU running (pid 49) client # mke2fs 1.47.4 (6-Mar-2025) lb # Disk image does not exist, creating the virtualisation disk image... client # Discarding device blocks: 0/262144 done lb # Formatting '/build/vm-state-lb/tmp.6CF368vp42', fmt=raw size=1073741824 client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # mke2fs 1.47.4 (6-Mar-2025) lb: QEMU running (pid 50) worker1 # Disk image does not exist, creating the virtualisation disk image... lb # Discarding device blocks: 0/262144 done worker1: QEMU running (pid 51) client # Filesystem UUID: d1837d7b-7cad-41be-9369-6315479279f8 worker1 # Formatting '/build/vm-state-worker1/tmp.CvNYMxuPFd', fmt=raw size=1073741824 client # Superblock backups stored on blocks: worker1 # mke2fs 1.47.4 (6-Mar-2025) client # 32768, 98304, 163840, 229376 worker1 # Discarding device blocks: 0/262144 done client # worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Allocating group tables: 0/8 done worker1 # Filesystem UUID: ce910eb5-ac87-49db-9b0e-64075be98147 client # Writing inode tables: 0/8 done worker1 # Superblock backups stored on blocks: client # Creating journal (8192 blocks): done worker1 # 32768, 98304, 163840, 229376 client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # client # worker1 # Allocating group tables: 0/8 done client # Virtualisation disk image created. worker1 # Writing inode tables: 0/8 done client # Starting virtiofs daemons... worker1 # Creating journal (8192 blocks): done client # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # Writing superblocks and filesystem accounting information: 0/8 done client # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # client # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # Virtualisation disk image created. client # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # Starting virtiofs daemons... client # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # Disk image does not exist, creating the virtualisation disk image... worker1 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # Formatting '/build/vm-state-worker2/tmp.670QnHUrxS', fmt=raw size=1073741824 worker1 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2: QEMU running (pid 52) lb # Filesystem UUID: 3538cfd2-bd36-4280-86ae-357e2a48f392 worker2 # Discarding device blocks: 0/262144 done lb # Superblock backups stored on blocks: worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # 32768, 98304, 163840, 229376 worker1 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) (finished: start all VMs, in 0.22 seconds) worker2 # Filesystem UUID: d9fcfd20-3f20-4f1d-b028-6a9b6653a44a lb # worker1 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client: waiting for unit network-addresses-eth1.service worker2 # Superblock backups stored on blocks: lb # Allocating group tables: 0/8 done worker1 # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... client: waiting for the VM to finish booting worker2 # 32768, 98304, 163840, 229376 lb # Writing inode tables: 0/8 done worker2 # lb # Creating journal (8192 blocks): done worker2 # Allocating group tables: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing inode tables: 0/8 done lb # worker2 # Creating journal (8192 blocks): done lb # Virtualisation disk image created. worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # Starting virtiofs daemons... worker2 # lb # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Virtualisation disk image created. lb # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Starting virtiofs daemons... lb # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-25T16:31:22Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-25T16:31:22Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-25T16:31:22Z INFO virtiofsd] Client connected, servicing requests worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # worker1 # client # client # lb # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # lb # client # lb # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # lb # Booting from ROM... worker1 # Booting from ROM... client # Booting from ROM... worker2 # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f94wjck2a7wq46iir6a6zbavnfk7qfqj-nixos-system-worker1-test/init regInfo=/nix/store/bmgjg3l7l2l8lkg7xd7sfzlrxaklnwwz-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/m68sx34dr7yy1drfgmzf0cyxm52cz9hp-nixos-system-worker2-test/init regInfo=/nix/store/zijq974g613q511fgj3vy2szbqsd8kv2-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] kvm-clock: using sched offset of 475972540 cycles worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000823] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000850] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000853] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.002767] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.002779] Using GB pages for direct mapping client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test/init regInfo=/nix/store/h3j26zp3yqdh88ddln89hmpjd3kw928v-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] kvm-clock: using sched offset of 478269960 cycles lb # [ 0.002923] RAMDISK: [mem 0x5e36e000-0x5ffcffff] client # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.002932] ACPI: Early table checksum verification disabled client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.002935] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000803] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002939] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.002943] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.002950] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002731] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.002952] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002741] Using GB pages for direct mapping worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.002811] RAMDISK: [mem 0x5e370000-0x5ffcffff] client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.002954] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] kvm-clock: using sched offset of 460816586 cycles worker1 # [ 0.002825] ACPI: Early table checksum verification disabled client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.002955] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002827] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.002957] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.002831] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.002958] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002835] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.002960] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.002842] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.002960] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.002844] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002961] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.002845] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002738] Using GB pages for direct mapping lb # [ 0.002961] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002808] RAMDISK: [mem 0x5e36f000-0x5ffcffff] worker1 # [ 0.002847] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.002962] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002815] ACPI: Early table checksum verification disabled client # [ 0.000000] kvm-clock: using sched offset of 474737876 cycles worker2 # [ 0.002818] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002849] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002962] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.002963] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002822] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.002850] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003194] No NUMA configuration found client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.002851] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002825] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003195] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.003197] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.002852] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002832] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005629] Zone ranges: client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.002834] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002853] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.005630] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.002853] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.002835] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005631] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.005633] Normal empty client # [ 0.002732] Using GB pages for direct mapping lb # [ 0.005633] Device empty worker1 # [ 0.002854] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002837] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002903] RAMDISK: [mem 0x5e370000-0x5ffcffff] lb # [ 0.005634] Movable zone start for each node worker1 # [ 0.002854] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.005635] Early memory node ranges client # [ 0.002913] ACPI: Early table checksum verification disabled worker2 # [ 0.002838] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005635] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.002915] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002855] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.003075] No NUMA configuration found lb # [ 0.005636] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.002840] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002919] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003076] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.005637] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.002841] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.003078] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.002923] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005659] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.005304] Zone ranges: worker2 # [ 0.002842] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.005911] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.002930] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005305] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002843] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.031528] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.002933] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.005306] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.031985] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.002843] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.005307] Normal empty worker1 # [ 0.005308] Device empty client # [ 0.002934] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.031996] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.002844] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.005309] Movable zone start for each node worker1 # [ 0.005310] Early memory node ranges lb # [ 0.032021] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.002936] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002844] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.032024] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.005310] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.002937] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002845] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.005311] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.032025] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.003075] No NUMA configuration found client # [ 0.002939] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.032026] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.005312] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.003076] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002940] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.005330] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.003078] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.032027] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.005335] Zone ranges: client # [ 0.002941] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.005586] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.032028] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.005336] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.031199] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.002942] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.032031] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.031657] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.005337] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.005338] Normal empty lb # [ 0.032031] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.002942] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.005339] Device empty lb # [ 0.032035] TSC deadline timer available worker1 # [ 0.031668] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.005340] Movable zone start for each node client # [ 0.002943] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.032038] CPU topo: Max. logical packages: 1 worker1 # [ 0.031694] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.005340] Early memory node ranges lb # [ 0.032039] CPU topo: Max. logical dies: 1 client # [ 0.002943] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.031697] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.005341] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.032039] CPU topo: Max. dies per package: 1 lb # [ 0.032043] CPU topo: Max. threads per core: 1 client # [ 0.002944] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.005342] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.031698] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.003191] No NUMA configuration found lb # [ 0.032043] CPU topo: Num. cores per package: 1 worker1 # [ 0.031699] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.005343] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.032044] CPU topo: Num. threads per package: 1 client # [ 0.003192] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.031700] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.005362] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.032044] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.003194] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.005619] Zone ranges: worker2 # [ 0.005624] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.031701] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.032061] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.005620] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.031809] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.031703] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.032096] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.005621] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.032290] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.031704] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.005622] Normal empty client # [ 0.005623] Device empty worker1 # [ 0.031708] TSC deadline timer available lb # [ 0.032097] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.032300] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.005624] Movable zone start for each node worker1 # [ 0.031712] CPU topo: Max. logical packages: 1 lb # [ 0.032099] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.032326] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.005624] Early memory node ranges worker1 # [ 0.031713] CPU topo: Max. logical dies: 1 lb # [ 0.032100] Booting paravirtualized kernel on KVM worker2 # [ 0.032328] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.005625] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.031713] CPU topo: Max. dies per package: 1 worker1 # [ 0.031716] CPU topo: Max. threads per core: 1 client # [ 0.005626] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.032330] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.032103] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.031717] CPU topo: Num. cores per package: 1 client # [ 0.005627] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.032331] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.036659] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.031717] CPU topo: Num. threads per package: 1 client # [ 0.005646] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.032332] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.031717] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.038763] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.005929] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.032333] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.038805] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.031735] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.034060] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.034529] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.032335] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.031764] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.032336] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.034540] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.032339] TSC deadline timer available worker1 # [ 0.031766] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.034568] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.032343] CPU topo: Max. logical packages: 1 worker1 # [ 0.031767] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.032344] CPU topo: Max. logical dies: 1 client # [ 0.034571] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.031768] Booting paravirtualized kernel on KVM worker2 # [ 0.032344] CPU topo: Max. dies per package: 1 lb # [ 0.038807] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.034572] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.032348] CPU topo: Max. threads per core: 1 worker1 # [ 0.031771] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.032348] CPU topo: Num. cores per package: 1 client # [ 0.034574] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.032349] CPU topo: Num. threads per package: 1 lb # [ 0.038898] Unknown kernel command line parameters "regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration", will be passed to user space. client # [ 0.034575] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.036250] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.038911] random: crng init done worker2 # [ 0.032349] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.038347] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.034575] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.038912] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.038389] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.032366] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.034578] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.040994] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.034579] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.032395] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.034583] TSC deadline timer available lb # [ 0.042032] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.034587] CPU topo: Max. logical packages: 1 worker2 # [ 0.032396] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.042066] Fallback order for Node 0: 0 client # [ 0.034588] CPU topo: Max. logical dies: 1 worker2 # [ 0.032398] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.042070] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.034588] CPU topo: Max. dies per package: 1 worker2 # [ 0.032399] Booting paravirtualized kernel on KVM lb # [ 0.042070] Policy zone: DMA32 client # [ 0.034592] CPU topo: Max. threads per core: 1 worker1 # [ 0.038391] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f94wjck2a7wq46iir6a6zbavnfk7qfqj-nixos-system-worker1-test/init regInfo=/nix/store/bmgjg3l7l2l8lkg7xd7sfzlrxaklnwwz-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.034592] CPU topo: Num. cores per package: 1 lb # [ 0.044691] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.032402] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.034593] CPU topo: Num. threads per package: 1 lb # [ 0.047667] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.034593] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.036860] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.050891] allocated 3145728 bytes of page_ext worker1 # [ 0.038480] Unknown kernel command line parameters "regInfo=/nix/store/bmgjg3l7l2l8lkg7xd7sfzlrxaklnwwz-closure-info/registration", will be passed to user space. lb # [ 0.060749] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.038493] random: crng init done worker2 # [ 0.038983] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.034611] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.060750] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.039024] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.038494] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.034642] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.061577] Dynamic Preempt: lazy lb # [ 0.061738] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.040576] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.034644] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.061739] rcu: RCU event tracing is enabled. client # [ 0.034645] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.041796] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.061740] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.034647] Booting paravirtualized kernel on KVM worker1 # [ 0.041834] Fallback order for Node 0: 0 lb # [ 0.061741] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.041837] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.061742] Rude variant of Tasks RCU enabled. client # [ 0.034650] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.041838] Policy zone: DMA32 worker2 # [ 0.039026] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/m68sx34dr7yy1drfgmzf0cyxm52cz9hp-nixos-system-worker2-test/init regInfo=/nix/store/zijq974g613q511fgj3vy2szbqsd8kv2-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.061742] Tracing variant of Tasks RCU enabled. worker1 # [ 0.044224] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.039149] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.061743] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.047166] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.041428] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.039117] Unknown kernel command line parameters "regInfo=/nix/store/zijq974g613q511fgj3vy2szbqsd8kv2-closure-info/registration", will be passed to user space. lb # [ 0.061743] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.050378] allocated 3145728 bytes of page_ext client # [ 0.041476] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.039129] random: crng init done worker1 # [ 0.060229] ftrace: allocating 48787 entries in 192 pages lb # [ 0.061759] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.039130] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.060231] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.061045] Dynamic Preempt: lazy lb # [ 0.061760] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.041220] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.061172] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.061172] rcu: RCU event tracing is enabled. worker2 # [ 0.042269] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.061761] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.042304] Fallback order for Node 0: 0 lb # [ 0.066183] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.061173] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.041478] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test/init regInfo=/nix/store/h3j26zp3yqdh88ddln89hmpjd3kw928v-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.061174] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.042307] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.066450] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.042308] Policy zone: DMA32 worker1 # [ 0.061175] Rude variant of Tasks RCU enabled. worker1 # [ 0.061175] Tracing variant of Tasks RCU enabled. client # [ 0.041573] Unknown kernel command line parameters "regInfo=/nix/store/h3j26zp3yqdh88ddln89hmpjd3kw928v-closure-info/registration", will be passed to user space. worker2 # [ 0.044910] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.066456] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.041586] random: crng init done worker2 # [ 0.047912] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.061176] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.041586] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.051131] allocated 3145728 bytes of page_ext lb # [ 0.066552] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.061177] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.070103] Console: colour VGA+ 80x25 worker2 # [ 0.060872] ftrace: allocating 48787 entries in 192 pages client # [ 0.043845] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.070106] printk: legacy console [tty0] enabled worker2 # [ 0.060874] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.061233] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.099567] printk: legacy console [ttyS0] enabled worker2 # [ 0.061686] Dynamic Preempt: lazy client # [ 0.045245] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.196238] ACPI: Core revision 20250807 client # [ 0.045276] Fallback order for Node 0: 0 worker2 # [ 0.061845] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.061234] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.061845] rcu: RCU event tracing is enabled. client # [ 0.045279] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.045280] Policy zone: DMA32 worker1 # [ 0.061235] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.061846] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.197096] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.047924] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.065782] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.061847] Trampoline variant of Tasks RCU enabled. lb # [ 0.198575] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.061848] Rude variant of Tasks RCU enabled. client # [ 0.051225] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.066051] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.061848] Tracing variant of Tasks RCU enabled. lb # [ 0.199538] x2apic enabled client # [ 0.054701] allocated 3145728 bytes of page_ext client # [ 0.064629] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.066057] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.061849] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.200269] APIC: Switched APIC routing to: physical x2apic client # [ 0.064630] ftrace: allocated 192 pages with 2 groups client # [ 0.065500] Dynamic Preempt: lazy worker2 # [ 0.061849] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.066156] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.065688] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.069680] Console: colour VGA+ 80x25 client # [ 0.065689] rcu: RCU event tracing is enabled. worker2 # [ 0.061869] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.202058] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.069683] printk: legacy console [tty0] enabled worker1 # [ 0.099718] printk: legacy console [ttyS0] enabled client # [ 0.065690] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.061871] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.065691] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.198450] ACPI: Core revision 20250807 lb # [ 0.203059] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.065692] Rude variant of Tasks RCU enabled. worker2 # [ 0.061872] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.065692] Tracing variant of Tasks RCU enabled. worker2 # [ 0.066212] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.199286] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.204715] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.065693] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.066481] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.200815] APIC: Switch to symmetric I/O mode setup client # [ 0.065693] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.205805] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.201812] x2apic enabled worker2 # [ 0.066488] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.065710] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.206855] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.202594] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.066585] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.065712] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.207713] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.070213] Console: colour VGA+ 80x25 worker2 # [ 0.070215] printk: legacy console [tty0] enabled client # [ 0.065713] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.100195] printk: legacy console [ttyS0] enabled worker1 # [ 0.204499] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.208716] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.070500] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.198781] ACPI: Core revision 20250807 client # [ 0.070761] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.209713] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.205484] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.070770] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.199645] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.210713] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.207149] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.201149] APIC: Switch to symmetric I/O mode setup client # [ 0.070887] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.211712] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.074406] Console: colour VGA+ 80x25 worker2 # [ 0.202136] x2apic enabled worker1 # [ 0.208235] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.074409] printk: legacy console [tty0] enabled lb # [ 0.212712] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.103942] printk: legacy console [ttyS0] enabled worker2 # [ 0.202914] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.210031] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.199302] ACPI: Core revision 20250807 worker1 # [ 0.210843] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.204741] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.200227] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.211943] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.201737] APIC: Switch to symmetric I/O mode setup lb # [ 0.213713] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.205762] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.202717] x2apic enabled lb # [ 0.215719] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.213146] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.207457] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.203499] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.214146] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.216459] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.208540] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.217713] active return thunk: srso_alias_return_thunk worker1 # [ 0.215146] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.205306] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.209612] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.216050] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.218733] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.211140] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.206296] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.219712] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.220713] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.207961] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.212243] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.221712] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.209047] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.216876] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.213454] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.222712] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.218153] Spectre V2 : Enabling IBPB for BPF client # [ 0.210129] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.214454] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.223712] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.211623] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.215388] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.219662] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.224713] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.220146] active return thunk: srso_alias_return_thunk worker2 # [ 0.216136] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.211962] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.226607] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.221000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.227434] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.213958] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.222146] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.228431] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.214958] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.223146] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.229435] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.216679] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.217189] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.230435] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.224146] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.218462] Spectre V2 : Enabling IBPB for BPF client # [ 0.216958] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.225146] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.230712] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.219998] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.226146] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.220455] active return thunk: srso_alias_return_thunk worker1 # [ 0.227145] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.221364] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.217957] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.228146] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.222454] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.219965] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.229146] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.223454] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.230146] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.220958] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.224454] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.221958] active return thunk: srso_alias_return_thunk worker1 # [ 0.231146] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.225454] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.232146] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.223600] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.226454] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.224860] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.233146] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.227454] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.225703] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.228455] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.226710] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.229454] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.227700] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.230454] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.228702] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.231454] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.229750] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.232454] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.230958] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.231957] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.233454] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.232957] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.233957] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.234957] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.235958] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.265617] Freeing SMP alternatives memory: 44K lb # [ 0.266295] pid_max: default: 32768 minimum: 301 lb # [ 0.266804] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.267826] landlock: Up and running. lb # [ 0.268713] Yama: becoming mindful. lb # [ 0.269916] LSM support for eBPF active lb # [ 0.270828] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.271749] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.268085] Freeing SMP alternatives memory: 44K worker1 # [ 0.268735] pid_max: default: 32768 minimum: 301 lb # [ 0.274498] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.269243] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.275302] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.270247] landlock: Up and running. worker1 # [ 0.271601] Yama: becoming mindful. lb # [ 0.275717] ... version: 2 lb # [ 0.276461] ... bit width: 48 worker1 # [ 0.272358] LSM support for eBPF active lb # [ 0.276715] ... generic counters: 6 worker1 # [ 0.273268] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.277485] ... generic bitmap: 000000000000003f lb # [ 0.277724] ... fixed-purpose counters: 0 worker2 # [ 0.268308] Freeing SMP alternatives memory: 44K worker1 # [ 0.274183] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.278408] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.269017] pid_max: default: 32768 minimum: 301 lb # [ 0.278715] ... value mask: 0000ffffffffffff worker2 # [ 0.269539] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.279639] ... max period: 00007fffffffffff worker1 # [ 0.276936] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.270555] landlock: Up and running. worker2 # [ 0.271455] Yama: becoming mindful. lb # [ 0.280427] ... global_ctrl mask: 000000000000003f worker2 # [ 0.272657] LSM support for eBPF active worker1 # [ 0.277653] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.280837] signal: max sigframe size: 3376 worker1 # [ 0.278150] ... version: 2 client # [ 0.270871] Freeing SMP alternatives memory: 44K lb # [ 0.281681] rcu: Hierarchical SRCU implementation. worker2 # [ 0.273418] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.278863] ... bit width: 48 client # [ 0.271512] pid_max: default: 32768 minimum: 301 lb # [ 0.282295] rcu: Max phase no-delay instances is 400. worker1 # [ 0.279148] ... generic counters: 6 worker2 # [ 0.274494] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.272066] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.279865] ... generic bitmap: 000000000000003f client # [ 0.273055] landlock: Up and running. worker1 # [ 0.280198] ... fixed-purpose counters: 0 client # [ 0.273958] Yama: becoming mindful. worker1 # [ 0.280922] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.275159] LSM support for eBPF active worker2 # [ 0.277097] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.281149] ... value mask: 0000ffffffffffff client # [ 0.275884] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.282084] ... max period: 00007fffffffffff lb # [ 0.287240] smp: Bringing up secondary CPUs ... worker2 # [ 0.277993] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.276998] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.282880] ... global_ctrl mask: 000000000000003f lb # [ 0.287729] smp: Brought up 1 node, 1 CPU worker2 # [ 0.278459] ... version: 2 worker1 # [ 0.283260] signal: max sigframe size: 3376 worker2 # [ 0.279139] ... bit width: 48 lb # [ 0.288401] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.284085] rcu: Hierarchical SRCU implementation. worker2 # [ 0.279457] ... generic counters: 6 client # [ 0.279415] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.284761] rcu: Max phase no-delay instances is 400. worker2 # [ 0.280184] ... generic bitmap: 000000000000003f worker2 # [ 0.280467] ... fixed-purpose counters: 0 lb # [ 0.288885] Memory: 1454576K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109320K reserved, 0K cma-reserved) client # [ 0.280546] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.281166] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.290176] devtmpfs: initialized client # [ 0.280963] ... version: 2 worker2 # [ 0.281457] ... value mask: 0000ffffffffffff lb # [ 0.290964] x86/mm: Memory block size: 128MB client # [ 0.281695] ... bit width: 48 worker2 # [ 0.282349] ... max period: 00007fffffffffff client # [ 0.281960] ... generic counters: 6 worker2 # [ 0.283131] ... global_ctrl mask: 000000000000003f client # [ 0.282662] ... generic bitmap: 000000000000003f lb # [ 0.292700] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.283565] signal: max sigframe size: 3376 worker1 # [ 0.289784] smp: Bringing up secondary CPUs ... client # [ 0.282965] ... fixed-purpose counters: 0 worker2 # [ 0.284367] rcu: Hierarchical SRCU implementation. client # [ 0.283675] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.290163] smp: Brought up 1 node, 1 CPU lb # [ 0.293598] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.285055] rcu: Max phase no-delay instances is 400. client # [ 0.283960] ... value mask: 0000ffffffffffff worker1 # [ 0.290839] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.294784] pinctrl core: initialized pinctrl subsystem client # [ 0.284824] ... max period: 00007fffffffffff lb # [ 0.295801] PM: RTC time: 16:31:22, date: 2026-09-25 client # [ 0.285631] ... global_ctrl mask: 000000000000003f worker1 # [ 0.291389] Memory: 1454584K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) client # [ 0.286056] signal: max sigframe size: 3376 worker1 # [ 0.292374] devtmpfs: initialized client # [ 0.286881] rcu: Hierarchical SRCU implementation. worker1 # [ 0.293279] x86/mm: Memory block size: 128MB client # [ 0.287564] rcu: Max phase no-delay instances is 400. lb # [ 0.299228] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.290062] smp: Bringing up secondary CPUs ... worker2 # [ 0.290470] smp: Brought up 1 node, 1 CPU lb # [ 0.300212] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.295079] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.291199] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.300734] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.296118] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.297225] pinctrl core: initialized pinctrl subsystem lb # [ 0.301988] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.291654] Memory: 1454628K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) client # [ 0.292498] smp: Bringing up secondary CPUs ... worker1 # [ 0.298318] PM: RTC time: 16:31:22, date: 2026-09-25 lb # [ 0.302725] audit: initializing netlink subsys (disabled) worker2 # [ 0.292706] devtmpfs: initialized client # [ 0.292973] smp: Brought up 1 node, 1 CPU worker2 # [ 0.293512] x86/mm: Memory block size: 128MB client # [ 0.293651] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.303858] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.303860] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.304716] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.295376] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.294142] Memory: 1454628K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker1 # [ 0.301876] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.305689] thermal_sys: Registered thermal governor 'user_space' client # [ 0.295238] devtmpfs: initialized worker2 # [ 0.296367] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.302723] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.296049] x86/mm: Memory block size: 128MB lb # [ 0.306402] audit: type=2000 audit(1790353883.126:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.297557] pinctrl core: initialized pinctrl subsystem lb # [ 0.307718] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.303171] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.298664] PM: RTC time: 16:31:22, date: 2026-09-25 lb # [ 0.307731] cpuidle: using governor menu client # [ 0.297840] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.304432] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.309925] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.298848] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.305157] audit: initializing netlink subsys (disabled) client # [ 0.300045] pinctrl core: initialized pinctrl subsystem lb # [ 0.310949] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.306150] audit: type=2000 audit(1790353883.132:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.302183] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.301156] PM: RTC time: 16:31:22, date: 2026-09-25 lb # [ 0.311718] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.307282] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.312727] PCI: Using configuration type 1 for base access worker2 # [ 0.302965] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.307284] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.303479] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.308150] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.313822] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.309149] thermal_sys: Registered thermal governor 'user_space' client # [ 0.304916] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.304744] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.310124] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.305466] audit: initializing netlink subsys (disabled) worker1 # [ 0.310946] cpuidle: using governor menu client # [ 0.306230] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.306636] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.306984] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.313230] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.306638] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.307458] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.308250] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.314402] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.308448] thermal_sys: Registered thermal governor 'user_space' client # [ 0.308970] audit: initializing netlink subsys (disabled) worker1 # [ 0.315152] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.320947] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.310095] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.309214] audit: type=2000 audit(1790353883.138:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.316160] PCI: Using configuration type 1 for base access lb # [ 0.321715] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.310097] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.310459] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.322697] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.317252] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.310961] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.310473] cpuidle: using governor menu client # [ 0.311894] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.312681] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.312635] audit: type=2000 audit(1790353883.150:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.313746] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.313963] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.313987] cpuidle: using governor menu worker2 # [ 0.314460] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.327717] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.315469] PCI: Using configuration type 1 for base access client # [ 0.316198] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.316594] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.324177] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.317209] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.325148] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.317963] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.318971] PCI: Using configuration type 1 for base access client # [ 0.320135] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.336120] ACPI: Added _OSI(Module Device) worker1 # [ 0.330149] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.336717] ACPI: Added _OSI(Processor Device) worker1 # [ 0.331150] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.323702] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.337483] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.324458] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.327180] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.327961] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.329458] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.330459] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.344270] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.332961] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.342435] ACPI: Added _OSI(Module Device) client # [ 0.333961] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.343150] ACPI: Added _OSI(Processor Device) lb # [ 0.348118] ACPI: Interpreter enabled worker1 # [ 0.343867] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.348730] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.349478] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.339105] ACPI: Added _OSI(Module Device) worker2 # [ 0.339458] ACPI: Added _OSI(Processor Device) lb # [ 0.351770] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.340209] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.352716] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.349510] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.355854] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.344410] ACPI: Added _OSI(Module Device) client # [ 0.344972] ACPI: Added _OSI(Processor Device) worker1 # [ 0.353550] ACPI: Interpreter enabled client # [ 0.345709] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.354164] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.354908] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.347031] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.357227] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.350397] ACPI: Interpreter enabled worker1 # [ 0.358149] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.350947] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.364483] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.351457] ACPI: Using IOAPIC for interrupt routing client # [ 0.352543] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.365467] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.352359] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.361286] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.366794] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.367837] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.356380] ACPI: Interpreter enabled lb # [ 0.369069] PCI host bridge to bus 0000:00 client # [ 0.356976] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.369720] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.357727] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.357457] PCI: Using E820 reservations for host bridge windows lb # [ 0.370715] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.358564] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.371715] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.368656] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.372715] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.360024] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.373715] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.360961] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.369154] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.374715] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.370228] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.375715] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.371270] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.364036] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.376755] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.372498] PCI host bridge to bus 0000:00 worker1 # [ 0.373153] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.367243] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.378183] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.374149] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.375148] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.368688] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.376149] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.369535] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.377148] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.370580] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.371119] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.371820] PCI host bridge to bus 0000:00 worker1 # [ 0.378149] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.371967] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.379150] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.372461] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.373038] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.373457] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.380767] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.380183] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.374082] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.381727] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.374457] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.375351] PCI host bridge to bus 0000:00 lb # [ 0.382670] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.381637] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.375457] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.375965] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.376457] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.383670] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.376961] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.377457] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.377960] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.378457] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.385510] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.378960] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.379412] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.379960] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.388752] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.380887] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.380960] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.389599] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.381960] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.384231] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.390475] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.385161] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.382880] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.390721] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.386125] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.384413] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.387351] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.392466] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.389093] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.394754] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.383508] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.395629] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.384469] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.396497] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.385472] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.392188] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.393065] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.386840] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.398154] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.393955] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.387118] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.395017] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.388045] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.388265] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.389023] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.396956] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.401001] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.390281] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.390489] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.402379] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.391374] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.402737] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.399186] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.391684] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.392264] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.400008] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.393409] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.404264] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.400966] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.394002] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.395300] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.402617] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.405757] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.394880] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.406635] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.395708] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.407538] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.397492] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.395967] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.398359] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.408592] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.405185] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.399254] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.397561] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.406090] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.410287] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.406940] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.400901] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.399000] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.411735] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.408569] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.399918] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.412697] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.400708] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.403628] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.411002] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.414175] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.401565] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.404464] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.411763] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.405447] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.415728] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.412173] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.406935] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.413156] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.403994] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.416738] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.404808] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.414750] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.405736] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.418317] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.408498] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.409321] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.416162] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.407315] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.410234] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.419727] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.417111] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.420674] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.411265] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.409003] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.418565] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.422134] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.409880] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.413165] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.423761] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.410716] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.415324] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.420191] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.410967] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.416227] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.424737] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.421172] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.412466] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.417923] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.426356] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.422761] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.413833] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.419470] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.414734] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.424162] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.427734] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.425103] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.420467] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.428581] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.416362] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.429507] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.426553] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.422013] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.418005] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.431190] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.423258] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.419012] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.428472] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.424230] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.429172] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.420575] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.425867] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.433216] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.430730] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.434377] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.421830] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.427469] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.434737] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.422731] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.428418] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.432200] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.436269] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.433103] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.424405] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.433892] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.429980] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.437421] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.425973] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.437910] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.431472] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.434693] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.426982] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.432347] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.439347] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.433219] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.428495] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.436187] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.439906] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.437075] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.434049] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.441367] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.430014] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.437953] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.430867] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.439563] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.431820] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.435488] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.436464] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.440785] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.433399] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.437480] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.441345] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.439056] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.443557] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.435199] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.440050] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.435967] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.444354] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.440663] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.436937] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.445799] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.442021] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.438393] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.441952] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.442693] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.439505] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.444373] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.444004] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.440177] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.445003] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.441512] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.446009] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.442152] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.447045] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.443541] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.448743] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.449626] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.450883] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.446380] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.452415] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.448775] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.449460] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.444723] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.450443] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.447042] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.456137] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.451400] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.447692] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.456820] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.457817] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.448747] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.453130] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.444186] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.458813] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.453760] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.449709] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.459811] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.446595] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.460810] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.454485] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.451354] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.447267] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.461816] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.452098] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.455812] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.462827] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.448245] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.463752] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.452818] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.449363] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.464729] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.454085] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.465730] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.450862] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.459852] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.466730] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.451650] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.460259] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.467728] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.468727] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.452278] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.461245] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.457816] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.469677] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.462249] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.453869] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.470472] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.458564] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.463243] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.459555] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.464264] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.471777] iommu: Default domain type: Translated worker2 # [ 0.460555] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.465272] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.472600] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.461585] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.466254] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.473743] ACPI: bus type USB registered client # [ 0.457640] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.462556] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.474509] usbcore: registered new interface driver usbfs worker1 # [ 0.467188] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.458069] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.463558] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.475404] usbcore: registered new interface driver hub worker1 # [ 0.468165] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.459058] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.475732] usbcore: registered new device driver usb worker2 # [ 0.464558] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.469155] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.460062] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.465494] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.470154] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.477489] NetLabel: Initializing client # [ 0.461061] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.466469] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.477716] NetLabel: domain hash size = 128 worker1 # [ 0.471127] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.462055] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.478413] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.467471] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.471904] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.463059] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.478751] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.468473] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.472163] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.464062] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.479604] PCI: Using ACPI for IRQ routing worker2 # [ 0.469460] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.473129] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.464995] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.470443] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.465953] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.474929] iommu: Default domain type: Translated worker2 # [ 0.471234] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.466716] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.471473] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.475156] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.466972] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.476410] ACPI: bus type USB registered client # [ 0.467920] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.473448] iommu: Default domain type: Translated worker1 # [ 0.477205] usbcore: registered new interface driver usbfs client # [ 0.468728] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.478123] usbcore: registered new interface driver hub worker2 # [ 0.474281] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.469686] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.478831] usbcore: registered new device driver usb worker2 # [ 0.475489] ACPI: bus type USB registered client # [ 0.469975] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.476256] usbcore: registered new interface driver usbfs worker1 # [ 0.480280] NetLabel: Initializing worker2 # [ 0.477201] usbcore: registered new interface driver hub client # [ 0.472001] iommu: Default domain type: Translated worker1 # [ 0.480902] NetLabel: domain hash size = 128 worker2 # [ 0.477473] usbcore: registered new device driver usb client # [ 0.472821] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.481149] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.474008] ACPI: bus type USB registered worker2 # [ 0.479201] NetLabel: Initializing worker1 # [ 0.482190] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.479463] NetLabel: domain hash size = 128 worker1 # [ 0.483099] PCI: Using ACPI for IRQ routing client # [ 0.474738] usbcore: registered new interface driver usbfs worker2 # [ 0.480220] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.474978] usbcore: registered new interface driver hub worker2 # [ 0.480496] NetLabel: unlabeled traffic allowed by default client # [ 0.475888] usbcore: registered new device driver usb worker2 # [ 0.481466] PCI: Using ACPI for IRQ routing client # [ 0.477525] NetLabel: Initializing client # [ 0.477961] NetLabel: domain hash size = 128 client # [ 0.478756] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.479763] NetLabel: unlabeled traffic allowed by default client # [ 0.480709] PCI: Using ACPI for IRQ routing lb # [ 0.523985] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.524711] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.524711] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.524720] vgaarb: loaded lb # [ 0.525508] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.525717] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.530825] clocksource: Switched to clocksource kvm-clock lb # [ 0.534253] VFS: Disk quotas dquot_6.6.0 lb # [ 0.534967] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.536380] pnp: PnP ACPI init worker1 # [ 0.529553] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.537130] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.530145] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.538074] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.530145] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.530154] vgaarb: loaded worker2 # [ 0.528954] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.539662] pnp: PnP ACPI: found 5 devices worker2 # [ 0.529453] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.530900] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.525259] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.531149] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.529453] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.525956] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.529462] vgaarb: loaded worker2 # [ 0.530227] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.525956] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.525966] vgaarb: loaded worker2 # [ 0.530460] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.526755] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.527636] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.535237] clocksource: Switched to clocksource kvm-clock lb # [ 0.547232] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.537023] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.534569] clocksource: Switched to clocksource kvm-clock lb # [ 0.548728] clocksource: Switched to clocksource acpi_pm lb # [ 0.549744] NET: Registered PF_INET protocol family worker1 # [ 0.539568] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.532053] clocksource: Switched to clocksource kvm-clock lb # [ 0.550940] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.538057] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.540909] pnp: PnP ACPI init worker2 # [ 0.538783] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.541757] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.540214] pnp: PnP ACPI init worker1 # [ 0.542821] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.535708] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.541056] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.544427] pnp: PnP ACPI: found 5 devices client # [ 0.536407] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.542017] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.537714] pnp: PnP ACPI init worker2 # [ 0.543568] pnp: PnP ACPI: found 5 devices client # [ 0.538540] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.539498] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.541129] pnp: PnP ACPI: found 5 devices worker1 # [ 0.552010] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.553534] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.551177] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.554539] NET: Registered PF_INET protocol family worker2 # [ 0.552668] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.555727] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.553692] NET: Registered PF_INET protocol family lb # [ 0.567034] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.548853] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.568564] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.555075] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.550292] clocksource: Switched to clocksource acpi_pm lb # [ 0.569866] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.551262] NET: Registered PF_INET protocol family lb # [ 0.571190] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.552479] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.572490] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.573731] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.575118] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.576356] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.577612] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.578616] NET: Registered PF_XDP protocol family lb # [ 0.579508] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.580568] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.581614] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.582783] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.572350] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.583940] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.585032] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.573899] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.571433] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.586737] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.575238] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.573098] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.576606] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.574438] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.589031] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.569466] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.577914] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.575792] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.570968] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.579036] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.577088] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.591221] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.580320] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.572283] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.578208] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.581390] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.573608] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.593220] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.579492] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.582609] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.574810] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.580568] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.583579] NET: Registered PF_XDP protocol family lb # [ 0.594976] PCI: CLS 0 bytes, default 64 client # [ 0.575906] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.584411] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.581767] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.577149] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.582713] NET: Registered PF_XDP protocol family worker1 # [ 0.585383] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.595916] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.583552] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.578225] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.586335] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.597614] Trying to unpack rootfs image as initramfs... client # [ 0.579394] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.584552] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.587380] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.580307] NET: Registered PF_XDP protocol family worker2 # [ 0.585567] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.588459] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.581147] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.586691] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.589614] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.582162] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.587803] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.591335] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.583210] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.588937] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.584305] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.590643] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.585443] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.593704] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.586512] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.592942] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.596171] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.588306] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.595251] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.598203] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.591014] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.597272] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.599935] PCI: CLS 0 bytes, default 64 client # [ 0.593012] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.599006] PCI: CLS 0 bytes, default 64 worker1 # [ 0.600968] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.602736] Trying to unpack rootfs image as initramfs... client # [ 0.594992] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.599878] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.601630] Trying to unpack rootfs image as initramfs... client # [ 0.596767] PCI: CLS 0 bytes, default 64 client # [ 0.597637] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.599438] Trying to unpack rootfs image as initramfs... lb # [ 0.642673] Initialise system trusted keyrings lb # [ 0.643672] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.646838] Initialise system trusted keyrings worker2 # [ 0.646752] Initialise system trusted keyrings worker1 # [ 0.650172] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.647723] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.643267] Initialise system trusted keyrings client # [ 0.646261] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.667378] Key type asymmetric registered lb # [ 0.668137] Asymmetric key parser 'x509' registered lb # [ 0.669028] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.674374] io scheduler mq-deadline registered lb # [ 0.675192] io scheduler kyber registered lb # [ 0.677836] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.679196] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.672178] Key type asymmetric registered worker1 # [ 0.672925] Asymmetric key parser 'x509' registered lb # [ 0.684910] Linux agpgart interface v0.103 worker2 # [ 0.671088] Key type asymmetric registered worker1 # [ 0.673828] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.671843] Asymmetric key parser 'x509' registered lb # [ 0.685700] ACPI: bus type drm_connector registered worker2 # [ 0.672697] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.669338] Key type asymmetric registered lb # [ 0.688720] usbcore: registered new interface driver usbserial_generic client # [ 0.670103] Asymmetric key parser 'x509' registered lb # [ 0.689811] usbserial: USB Serial support registered for generic worker1 # [ 0.679253] io scheduler mq-deadline registered client # [ 0.670982] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.680013] io scheduler kyber registered worker2 # [ 0.678088] io scheduler mq-deadline registered worker2 # [ 0.678914] io scheduler kyber registered client # [ 0.674324] io scheduler mq-deadline registered lb # [ 0.693296] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.675132] io scheduler kyber registered lb # [ 0.693296] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.683800] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.695540] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.682558] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.685126] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.677862] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.697449] drop_monitor: Initializing network drop monitor service worker2 # [ 0.683857] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.679142] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.698655] NET: Registered PF_INET6 protocol family worker1 # [ 0.688725] Linux agpgart interface v0.103 worker1 # [ 0.689508] ACPI: bus type drm_connector registered worker2 # [ 0.687750] Linux agpgart interface v0.103 worker2 # [ 0.688556] ACPI: bus type drm_connector registered lb # [ 0.703785] Segment Routing with IPv6 worker1 # [ 0.692539] usbcore: registered new interface driver usbserial_generic client # [ 0.685010] Linux agpgart interface v0.103 lb # [ 0.704489] In-situ OAM (IOAM) with IPv6 client # [ 0.685808] ACPI: bus type drm_connector registered worker1 # [ 0.693649] usbserial: USB Serial support registered for generic worker2 # [ 0.691411] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.692544] usbserial: USB Serial support registered for generic lb # [ 0.707564] IPI shorthand broadcast: enabled worker1 # [ 0.696122] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.696122] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.695007] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.698380] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.690652] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.695007] Please enable it if your BIOS has the CPPC option. client # [ 0.691728] usbserial: USB Serial support registered for generic worker2 # [ 0.697281] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.702252] drop_monitor: Initializing network drop monitor service worker1 # [ 0.703500] NET: Registered PF_INET6 protocol family client # [ 0.695227] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.695227] Please enable it if your BIOS has the CPPC option. lb # [ 0.715812] sched_clock: Marking stable (581014599, 134255968)->(787717591, -72447024) client # [ 0.697516] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.703124] drop_monitor: Initializing network drop monitor service worker2 # [ 0.704321] NET: Registered PF_INET6 protocol family lb # [ 0.719396] registered taskstats version 1 worker1 # [ 0.708620] Segment Routing with IPv6 lb # [ 0.720402] Loading compiled-in X.509 certificates client # [ 0.701364] drop_monitor: Initializing network drop monitor service worker2 # [ 0.707418] Segment Routing with IPv6 client # [ 0.702541] NET: Registered PF_INET6 protocol family worker1 # [ 0.712152] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.710036] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.713277] IPI shorthand broadcast: enabled client # [ 0.705660] Segment Routing with IPv6 worker2 # [ 0.711109] IPI shorthand broadcast: enabled client # [ 0.708232] In-situ OAM (IOAM) with IPv6 client # [ 0.709375] IPI shorthand broadcast: enabled worker1 # [ 0.721582] sched_clock: Marking stable (585015634, 136088055)->(799426982, -78323293) worker2 # [ 0.719302] sched_clock: Marking stable (582014403, 136965715)->(793373053, -74392935) worker1 # [ 0.726211] registered taskstats version 1 client # [ 0.717723] sched_clock: Marking stable (584014813, 133187124)->(792414938, -75213001) worker2 # [ 0.724217] registered taskstats version 1 worker1 # [ 0.727192] Loading compiled-in X.509 certificates worker2 # [ 0.725216] Loading compiled-in X.509 certificates lb # [ 0.739279] Demotion targets for Node 0: null lb # [ 0.740124] Key type .fscrypt registered lb # [ 0.740849] Key type fscrypt-provisioning registered lb # [ 0.741850] ima: No TPM chip found, activating TPM-bypass! client # [ 0.723301] registered taskstats version 1 client # [ 0.724291] Loading compiled-in X.509 certificates lb # [ 0.746288] ima: Allocated hash algorithm: sha1 lb # [ 0.747076] ima: No architecture policies found lb # [ 0.749291] PM: Magic number: 10:74:541 lb # [ 0.750842] RAS: Correctable Errors collector initialized. worker1 # [ 0.745117] Demotion targets for Node 0: null worker1 # [ 0.746073] Key type .fscrypt registered worker2 # [ 0.743995] Demotion targets for Node 0: null worker2 # [ 0.744918] Key type .fscrypt registered lb # [ 0.759983] clk: Disabling unused clocks client # [ 0.740854] Demotion targets for Node 0: null worker1 # [ 0.749108] Key type fscrypt-provisioning registered worker1 # [ 0.750043] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.747985] Key type fscrypt-provisioning registered worker1 # [ 0.751010] ima: Allocated hash algorithm: sha1 worker2 # [ 0.748957] ima: No TPM chip found, activating TPM-bypass! client # [ 0.744245] Key type .fscrypt registered worker2 # [ 0.749945] ima: Allocated hash algorithm: sha1 client # [ 0.744936] Key type fscrypt-provisioning registered worker1 # [ 0.753135] ima: No architecture policies found lb # [ 0.764289] PM: genpd: Disabling unused power domains client # [ 0.745914] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.752013] ima: No architecture policies found worker2 # [ 0.753030] PM: Magic number: 10:74:541 worker1 # [ 0.756120] PM: Magic number: 10:74:541 client # [ 0.748220] ima: Allocated hash algorithm: sha1 client # [ 0.749024] ima: No architecture policies found worker2 # [ 0.754617] RAS: Correctable Errors collector initialized. worker1 # [ 0.757693] RAS: Correctable Errors collector initialized. client # [ 0.753222] PM: Magic number: 10:74:541 client # [ 0.754948] RAS: Correctable Errors collector initialized. worker1 # [ 0.765804] clk: Disabling unused clocks worker2 # [ 0.764689] clk: Disabling unused clocks worker2 # [ 0.766999] PM: genpd: Disabling unused power domains worker1 # [ 0.770124] PM: genpd: Disabling unused power domains client # [ 0.762909] clk: Disabling unused clocks client # [ 0.767225] PM: genpd: Disabling unused power domains lb # [ 0.920095] Freeing initrd memory: 29064K lb # [ 0.923367] Freeing unused decrypted memory: 2028K lb # [ 0.925967] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.927062] Write protecting the kernel read-only data: 32768k lb # [ 0.928958] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.930458] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.924060] Freeing initrd memory: 29060K worker2 # [ 0.927235] Freeing unused decrypted memory: 2028K worker1 # [ 0.930315] Freeing initrd memory: 29056K worker2 # [ 0.929815] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.933558] Freeing unused decrypted memory: 2028K worker2 # [ 0.931061] Write protecting the kernel read-only data: 32768k worker2 # [ 0.932957] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.936180] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.934514] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.937307] Write protecting the kernel read-only data: 32768k worker1 # [ 0.939223] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.940759] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.938514] Freeing initrd memory: 29056K client # [ 0.941790] Freeing unused decrypted memory: 2028K client # [ 0.944547] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.945724] Write protecting the kernel read-only data: 32768k client # [ 0.947681] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.949271] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.981437] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.982524] Run /init as init process lb # [ 0.993062] systemd[1]: Inserted module 'autofs4' worker2 # [ 0.985343] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.986482] Run /init as init process worker1 # [ 0.991694] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.992818] Run /init as init process worker2 # [ 0.997191] systemd[1]: Inserted module 'autofs4' lb # [ 1.012848] fuse: init (API version 7.45) worker1 # [ 1.003394] systemd[1]: Inserted module 'autofs4' client # [ 1.000355] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.020200] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.001526] Run /init as init process lb # [ 1.022575] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.025907] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.027986] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.017053] fuse: init (API version 7.45) client # [ 1.012603] systemd[1]: Inserted module 'autofs4' lb # [ 1.033031] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.023164] fuse: init (API version 7.45) lb # [ 1.034649] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.024477] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.026919] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.030547] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.041600] virtiofs virtio6: discovered new tag: shared lb # [ 1.043185] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.029880] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.033029] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.031892] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.046279] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.036215] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.047808] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.038341] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.036994] virtiofs virtio5: discovered new tag: nix-store client # [ 1.032394] fuse: init (API version 7.45) worker2 # [ 1.038559] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.043543] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.045107] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.039840] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.045255] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.046717] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.042642] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.052369] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.050130] virtiofs virtio7: discovered new tag: xchg client # [ 1.045993] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.054073] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.051647] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.048325] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.057313] virtiofs virtio7: discovered new tag: xchg lb # [ 1.070049] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.058829] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.054267] virtiofs virtio5: discovered new tag: nix-store client # [ 1.055906] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.063008] virtiofs virtio6: discovered new tag: shared client # [ 1.064605] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.068162] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.074751] systemd[1]: Successfully made /usr/ read-only. client # [ 1.069701] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.079885] systemd[1]: Successfully made /usr/ read-only. client # [ 1.091369] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.406301] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.418135] systemd[1]: Detected virtualization kvm. lb # [ 1.420320] systemd[1]: Detected architecture x86-64. lb # [ 1.422429] systemd[1]: Running in initrd. lb # [ 1.424847] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.410248] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.427750] systemd[1]: Hostname set to . worker2 # [ 1.415313] systemd[1]: Detected virtualization kvm. worker2 # [ 1.416200] systemd[1]: Detected architecture x86-64. worker2 # [ 1.417111] systemd[1]: Running in initrd. worker2 # [ 1.418196] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.419520] systemd[1]: Hostname set to . worker1 # [ 1.416530] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.428807] systemd[1]: Detected virtualization kvm. worker1 # [ 1.431012] systemd[1]: Detected architecture x86-64. worker1 # [ 1.433218] systemd[1]: Running in initrd. worker1 # [ 1.435635] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.438641] systemd[1]: Hostname set to . client # [ 1.428138] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.440304] systemd[1]: Detected virtualization kvm. client # [ 1.442422] systemd[1]: Detected architecture x86-64. client # [ 1.444526] systemd[1]: Running in initrd. client # [ 1.447022] systemd[1]: Initializing machine ID from random generator. client # [ 1.449942] systemd[1]: Hostname set to . worker2 # [ 1.620167] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.649209] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.645424] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.671356] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.668395] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.675226] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.676435] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.677908] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.679152] systemd[1]: Reached target Path Units. worker2 # [ 1.680086] systemd[1]: Reached target Slice Units. worker1 # [ 1.682870] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.681010] systemd[1]: Reached target Swaps. worker2 # [ 1.681807] systemd[1]: Reached target Timer Units. worker2 # [ 1.682791] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.684083] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.687404] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.685288] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.686360] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.688643] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.687460] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.690154] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.701554] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.688452] systemd[1]: Reached target Socket Units. worker1 # [ 1.691287] systemd[1]: Reached target Path Units. worker1 # [ 1.692185] systemd[1]: Reached target Slice Units. worker1 # [ 1.693114] systemd[1]: Reached target Swaps. worker2 # [ 1.690280] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.693943] systemd[1]: Reached target Timer Units. lb # [ 1.705569] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.694947] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.706728] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.696234] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.694052] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.708077] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.697457] systemd[1]: Listening on Journal Sockets. lb # [ 1.709180] systemd[1]: Reached target Path Units. worker1 # [ 1.698509] systemd[1]: Listening on udev Control Socket. lb # [ 1.710009] systemd[1]: Reached target Slice Units. worker1 # [ 1.699561] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.710888] systemd[1]: Reached target Swaps. lb # [ 1.711690] systemd[1]: Reached target Timer Units. worker1 # [ 1.700563] systemd[1]: Reached target Socket Units. lb # [ 1.712642] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.702329] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.713833] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.714974] systemd[1]: Listening on Journal Sockets. lb # [ 1.715923] systemd[1]: Listening on udev Control Socket. lb # [ 1.716918] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.717858] systemd[1]: Reached target Socket Units. worker1 # [ 1.707040] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.719605] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.723347] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.702052] systemd[1]: Starting Journal Service... worker1 # [ 1.715248] systemd[1]: Starting Journal Service... client # [ 1.722122] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.729155] systemd[1]: Starting Load Kernel Modules... lb # [ 1.731875] systemd[1]: Starting Journal Service... client # [ 1.726580] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.727771] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.733074] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.729243] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.730387] systemd[1]: Reached target Path Units. client # [ 1.731308] systemd[1]: Reached target Slice Units. client # [ 1.732272] systemd[1]: Reached target Swaps. worker1 # [ 1.740197] systemd[1]: Starting Load Kernel Modules... client # [ 1.733073] systemd[1]: Reached target Timer Units. client # [ 1.734087] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.739751] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.735363] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.736542] systemd[1]: Listening on Journal Sockets. lb # [ 1.755836] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.744203] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.737508] systemd[1]: Listening on udev Control Socket. client # [ 1.738541] systemd[1]: Listening on udev Kernel Socket. client # [ 1.739497] systemd[1]: Reached target Socket Units. client # [ 1.741391] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.760392] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.752291] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.745052] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.751689] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.754337] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.768341] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.760575] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.763403] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.765067] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.780651] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.767334] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.771553] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.783324] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.754903] systemd[1]: Starting Journal Service... lb # [ 1.786838] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.772389] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.778533] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.795668] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.784521] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.784054] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.781387] systemd[1]: Starting Load Kernel Modules... lb # [ 1.801699] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.785308] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.796185] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.796127] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.811338] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.793392] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.803987] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.804016] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.803890] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.822550] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.814285] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.806935] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.829301] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.812874] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.819642] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.825076] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.826650] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.837662] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.835183] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.852830] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.846302] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.838275] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.847617] systemd[1]: Finished Load Kernel Modules. lb # [ 1.861471] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.857169] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.855521] systemd[1]: Starting Apply Kernel Variables... client # [ 1.851043] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.872339] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.867184] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.880527] systemd[1]: Starting Apply Kernel Variables... client # [ 1.862414] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.737242] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.739301] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.877142] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.741295] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.882177] systemd[1]: Started Journal Service. worker1 # [ 1.748284] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.885685] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # worker1 # [ 1.750729] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 1.898833] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.754327] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.892225] systemd[1]: Started Journal Service. client # [ 1.884319] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.904463] systemd[1]: Started Journal Service. lb # [ 1.771173] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.772446] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.756756] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.757794] systemd[1]: Reached target Local File Systems. lb # [ 1.774595] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.758804] systemd[1]: Starting Create System Files and Directories... client # [ 1.893426] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.768150] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.769072] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.770138] systemd[1]: Reached target Local File Systems. worker2 # [ 1.766614] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.784173] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.772674] systemd[1]: Starting Create System Files and Directories... lb # [ 1.787076] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.772172] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.788951] systemd[1]: Reached target Local File Systems. lb # [ 1.790251] systemd[1]: Starting Create System Files and Directories... client # [ 1.905803] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.777778] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.799072] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.918364] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.790300] systemd[1]: Finished Create System Files and Directories. client # [ 1.926536] systemd[1]: Started Journal Service. client # [ 1.790803] systemd-modules-load[68]: Inserted module 'dm_mod' client # [ 1.795055] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.801255] systemd[1]: Finished Create System Files and Directories. client # [ 1.797266] systemd-modules-load[68]: Inserted module 'virtio_gpu' lb # [ 1.822101] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.813825] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 1.817145] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.818240] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.819211] systemd[1]: Reached target Local File Systems. worker1 # [ 1.826358] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 1.823076] systemd[1]: Starting Create System Files and Directories... lb # [ 1.843240] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 1.830759] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.837204] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.837069] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.848932] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.867685] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.864490] systemd[1]: Finished Create System Files and Directories. client # [ 1.883441] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.890665] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.891579] systemd[1]: Reached target System Initialization. worker2 # [ 1.893129] systemd[1]: Reached target Basic System. worker1 # [ 1.902778] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.903760] systemd[1]: Reached target System Initialization. worker1 # [ 1.904588] systemd[1]: Reached target Basic System. lb # [ 1.925156] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.926113] systemd[1]: Reached target System Initialization. lb # [ 1.926842] systemd[1]: Reached target Basic System. client # [ 1.910449] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.966088] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.966981] systemd[1]: Reached target System Initialization. client # [ 1.968838] systemd[1]: Reached target Basic System. worker2 # [ 2.181618] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.206689] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.209049] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.224235] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.224988] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.231020] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.234337] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.254088] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.246145] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.246938] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.248729] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.250022] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.248815] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.263121] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.249552] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.253630] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.251325] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.254324] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.257126] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.268904] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.258072] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.259618] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.258007] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.261138] usb usb1: Product: EHCI Host Controller worker1 # [ 2.261853] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.259438] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.260607] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.274726] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.275462] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.266105] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.264032] usb usb1: Product: EHCI Host Controller worker1 # [ 2.266943] hub 1-0:1.0: USB hub found worker2 # [ 2.264721] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.278854] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.268077] hub 1-0:1.0: 6 ports detected lb # [ 2.279683] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.266743] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.281523] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.269183] hub 1-0:1.0: USB hub found worker2 # [ 2.269735] hub 1-0:1.0: 6 ports detected worker1 # [ 2.273289] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.273998] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.289290] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.290765] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.278722] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.293571] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.295816] usb usb1: Product: EHCI Host Controller lb # [ 2.297204] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.298283] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.300040] hub 1-0:1.0: USB hub found worker1 # [ 2.289029] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.301571] hub 1-0:1.0: 6 ports detected worker1 # [ 2.290288] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.288675] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.307413] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.308145] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.296283] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.291497] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.300728] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.295262] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.315617] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.316478] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.304283] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.301453] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.309859] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.312456] usb usb2: Product: UHCI Host Controller worker2 # [ 2.313675] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.308915] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.328325] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.314983] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.321305] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.313853] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.322030] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.183305] systemd[1]: Starting Virtual Console Setup... client # [ 2.316822] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.336405] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.185849] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.333744] hub 2-0:1.0: USB hub found worker2 # [ 2.332603] usb usb2: Product: UHCI Host Controller client # [ 2.326883] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 lb # [ 2.346579] usb usb2: Product: UHCI Host Controller client # [ 2.329744] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.202249] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.203573] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.199098] (udev-worker)[89]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.340403] hub 2-0:1.0: 2 ports detected worker2 # [ 2.338993] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.334047] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.339693] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.353720] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.203614] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.343890] SCSI subsystem initialized client # [ 2.338077] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.341608] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.344010] usb usb1: Product: UHCI Host Controller lb # [ 2.364279] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.345225] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.346015] usb usb1: SerialNumber: 0000:00:1d.0 client # [ 2.349731] hub 1-0:1.0: USB hub found lb # [ 2.234428] systemd[1]: Starting Virtual Console Setup... client # [ 2.351455] SCSI subsystem initialized client # [ 2.352393] hub 1-0:1.0: 2 ports detected worker2 # [ 2.358888] SCSI subsystem initialized worker2 # [ 2.222821] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.355484] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.356343] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 worker2 # [ 2.362044] hub 2-0:1.0: USB hub found lb # [ 2.376462] hub 2-0:1.0: USB hub found client # [ 2.357989] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.364781] hub 2-0:1.0: 2 ports detected lb # [ 2.379054] hub 2-0:1.0: 2 ports detected worker2 # [ 2.231796] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.235278] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.364413] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.250287] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.367008] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.368138] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.377002] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.375102] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.371293] usb usb2: Product: EHCI Host Controller client # [ 2.372049] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.391444] SCSI subsystem initialized worker1 # [ 2.242976] (udev-worker)[85]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.245117] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.374052] usb usb2: SerialNumber: 0000:00:1d.7 client # [ 2.375370] hub 2-0:1.0: USB hub found worker1 # [ 2.383397] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.384113] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.376915] hub 2-0:1.0: 6 ports detected lb # [ 2.261892] (udev-worker)[87]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.263923] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.401161] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.253545] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.257661] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.256765] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.258059] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.258616] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.397355] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.400217] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.401037] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.398155] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.278806] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.280383] systemd[1]: Finished Virtual Console Setup. client # [ 2.399520] hub 1-0:1.0: USB hub found worker1 # [ 2.408173] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.409285] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.401992] hub 1-0:1.0: 2 ports detected worker2 # [ 2.408038] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.408834] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.276736] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.424317] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.425027] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.278207] systemd[1]: Reached target Initrd Root Device. client # [ 2.406515] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.407248] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.415091] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.282068] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.416772] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.419019] usb usb3: Product: UHCI Host Controller worker2 # [ 2.419705] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.422787] usb usb3: Product: UHCI Host Controller worker1 # [ 2.423707] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.435358] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.424534] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.422016] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.436127] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.424421] hub 3-0:1.0: USB hub found worker2 # [ 2.426103] hub 3-0:1.0: 2 ports detected lb # [ 2.441592] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.431517] hub 3-0:1.0: USB hub found lb # [ 2.442766] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.433598] hub 3-0:1.0: 2 ports detected client # [ 2.294589] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.297333] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.314755] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.297410] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.437056] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.317206] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.440173] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.437814] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.440981] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.433663] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.453116] usb usb3: Product: UHCI Host Controller lb # [ 2.319774] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.443167] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.455189] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.444001] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.304762] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.455934] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.445114] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.447336] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.445920] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.308216] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.450154] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.452145] usb usb4: Product: UHCI Host Controller client # [ 2.444333] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.449185] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.452907] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.464468] hub 3-0:1.0: USB hub found client # [ 2.313305] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.452016] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.466428] hub 3-0:1.0: 2 ports detected client # [ 2.315261] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.454021] usb usb4: Product: UHCI Host Controller worker1 # [ 2.456753] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.454761] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.460824] hub 4-0:1.0: USB hub found worker1 # [ 2.326373] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.454398] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.476052] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.457007] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.462982] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.476812] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.331423] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.465448] hub 4-0:1.0: USB hub found worker2 # [ 2.466382] hub 4-0:1.0: 2 ports detected lb # [ 2.480336] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.470156] hub 4-0:1.0: 2 ports detected lb # [ 2.481230] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.484533] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.466167] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.487313] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.489458] usb usb4: Product: UHCI Host Controller lb # [ 2.492375] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.493186] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.475204] usb usb3: Product: UHCI Host Controller client # [ 2.475894] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.497859] hub 4-0:1.0: USB hub found lb # [ 2.364575] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.484667] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.369509] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.506745] hub 4-0:1.0: 2 ports detected client # [ 2.489333] hub 3-0:1.0: USB hub found client # [ 2.359877] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.498442] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.499605] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.361723] systemd[1]: Reached target Initrd Root Device. client # [ 2.495722] hub 3-0:1.0: 2 ports detected worker2 # [ 2.500995] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.503625] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.504900] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.365422] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.507125] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.505041] scsi host0: ahci worker2 # [ 2.506631] scsi host1: ahci worker1 # [ 2.509115] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.508002] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.509419] scsi host2: ahci client # [ 2.504262] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.505002] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.511117] scsi host3: ahci worker2 # [ 2.512655] scsi host4: ahci worker1 # [ 2.515310] scsi host0: ahci worker2 # [ 2.514288] scsi host5: ahci worker1 # [ 2.517115] scsi host1: ahci worker2 # [ 2.514870] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.518760] scsi host2: ahci worker1 # [ 2.520392] scsi host3: ahci worker2 # [ 2.517138] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.513242] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.518358] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.521983] scsi host4: ahci client # [ 2.514067] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.519533] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.523624] scsi host5: ahci worker2 # [ 2.520688] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.516568] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.521899] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.524679] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.537312] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.526412] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.527569] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.528779] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.529989] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.522430] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.523632] usb usb4: Product: UHCI Host Controller worker1 # [ 2.531257] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.542921] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.525235] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.526003] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.547299] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.529082] hub 4-0:1.0: USB hub found lb # [ 2.548141] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.530416] hub 4-0:1.0: 2 ports detected lb # [ 2.554902] scsi host0: ahci lb # [ 2.556699] scsi host1: ahci client # [ 2.404726] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.558311] scsi host2: ahci lb # [ 2.559910] scsi host3: ahci lb # [ 2.561579] scsi host4: ahci lb # [ 2.563220] scsi host5: ahci lb # [ 2.564683] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.565939] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.567058] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.568354] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.569509] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.570675] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.421506] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.577435] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.582011] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.583454] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.590461] scsi host0: ahci client # [ 2.592116] scsi host1: ahci client # [ 2.593787] scsi host2: ahci client # [ 2.595511] scsi host3: ahci client # [ 2.597124] scsi host4: ahci client # [ 2.598776] scsi host5: ahci client # [ 2.599776] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.600914] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.602693] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.603893] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.605059] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.606247] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.612221] usb 2-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.637180] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.639978] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.643183] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.639506] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.644935] usb 1-1: Manufacturer: QEMU worker2 # [ 2.642397] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.646557] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.645612] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.647421] usb 1-1: Manufacturer: QEMU worker2 # [ 2.649402] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.667581] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.670454] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.673659] usb 1-1: Product: QEMU USB Tablet lb # [ 2.675439] usb 1-1: Manufacturer: QEMU lb # [ 2.677039] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.676537] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.682107] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.710440] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.612051] systemd[1]: Mounting /sysroot... client # [ 2.741717] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.744663] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.747843] usb 2-1: Product: QEMU USB Tablet client # [ 2.749659] usb 2-1: Manufacturer: QEMU client # [ 2.751303] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.628512] systemd[1]: Mounting /sysroot... lb # [ 2.644672] systemd[1]: Mounting /sysroot... client # [ 2.784571] hid: raw HID events driver (C) Jiri Kosina client # [ 2.671981] systemd[1]: Mounting /sysroot... worker2 # [ 2.836695] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.841362] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.838938] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.843646] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.841689] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.846378] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.844263] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.848443] ata3.00: applying bridge limits worker2 # [ 2.846359] ata3.00: applying bridge limits worker1 # [ 2.850367] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.848354] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.852662] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.850584] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.855004] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.853031] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.857367] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.855332] ata3.00: configured for UDMA/100 worker1 # [ 2.859387] ata3.00: configured for UDMA/100 worker2 # [ 2.857703] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.861831] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.882226] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.884637] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.887480] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.889540] ata3.00: applying bridge limits lb # [ 2.891555] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.893685] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.895784] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.898331] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.900653] ata3.00: configured for UDMA/100 lb # [ 2.903065] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.915643] usbcore: registered new interface driver usbhid worker1 # [ 2.922512] usbhid: USB HID core driver client # [ 2.916327] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.924217] usbcore: registered new interface driver usbhid client # [ 2.918536] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.925031] usbhid: USB HID core driver client # [ 2.921092] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.923463] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.925662] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.928269] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.930231] ata3.00: applying bridge limits client # [ 2.932245] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.939117] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.934595] ata3.00: configured for UDMA/100 client # [ 2.936962] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.951569] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.953383] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.951180] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.954979] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.958390] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.956483] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.979815] usbcore: registered new interface driver usbhid worker1 # [ 2.969263] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.982675] usbhid: USB HID core driver worker1 # [ 2.970864] EXT4-fs (vda): mounted filesystem ce910eb5-ac87-49db-9b0e-64075be98147 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.969770] EXT4-fs (vda): mounted filesystem d9fcfd20-3f20-4f1d-b028-6a9b6653a44a r/w with ordered data mode. Quota mode: none. worker1 # [ 2.840632] systemd[1]: Mounted /sysroot. worker2 # [ 2.838838] systemd[1]: Mounted /sysroot. worker1 # [ 2.843073] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.841148] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.846076] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.845076] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.998415] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.860495] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.860471] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.011485] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.865066] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.866529] systemd[1]: Reloading... lb # [ 3.013223] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.863221] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.015464] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.866110] systemd[1]: Reloading... client # [ 3.007008] usbcore: registered new interface driver usbhid client # [ 3.012552] usbhid: USB HID core driver lb # [ 3.030846] EXT4-fs (vda): mounted filesystem 3538cfd2-bd36-4280-86ae-357e2a48f392 r/w with ordered data mode. Quota mode: none. lb # [ 2.904712] systemd[1]: Mounted /sysroot. lb # [ 2.905763] systemd[1]: Reached target Initrd Root File System. lb # [ 2.909218] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.025490] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 client # [ 3.033421] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.926173] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.929066] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.930516] systemd[1]: Reloading... client # [ 3.066379] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 3.072865] EXT4-fs (vda): mounted filesystem d1837d7b-7cad-41be-9369-6315479279f8 r/w with ordered data mode. Quota mode: none. client # [ 2.943458] systemd[1]: Mounted /sysroot. worker1 # [ 2.948447] systemd[1]: Reloading finished in 83 ms. worker2 # [ 2.945076] systemd[1]: Reloading finished in 79 ms. client # [ 3.077204] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.946104] systemd[1]: Reached target Initrd Root File System. client # [ 2.947130] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.956385] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker2 # [ 2.953075] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.960222] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker2 # [ 2.957163] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker1 # [ 2.964181] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.965234] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 2.961714] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.966337] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 2.963113] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 2.961886] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.964163] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 2.965063] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.966639] systemd[1]: Reloading... lb # [ 3.013739] systemd[1]: Reloading finished in 81 ms. lb # [ 3.022280] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... lb # [ 3.027173] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... lb # [ 3.029900] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.032078] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.032974] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.049466] systemd[1]: Reloading finished in 84 ms. client # [ 3.058302] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... client # [ 3.062224] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... client # [ 3.065240] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.066613] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.068123] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.615188] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.621174] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.630177] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.628175] systemd[1]: Mounting /sysroot/run... lb # [ 3.646355] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.637154] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.653172] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.637159] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.646168] systemd[1]: Mounting /sysroot/run... lb # [ 3.661174] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.650315] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.656154] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.671315] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.669318] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.685825] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.672560] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.675145] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.680780] systemd[1]: Mounting /sysroot/run... client # [ 3.684140] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.688849] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.690948] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.691142] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.693684] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.695147] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.701705] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.698488] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.704671] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.701683] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.708575] systemd[1]: Mounted /sysroot/run. lb # [ 3.721601] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.725494] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.713127] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.727296] systemd[1]: Mounted /sysroot/run. lb # [ 3.728141] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.710137] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.715346] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.712090] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.713526] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.712977] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.718562] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.715544] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.732365] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.735682] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.718241] systemd[1]: Mounted /sysroot/run. client # [ 3.719167] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.728134] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.724404] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.729599] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.725931] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.746511] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.748100] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.751227] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.734801] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.735987] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.737815] systemd[1]: Starting Find NixOS closure... client # [ 3.736199] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.737655] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.740324] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.739680] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.772076] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.773185] systemd[1]: Reached target Initrd File Systems. lb # [ 3.774814] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.758898] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.759609] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.777531] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.760671] systemd[1]: Reached target Initrd File Systems. client # [ 3.762335] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.765640] systemd[1]: Finished Find NixOS closure. client # [ 3.765146] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.766900] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.768992] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.796487] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.780778] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.782148] systemd[1]: Stopped target Basic System. client # [ 3.781042] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.783040] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.783945] systemd[1]: Stopped target Path Units. worker2 # [ 3.784804] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.786059] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.803873] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.787510] systemd[1]: Stopped target Slice Units. lb # [ 3.805241] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.789154] systemd[1]: Stopped target Socket Units. worker2 # [ 3.789846] systemd[1]: Stopped target System Initialization. client # [ 3.788794] systemd[1]: Finished Find NixOS closure. lb # [ 3.806773] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.790673] systemd[1]: Stopped target Swaps. worker2 # [ 3.791468] systemd[1]: Stopped target Timer Units. client # [ 3.790170] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.792201] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.793019] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.791582] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.793951] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.795472] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.796559] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.798174] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.799373] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.800384] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.801565] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.802582] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.820442] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.804112] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.821745] systemd[1]: Stopped target Basic System. worker2 # [ 3.805397] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.804333] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.822674] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.806533] systemd[1]: Stopped Create System Files and Directories. client # [ 3.805346] systemd[1]: Stopped target Basic System. lb # [ 3.823643] systemd[1]: Stopped target Path Units. client # [ 3.806281] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.808116] systemd[1]: Stopped target Local File Systems. lb # [ 3.825109] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.808831] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.808117] systemd[1]: Stopped target Path Units. lb # [ 3.826112] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.810117] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.827113] systemd[1]: Stopped target Slice Units. client # [ 3.808825] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.827767] systemd[1]: Stopped target Socket Units. client # [ 3.809824] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.811768] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.828466] systemd[1]: Stopped target System Initialization. client # [ 3.810999] systemd[1]: Stopped target Slice Units. worker2 # [ 3.812544] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.829594] systemd[1]: Stopped target Swaps. client # [ 3.811723] systemd[1]: Stopped target Socket Units. client # [ 3.812450] systemd[1]: Stopped target System Initialization. lb # [ 3.830616] systemd[1]: Stopped target Timer Units. worker2 # [ 3.814136] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.813283] systemd[1]: Stopped target Swaps. lb # [ 3.831516] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.815128] systemd[1]: Stopped Virtual Console Setup. client # [ 3.814157] systemd[1]: Stopped target Timer Units. lb # [ 3.832494] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.815113] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.833565] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.816103] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.835129] systemd[1]: Stopped Find NixOS closure. client # [ 3.817165] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.818590] systemd[1]: Stopped Find NixOS closure. lb # [ 3.836545] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.819580] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.838182] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.839313] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.821182] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.822277] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.840298] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.823271] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.842129] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.825407] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.824602] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.842828] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.825449] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.843834] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.844983] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.827112] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.829096] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.845937] systemd[1]: Stopped Create System Files and Directories. client # [ 3.828365] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.830130] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.829468] systemd[1]: Stopped Create System Files and Directories. lb # [ 3.848095] systemd[1]: Stopped target Local File Systems. client # [ 3.830597] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.832036] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.848848] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.831520] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.849728] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.850675] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.833129] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.834215] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.852224] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.837131] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.838154] systemd[1]: Closed udev Control Socket. lb # [ 3.854582] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.837064] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.855556] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.839689] systemd[1]: Starting Cleanup udev Database... client # [ 3.838173] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.841156] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.840226] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.842185] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.843085] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.844156] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.846116] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.863163] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.847069] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.846360] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.847930] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.849279] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.867147] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.850482] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.853506] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.855215] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.874720] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.876943] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.859621] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.878042] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.879136] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.861136] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.863411] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.880542] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.862579] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.864818] systemd[1]: Finished Cleanup udev Database. client # [ 3.863843] systemd[1]: Closed udev Control Socket. lb # [ 3.882093] systemd[1]: Closed udev Control Socket. worker2 # [ 3.866407] systemd[1]: Reached target Switch Root. lb # [ 3.883888] systemd[1]: Starting Cleanup udev Database... client # [ 3.865953] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.868077] systemd[1]: Starting NixOS Activation... lb # [ 3.884660] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.866787] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.885653] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.867810] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.886554] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.868687] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.888136] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.870146] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.889107] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.871165] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.889980] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.873117] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.888105] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.889162] systemd[1]: Finished Cleanup udev Database. client # [ 3.889888] systemd[1]: Reached target Switch Root. lb # [ 3.908351] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.891152] systemd[1]: Starting NixOS Activation... lb # [ 3.909469] systemd[1]: Finished Cleanup udev Database. lb # [ 3.910194] systemd[1]: Reached target Switch Root. lb # [ 3.911850] systemd[1]: Starting NixOS Activation... worker2 # [ 3.923898] initrd-nixos-activation-start[190]: booting system configuration /nix/store/m68sx34dr7yy1drfgmzf0cyxm52cz9hp-nixos-system-worker2-test worker2 # [ 3.947156] initrd-nixos-activation-start[190]: running activation script... lb # [ 3.979239] initrd-nixos-activation-start[190]: booting system configuration /nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test client # [ 3.961444] initrd-nixos-activation-start[191]: booting system configuration /nix/store/6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test client # [ 3.985456] initrd-nixos-activation-start[191]: running activation script... lb # [ 4.005221] initrd-nixos-activation-start[190]: running activation script... worker2 # [ 4.138682] initrd-nixos-activation-start[213]: setting up /etc... lb # [ 4.200840] initrd-nixos-activation-start[213]: setting up /etc... client # [ 4.185975] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 4.239588] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.242053] systemd[1]: Finished NixOS Activation. worker2 # [ 4.242988] systemd[1]: Starting Switch Root... worker2 # [ 4.256227] systemd[1]: Switching root. lb # [ 4.300162] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.301713] systemd[1]: Finished NixOS Activation. lb # [ 4.303619] systemd[1]: Starting Switch Root... client # [ 4.287798] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.289175] systemd[1]: Finished NixOS Activation. client # [ 4.290994] systemd[1]: Starting Switch Root... lb # [ 4.315836] systemd[1]: Switching root. client # [ 4.303796] systemd[1]: Switching root. worker2 # [ 4.523115] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.576373] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.571504] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.626774] NET: Registered PF_VSOCK protocol family lb # [ 4.660942] NET: Registered PF_VSOCK protocol family client # [ 4.657556] NET: Registered PF_VSOCK protocol family worker1 # [ 4.627804] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.650767] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.651976] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.653818] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.656371] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.674502] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.677953] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.683824] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.685186] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.686711] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.700252] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.701397] systemd[1]: Stopped target Basic System. worker1 # [ 4.703124] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.703879] systemd[1]: Stopped target Path Units. worker1 # [ 4.704749] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.705729] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.706774] systemd[1]: Stopped target Slice Units. worker1 # [ 4.707462] systemd[1]: Stopped target Socket Units. worker1 # [ 4.708200] systemd[1]: Stopped target System Initialization. worker1 # [ 4.709314] systemd[1]: Stopped target Swaps. worker1 # [ 4.710107] systemd[1]: Stopped target Timer Units. worker1 # [ 4.711106] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.712121] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.713137] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.714603] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.715627] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.716556] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.718237] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.719240] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.720439] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.721912] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.723168] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.724235] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.725695] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.727112] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.727886] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.730132] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.731127] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.734155] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.735248] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.736259] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.743777] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.746947] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.747956] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.750885] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.754786] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.756210] systemd[1]: Closed udev Control Socket. worker1 # [ 4.757769] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.759150] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.760187] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.761082] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.763108] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.764074] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.764969] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.765947] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.767329] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.782124] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.783441] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.785117] systemd[1]: Reached target Switch Root. worker1 # [ 4.786043] systemd[1]: Starting NixOS Activation... worker1 # [ 4.854085] initrd-nixos-activation-start[190]: booting system configuration /nix/store/f94wjck2a7wq46iir6a6zbavnfk7qfqj-nixos-system-worker1-test worker2 # [ 4.985232] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 4.994893] systemd[1]: Detected virtualization kvm. worker2 # [ 4.996701] systemd[1]: Detected architecture x86-64. worker2 # [ 4.998668] systemd[1]: Detected first boot. worker2 # [ 5.002537] systemd[1]: Initializing machine ID from random generator. worker1 # [ 4.879673] initrd-nixos-activation-start[190]: running activation script... lb # [ 5.020369] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.030557] systemd[1]: Detected virtualization kvm. lb # [ 5.032363] systemd[1]: Detected architecture x86-64. lb # [ 5.034451] systemd[1]: Detected first boot. lb # [ 5.038490] systemd[1]: Initializing machine ID from random generator. client # [ 5.015386] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.025022] systemd[1]: Detected virtualization kvm. client # [ 5.026891] systemd[1]: Detected architecture x86-64. client # [ 5.028842] systemd[1]: Detected first boot. client # [ 5.032861] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.071343] initrd-nixos-activation-start[213]: setting up /etc... worker2 # [ 5.236672] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.274493] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.269286] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.172486] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.174924] systemd[1]: Finished NixOS Activation. worker1 # [ 5.175984] systemd[1]: Starting Switch Root... worker1 # [ 5.187724] systemd[1]: Switching root. worker2 # [ 5.356590] systemd[1]: Applying preset policy. lb # [ 5.378496] systemd[1]: Applying preset policy. client # [ 5.378974] systemd[1]: Applying preset policy. worker1 # [ 5.450273] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.519618] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.537578] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.546734] NET: Registered PF_VSOCK protocol family client # [ 5.548028] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.699032] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.700373] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.702384] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.704443] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.705768] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.706684] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.707894] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.709009] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.709684] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.710432] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.724686] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.711283] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.712036] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.726019] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.712817] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.713658] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.714540] systemd[1]: Reached target Path Units. lb # [ 5.728553] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.715249] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.716035] systemd[1]: Reached target Slice Units. worker2 # [ 5.716702] systemd[1]: Reached target Swaps. lb # [ 5.730531] systemd[1]: Created slice Slice /system/getty. lb # [ 5.731866] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.718329] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.732788] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 5.733994] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.720547] systemd[1]: Listening on Process Core Dump Socket. lb # [ 5.735072] systemd[1]: Expecting device /dev/hvc0... lb # [ 5.735823] systemd[1]: Expecting device /dev/ttyS0... lb # [ 5.736584] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.737444] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.738194] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.738970] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.739792] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.740708] systemd[1]: Reached target Path Units. lb # [ 5.741444] systemd[1]: Reached target Remote File Systems. lb # [ 5.742222] systemd[1]: Reached target Slice Units. lb # [ 5.742918] systemd[1]: Reached target Swaps. lb # [ 5.744624] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 5.727523] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.746901] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.722144] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.728881] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.735466] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.736393] systemd[1]: Listening on Hostname Service Socket. client # [ 5.731481] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 5.733521] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.739443] systemd[1]: Starting Journal Log Access Socket... client # [ 5.734836] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.740686] systemd[1]: Listening on Journal Audit Socket. client # [ 5.735780] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.736986] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 5.738084] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.743254] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.738847] systemd[1]: Expecting device /dev/ttyS0... client # [ 5.739671] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.744740] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 5.740472] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.748540] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.745858] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.741244] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.742028] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.747136] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 5.761877] systemd[1]: Listening on Factory Reset Management. client # [ 5.742901] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.743828] systemd[1]: Reached target Path Units. lb # [ 5.762865] systemd[1]: Listening on Hostname Service Socket. client # [ 5.744513] systemd[1]: Reached target Remote File Systems. client # [ 5.745275] systemd[1]: Reached target Slice Units. worker2 # [ 5.751015] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.745985] systemd[1]: Reached target Swaps. lb # [ 5.765600] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.752033] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.752880] systemd[1]: Listening on udev Varlink Socket. lb # [ 5.766740] systemd[1]: Listening on Journal Audit Socket. client # [ 5.747778] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.755008] systemd[1]: Mounting Huge Pages File System... lb # [ 5.769155] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 5.770521] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.771659] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.759366] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 5.772955] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 5.776552] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.777580] systemd[1]: Listening on udev Control Socket. lb # [ 5.778476] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.766445] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.780489] systemd[1]: Mounting Huge Pages File System... client # [ 5.750148] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.763490] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 5.783417] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.765400] systemd[1]: Listening on Factory Reset Management. client # [ 5.766300] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.771821] systemd[1]: Mounting Kernel Trace File System... client # [ 5.768908] systemd[1]: Starting Journal Log Access Socket... client # [ 5.770276] systemd[1]: Listening on Journal Audit Socket. lb # [ 5.790409] systemd[1]: Mounting Kernel Debug File System... client # [ 5.772687] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.774227] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.780284] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.775318] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.776632] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 5.798838] systemd[1]: Mounting Kernel Trace File System... client # [ 5.780420] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.781425] systemd[1]: Listening on udev Control Socket. client # [ 5.782319] systemd[1]: Listening on udev Varlink Socket. client # [ 5.784384] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.790093] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.790923] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 5.786647] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 5.807823] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.791674] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.801076] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.799498] systemd[1]: Mounting Kernel Trace File System... lb # [ 5.822764] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.809846] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.808057] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.827491] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.822252] systemd[1]: Mounting FUSE Control File System... client # [ 5.818431] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.823835] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 5.838993] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.823880] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 5.846889] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.836571] systemd[1]: Starting Journal Service... worker2 # [ 5.841337] systemd[1]: Starting Load Kernel Modules... lb # [ 5.855508] systemd[1]: Mounting FUSE Control File System... client # [ 5.835982] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.846322] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.861542] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 5.846483] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.854273] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.856234] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.876604] systemd[1]: Starting Journal Service... worker2 # [ 5.863176] systemd[1]: Starting Coldplug All udev Devices... client # [ 5.860713] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.867575] systemd[1]: Listening on Journal Log Access Socket. client # [ 5.861916] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.870755] systemd[1]: Mounted Huge Pages File System. lb # [ 5.885326] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.873158] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.874847] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.876709] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.878939] systemd[1]: Mounted FUSE Control File System. lb # [ 5.892954] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.882143] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.877977] systemd[1]: Starting Journal Service... lb # [ 5.901574] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.888042] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.885046] systemd[1]: Starting Load Kernel Modules... lb # [ 5.908373] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.893451] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 5.901124] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.921067] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.903952] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.904945] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.913685] systemd[1]: Detected virtualization kvm. worker1 # [ 5.915492] systemd[1]: Detected architecture x86-64. lb # [ 5.927425] systemd-journald[283]: Collecting audit messages is enabled. worker2 # [ 5.913647] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.915036] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 5.917359] systemd[1]: Detected first boot. client # [ 5.913595] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.920944] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.920376] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.935120] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.940416] systemd[1]: Mounted Huge Pages File System. lb # [ 5.944802] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.928160] systemd[1]: Listening on Journal Log Access Socket. lb # [ 5.948970] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.820819] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.936152] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 5.956192] systemd[1]: Started Journal Service. client # [ 5.938370] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.945376] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.825422] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 5.942512] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.945037] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.834844] systemd[1]: Mounted Kernel Trace File System. client # [ 5.949997] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.835776] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.837750] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.974427] loop: module loaded lb # [ 5.842515] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.963399] systemd-journald[283]: Collecting audit messages is enabled. lb # [ 5.843548] systemd-modules-load[284]: Inserted module 'loop' lb # [ 5.844803] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.965456] EXT4-fs (vda): re-mounted d9fcfd20-3f20-4f1d-b028-6a9b6653a44a. client # [ 5.960402] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.964085] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 5.833726] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.975855] loop: module loaded client # [ 5.837425] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.977119] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.858111] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.978319] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 5.974222] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.975429] loop: module loaded worker2 # [ 5.980292] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.865070] systemd[1]: Mounting Kernel Configuration File System... client # [ 5.847392] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 5.986915] systemd[1]: Starting Load/Save OS Random Seed... client # [ 5.982563] systemd[1]: Started Journal Service. worker2 # [ 5.987706] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.003286] EXT4-fs (vda): re-mounted 3538cfd2-bd36-4280-86ae-357e2a48f392. worker2 # [ 5.991051] systemd[1]: Finished Load Kernel Modules. client # [ 5.852934] systemd[1]: Mounted FUSE Control File System. lb # [ 5.872028] systemd[1]: Starting Firewall... client # [ 5.856236] systemd[1]: Finished Load Kernel Modules. lb # [ 5.877165] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.997433] systemd[1]: Starting Firewall... client # [ 6.000218] EXT4-fs (vda): re-mounted d1837d7b-7cad-41be-9369-6315479279f8. worker2 # [ 6.006312] systemd[1]: Starting Apply Kernel Variables... lb # [ 5.892251] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.876376] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 6.019408] systemd[1]: Started Journal Service. client # [ 5.881548] systemd[1]: Starting Apply Kernel Variables... lb # [ 5.902153] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.889156] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.890416] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 5.889720] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.909128] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 5.893070] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.899059] systemd-modules-load[284]: Inserted module 'loop' worker2 # [ 5.900418] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.900890] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.921757] systemd-oomd[286]: No swap; memory pressure usage will be degraded client # [ 5.904133] systemd-oomd[287]: No swap; memory pressure usage will be degraded lb # [ 5.925987] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.926889] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.914078] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.914994] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.921219] systemd[1]: Starting Load/Save OS Random Seed... client # [ 5.922362] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.924503] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 5.942729] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.927091] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 5.943626] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.947067] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.932470] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 5.961748] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 5.964233] systemd[1]: Reached target First Boot Complete. worker2 # [ 6.115808] systemd-journald[283]: Received client request to flush runtime journal. lb # [ 6.134747] systemd-journald[283]: Received client request to flush runtime journal. client # [ 6.115762] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 6.155497] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.066140] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.067712] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.069399] systemd[1]: Reached target First Boot Complete. lb # [ 6.088297] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.071196] systemd[1]: Finished Apply Kernel Variables. lb # [ 6.089858] systemd[1]: Finished Apply Kernel Variables. client # [ 6.073216] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.091548] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.092326] systemd[1]: Reached target First Boot Complete. lb # [ 6.095443] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.104183] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.107498] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.091238] systemd-oomd[285]: No swap; memory pressure usage will be degraded worker2 # [ 6.095599] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.096551] systemd[1]: Finished Apply Kernel Variables. client # [ 6.095233] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.098514] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.097119] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.099438] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.101584] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.104410] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.259376] systemd[1]: Applying preset policy. client # [ 6.145977] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.159192] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.161183] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.162793] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.186488] systemd-udevd[318]: Using default interface naming scheme 'v261'. lb # [ 6.203330] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.193320] systemd-udevd[315]: Using default interface naming scheme 'v261'. lb # [ 6.214978] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 6.217183] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.219473] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.225178] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.262089] systemd-udevd[323]: Using default interface naming scheme 'v261'. worker2 # [ 6.257400] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.430344] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.311069] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 6.308047] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.321237] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.353088] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.373195] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.389328] (udev-worker)[318]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.395914] (udev-worker)[322]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.398149] (udev-worker)[322]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.428139] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.414724] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.612307] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.613645] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.615614] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.476052] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.617697] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.619003] systemd[1]: Created slice User and Session Slice. client # [ 6.477923] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.619989] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.621227] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.479313] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.622308] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.623009] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.481716] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.623792] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.624652] systemd[1]: Stopped target initrd-fs.target. client # [ 6.483309] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.625385] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.626184] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.484882] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.627045] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.628012] systemd[1]: Reached target Path Units. worker1 # [ 6.628757] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.629566] systemd[1]: Reached target Slice Units. worker1 # [ 6.630268] systemd[1]: Reached target Swaps. worker1 # [ 6.632164] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 6.510306] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.634569] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.497537] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.636339] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.649910] systemd[1]: Listening on Factory Reset Management. worker1 # [ 6.650895] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 6.653652] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.654978] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.516333] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.657307] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.658754] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.659885] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.661226] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.665106] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.542720] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.666140] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.666998] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.669181] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.673457] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.670863] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 6.680256] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.685593] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.562962] (udev-worker)[345]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.682071] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 6.693667] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 6.553884] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.571225] (udev-worker)[349]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.573344] (udev-worker)[349]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.703977] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.565952] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.710332] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.575357] (udev-worker)[354]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.594465] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.577919] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.717989] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.725582] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.737428] systemd[1]: Mounting FUSE Control File System... client # [ 6.598451] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.739885] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.751294] systemd[1]: Starting Journal Service... worker1 # [ 6.756499] systemd[1]: Starting Load Kernel Modules... lb # [ 6.634973] systemd[1]: Mounted /run/wrappers. lb # [ 6.636302] systemd[1]: Reached target Local File Systems. lb # [ 6.639115] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 6.624060] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.624995] systemd[1]: Reached target Local File Systems. worker1 # [ 6.765017] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 6.627468] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.644256] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.769763] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.630760] systemd[1]: Starting register-nix-paths.service... lb # [ 6.648460] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.771768] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.633550] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.651699] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.637436] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.638729] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.779396] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.659249] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.643171] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.783791] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.786301] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.788231] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.790883] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.793285] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.673112] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.796293] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.798483] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.804974] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.677043] systemd[1]: Mounted /run/wrappers. client # [ 6.678576] systemd[1]: Reached target Local File Systems. client # [ 6.684345] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.688066] systemd[1]: Starting register-nix-paths.service... client # [ 6.688964] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.830107] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 6.832141] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.694145] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.695440] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.836603] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.696882] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.857911] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.868463] EXT4-fs (vda): re-mounted ce910eb5-ac87-49db-9b0e-64075be98147. worker2 # [ 6.729804] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.733727] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.752227] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.693989] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 6.877941] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.879236] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.881929] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.762423] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 6.888155] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.888950] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.748847] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.892397] systemd-journald[283]: Collecting audit messages is enabled. client # [ 6.753122] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 6.897583] loop: module loaded worker1 # [ 6.906784] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.912358] systemd[1]: Starting Firewall... client # [ 6.694629] ACPI: button: Power Button [PWRF] client # [ 6.710248] mousedev: PS/2 mouse device common for all mice client # [ 6.743756] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 6.915170] systemd[1]: Starting Apply Kernel Variables... client # [ 6.762057] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 6.784544] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.789680] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.792150] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.791462] systemd[1]: Finished Create System Files and Directories. lb # [ 6.814177] systemd[1]: Finished Create System Files and Directories. client # [ 6.797291] systemd[1]: Starting Rebuild Journal Catalog... client # [ 6.802354] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.824110] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.949183] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.954594] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.832722] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 6.959377] systemd[1]: Started Journal Service. worker1 # [ 6.828531] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.829704] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.762144] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 6.833333] systemd-modules-load[284]: Inserted module 'loop' client # [ 6.767402] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 6.842721] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.856173] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 6.857368] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.860133] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.861870] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.869479] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.857615] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.871643] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.872873] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.860550] systemd[1]: Reached target First Boot Complete. client # [ 6.864633] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 6.869123] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.767470] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:31:29 UTC (1790353889) worker1 # [ 6.888984] systemd-oomd[285]: No swap; memory pressure usage will be degraded client # [ 6.890878] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.896725] systemd[1]: Starting Update is Completed... worker1 # [ 6.902923] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.767553] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 6.768415] systemd-journald[284]: Time jumped backwards, rotating. worker1 # [ 6.911924] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.053858] systemd-journald[283]: Received client request to flush runtime journal. lb # [ 6.939192] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 6.926139] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.928489] systemd[1]: Starting Update is Completed... client # [ 6.800901] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 6.869767] Console: switching to colour dummy device 80x25 client # [ 6.938579] systemd[1]: Finished Update is Completed. client # [ 7.088987] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.088989] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.092735] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.093406] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 6.978287] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.984784] systemd[1]: Starting Update is Completed... client # [ 7.119139] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.119882] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.131060] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.135025] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.006552] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.009537] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.012412] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.016122] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.018202] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.020815] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.023156] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.027558] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.029852] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.031985] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.030768] systemd[1]: Finished Update is Completed. worker1 # [ 7.035185] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.202129] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 lb # [ 7.075751] systemd[1]: Finished Update is Completed. lb # [ 7.223969] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 client # [ 7.086278] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.097791] systemd-udevd[315]: Using default interface naming scheme 'v261'. lb # [ 7.247633] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 7.276011] ACPI: button: Power Button [PWRF] client # [ 7.271244] Console: switching to colour frame buffer device 160x50 worker2 # [ 7.289415] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.153541] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.156160] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.163168] systemd[1]: Finished Firewall. client # [ 7.295969] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.302831] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.168536] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.175582] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.320693] ACPI: button: Power Button [PWRF] worker1 # [ 7.231303] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.381354] ppdev: user-space parallel port driver worker2 # [ 7.284142] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.285238] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.438630] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 7.317975] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.314618] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.317649] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.327562] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.463395] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.332287] systemd[1]: Stopped Virtual Console Setup. client # [ 7.335785] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.428554] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.452453] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.388093] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.462728] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.462805] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:31:30 UTC (1790353890) lb # [ 7.392236] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.326289] mousedev: PS/2 mouse device common for all mice lb # [ 7.417012] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.462878] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.474499] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 7.411206] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.467670] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.467738] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:31:30 UTC (1790353890) lb # [ 7.467813] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.474582] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.430825] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 7.564426] kvm_amd: TSC scaling supported client # [ 7.564927] kvm_amd: Nested Virtualization enabled client # [ 7.565794] kvm_amd: Nested Paging enabled client # [ 7.566384] kvm_amd: LBR virtualization supported client # [ 7.566870] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.567623] kvm_amd: Virtual GIF supported client # [ 7.568009] kvm_amd: Virtual NMI enabled lb # [ 7.455458] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.489915] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.457702] systemd[1]: Reached target System Initialization. worker2 # [ 7.495166] Console: switching to colour dummy device 80x25 worker2 # [ 7.506884] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.460507] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.461477] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.463135] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.464088] systemd[1]: Reached target Timer Units. lb # [ 7.464784] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.454552] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.472765] systemd[1]: Listening on niks3 server socket. lb # [ 7.473616] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.474487] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.476176] systemd[1]: Reached target Socket Units. lb # [ 7.476902] systemd[1]: Reached target Basic System. worker1 # [ 7.465629] (udev-worker)[359]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.480908] systemd[1]: Started backdoor.service. worker1 # [ 7.468280] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.482763] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.516072] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 7.516163] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.485080] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 7.608091] EDAC MC: Ver: 3.0.0 worker1 # [ 7.479889] systemd[1]: Mounting /run/wrappers... lb # [ 7.494071] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.616118] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.616554] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.501216] systemd[1]: Starting Post-Boot Actions... lb # [ 7.512636] systemd[1]: Started Reset console on configuration changes. lb # [ 7.544183] Console: switching to colour dummy device 80x25 worker2 # [ 7.634733] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.626010] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.635494] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.626118] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.650175] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.650177] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 7.642768] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.643658] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.523822] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.526249] systemd[1]: Reached target Local File Systems. worker1 # [ 7.531064] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.534060] systemd[1]: Starting register-nix-paths.service... lb # [ 7.548856] systemd[1]: Starting resolvconf update... worker1 # [ 7.540669] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.541748] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.547637] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.562094] systemd[1]: Started rustfs.service. worker1 # [ 7.550129] systemd[1]: Starting Create System Files and Directories... lb # [ 7.572131] systemd[1]: Starting rustfs-bucket.service... lb # [ 7.709345] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.710156] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.593082] systemd[1]: Finished Firewall. lb # [ 7.742636] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 7.746010] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.619313] nsncd[517]: Sep 25 16:31:30.785 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.622388] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 7.626968] systemd[1]: Finished Post-Boot Actions. worker2 # [ 7.613460] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.616367] systemd[1]: Reached target System Initialization. worker2 # [ 7.618156] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.622701] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.623920] systemd[1]: Reached target Timer Units. worker2 # [ 7.624689] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.627101] systemd[1]: Listening on Nix Daemon Socket. lb # connecting to host... worker2 # [ 7.627939] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.632271] systemd[1]: Reached target Socket Units. worker1 # [ 7.635946] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.633074] systemd[1]: Reached target Basic System. worker2 # [ 7.635699] systemd[1]: Started backdoor.service. worker1 # [ 7.639955] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.636460] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 7.639070] systemd-vconsole-setup[419]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 7.641282] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.642218] systemd[1]: Starting Post-Boot Actions... client # [ 7.642869] systemd[1]: Finished Virtual Console Setup. client # [ 7.644943] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.646175] systemd[1]: Started Reset console on configuration changes. lb # [ 7.663192] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.646890] systemd[1]: Reached target System Initialization. lb # [ 7.665889] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.648285] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.649665] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 7.650704] systemd[1]: Reached target Timer Units. client # [ 7.652139] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.653992] systemd[1]: Starting resolvconf update... client # [ 7.653152] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.653934] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 7.655206] systemd[1]: Reached target Socket Units. client # [ 7.655929] systemd[1]: Reached target Basic System. lb # [ 7.674587] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 7.658160] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.657977] systemd[1]: Started backdoor.service. client # [ 7.661937] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 7.666342] systemd[1]: Starting nftables firewall... client # [ 7.675966] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.682146] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.689071] systemd[1]: Finished Create System Files and Directories. lb # [ 7.704467] systemd[1]: Starting User Login Management... client # [ 7.687717] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.694599] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.697390] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.697472] systemd[1]: Starting Virtual Console Setup... client # [ 7.704932] systemd[1]: Starting resolvconf update... lb # [ 7.732719] systemd[1]: Finished Import lastlog data into lastlog2 database. client # connecting to host... worker2 # [ 7.745257] systemd[1]: Finished Post-Boot Actions. client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 7.764072] systemd[1]: Starting D-Bus System Message Bus... worker2 # connecting to host... worker1 # [ 7.775612] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.778491] nsncd[513]: Sep 25 16:31:30.952 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.767820] systemd[1]: Finished Post-Boot Actions. worker2 # [ 7.782895] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.791360] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.773520] nsncd[427]: Sep 25 16:31:30.638 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.830862] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.788200] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.779289] systemd[1]: Started Name Service Cache Daemon (nsncd). client: connected to guest root shell worker1 # [ 7.792440] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.791196] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.783224] systemd[1]: Reached target Host and Network Name Lookups. client: (connecting took 8.49 seconds) worker1 # [ 7.795301] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.792848] systemd[1]: Starting User Login Management... client # [ 7.788454] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.797291] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client: (finished: waiting for the VM to finish booting, in 8.50 seconds) client # [ 7.799048] systemd[1]: Starting User Login Management... worker1 # [ 7.799936] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.810474] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 7.802277] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.804514] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.839220] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.841116] systemd[1]: Starting Update is Completed... worker2 # [ 7.717572] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.717895] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 7.899682] systemd[1]: Finished Update is Completed. client # [ 7.904968] dbus-broker-launch[442]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 7.923721] dbus-broker-launch[548]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 7.838549] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.055581] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.821248] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.923689] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 7.929567] dbus-broker-launch[517]: Looking up NSS user entry for 'systemd-timesync'... client # [ 7.928791] systemd-logind[457]: New seat seat0. worker2 # [ 7.932456] dbus-broker-launch[517]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.934377] dbus-broker-launch[517]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 7.937531] dbus-broker-launch[517]: Ready client # [ 7.936536] systemd-logind[457]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 7.940589] systemd-logind[457]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 7.942411] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.943497] systemd[1]: Stopped Virtual Console Setup. client # [ 7.941762] systemd-logind[457]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 7.945283] systemd[1]: Starting Virtual Console Setup... client # [ 7.947527] systemd[1]: Started User Login Management. client # [ 7.956201] dbus-broker-launch[442]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.959195] systemd-logind[539]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 7.957220] dbus-broker-launch[442]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 7.960677] systemd-logind[539]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 7.965921] systemd[1]: Starting linger-users.service... worker2 # [ 7.963775] systemd-logind[539]: New seat seat0. worker2 # [ 7.971055] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 7.970876] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 7.971843] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 7.974636] systemd[1]: Stopping Host and Network Name Lookups... client # [ 7.973482] systemd[1]: Stopped target User and Group Name Lookups. client # [ 7.975139] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.975963] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 7.978191] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 7.981156] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.980286] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 7.981994] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 7.983088] systemd[1]: Started User Login Management. client # [ 7.981830] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.983782] systemd[1]: Starting linger-users.service... worker2 # [ 7.989866] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 7.992445] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.993348] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.996217] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.168727] Console: switching to colour frame buffer device 160x50 client # [ 8.023123] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.037408] dbus-broker-launch[442]: Ready worker2 # [ 8.184149] ppdev: user-space parallel port driver worker2 # [ 8.049880] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.051556] systemd[1]: Finished linger-users.service. worker1 # [ 8.061516] systemd[1]: Finished Firewall. client # [ 8.057721] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.060832] systemd[1]: Finished linger-users.service. worker2 # [ 8.062819] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.064079] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.065203] nsncd[589]: Sep 25 16:31:31.238 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.069138] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.210160] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 8.080309] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.169892] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 8.081369] nsncd[517]: Sep 25 16:31:30.945 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.083586] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.932297] systemd-logind[550]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.084642] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.103426] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.104503] dbus-broker-launch[548]: NSS returned no entry for 'systemd-timesync' lb # [ 8.105574] dbus-broker-launch[548]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 8.090847] systemd[1]: Finished resolvconf update. worker2 # [ 8.091793] systemd[1]: Reached target Preparation for Network. lb # [ 8.109044] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 8.110250] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 8.094872] systemd[1]: Starting DHCP Client... worker2 # [ 8.096153] systemd[1]: Starting Address configuration of eth1... lb # [ 8.112499] nsncd[607]: Sep 25 16:31:31.218 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.096087] systemd[1]: Finished resolvconf update. lb # [ 8.115745] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 8.100038] systemd[1]: Starting Extra networking commands.... lb # [ 8.116678] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.101097] systemd[1]: Starting DHCP Client... lb # [ 8.119082] systemd[1]: nscd.service: Deactivated successfully. lb # [ 8.119852] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.120665] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.121589] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.122548] dbus-broker-launch[548]: Ready lb # [ 8.126288] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.127153] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.127992] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.128869] systemd[1]: Finished resolvconf update. lb # [ 8.129581] systemd[1]: Reached target Preparation for Network. lb # [ 8.131456] systemd-logind[550]: New seat seat0. lb # [ 8.132757] systemd-logind[550]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.135078] systemd-logind[550]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.259119] ACPI: button: Power Button [PWRF] lb # [ 8.136260] systemd[1]: Starting DHCP Client... lb # [ 8.136898] systemd[1]: Starting Address configuration of eth1... worker1 # [ 8.263110] mousedev: PS/2 mouse device common for all mice lb # [ 8.140660] systemd[1]: Starting Extra networking commands.... lb # [ 8.146336] systemd[1]: Started User Login Management. lb # [ 8.147114] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.158843] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.298171] ppdev: user-space parallel port driver worker1 # [ 8.175322] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.314881] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 8.178124] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.323002] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.189188] dhcpcd[554]: dhcpcd-10.3.2 starting lb # [ 8.212252] systemd[1]: Starting linger-users.service... client # [ 8.194520] dhcpcd[561]: dev: loaded udev client # [ 8.336265] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.222421] systemd[1]: Starting Virtual Console Setup... lb # [ 8.374330] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.223370] network-addresses-eth1-start[617]: adding address 192.168.1.4/24... done client # [ 8.236846] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.239825] network-addresses-eth1-start[617]: adding address 2001:db8:1::4/64... done worker2 # [ 8.266733] systemd[1]: Finished Address configuration of eth1. client # [ 8.411104] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 8.282970] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.285042] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.288261] systemd[1]: Starting Virtual Console Setup... client # [ 8.430790] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.431464] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 8.434325] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.435212] cfg80211: failed to load regulatory.db worker2 # [ 8.440756] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.455336] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.330591] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.334110] systemd[1]: Finished linger-users.service. client # [ 8.324874] systemd[1]: Finished nftables firewall. client # [ 8.327478] systemd[1]: Reached target Preparation for Network. client # [ 8.330967] systemd[1]: Starting Address configuration of eth1... client # [ 8.335251] systemd[1]: Starting Extra networking commands.... lb # [ 8.359768] network-addresses-eth1-start[638]: adding address 192.168.1.2/24... done client # [ 8.482344] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.350729] dhcpcd[561]: eth0: waiting for carrier client # [ 8.351703] dhcpcd[561]: eth0: carrier acquired client # [ 8.362119] dhcpcd[561]: DUID 00:01:00:01:32:49:5e:63:52:54:00:12:34:56 client # [ 8.363099] dhcpcd[561]: eth0: IAID 00:12:34:56 worker2 # [ 8.364812] systemd-logind[539]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.363857] dhcpcd[561]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.387229] network-addresses-eth1-start[638]: adding address 2001:db8:1::2/64... done worker1 # [ 8.337025] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 8.402389] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.337409] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:31:30 UTC (1790353890) worker2 # [ 8.524895] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.519932] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.337506] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 8.390206] systemd[1]: Finished Extra networking commands.. lb # [ 8.407058] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.393048] systemd[1]: Reached target Network. worker2 # [ 8.393875] dhcpcd[627]: dhcpcd-10.3.2 starting worker2 # [ 8.396828] systemd[1]: Starting Permit User Sessions... client # [ 8.398719] network-addresses-eth1-start[580]: adding address 192.168.1.1/24... done worker2 # [ 8.405306] dhcpcd[688]: dev: loaded udev client # [ 8.406612] network-addresses-eth1-start[580]: adding address 2001:db8:1::1/64... done worker1 # [ 8.338293] systemd-journald[283]: Time jumped backwards, rotating. worker1 # [ 8.358707] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 8.431410] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.555586] 8021q: 802.1Q VLAN Support v1.8 client # [ 8.417774] systemd[1]: Finished Address configuration of eth1. lb # [ 8.436460] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.557970] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.374691] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.374772] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.396792] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.519765] Console: switching to colour dummy device 80x25 client # [ 8.440409] systemd[1]: Finished Extra networking commands.. client # [ 8.443069] systemd[1]: Reached target Network. client # [ 8.444462] systemd[1]: Starting Permit User Sessions... client # [ 8.459746] systemd[1]: Finished Permit User Sessions. client # [ 8.462946] systemd[1]: Started Getty on tty1. client # [ 8.464063] systemd[1]: Reached target Login Prompts. worker1 # [ 8.523385] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.523496] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 8.587178] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.485302] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.499727] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.503636] systemd[1]: Reached target System Initialization. worker2 # [ 8.501191] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.507138] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 8.507250] systemd[1]: Started Getty on tty1. worker2 # [ 8.508460] systemd[1]: Reached target Login Prompts. worker1 # [ 8.512140] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 8.514120] systemd[1]: Reached target Timer Units. worker1 # [ 8.517495] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.520647] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 8.534670] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.535848] systemd[1]: Reached target Socket Units. worker1 # [ 8.536582] systemd[1]: Reached target Basic System. worker1 # [ 8.537279] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 8.550671] dhcpcd[660]: dhcpcd-10.3.2 starting worker1 # [ 8.542499] systemd[1]: Started backdoor.service. worker1 # [ 8.543631] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.553152] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.558955] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.562612] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.697638] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.568072] systemd[1]: Starting resolvconf update... lb # [ 8.585327] dhcpcd[717]: dev: loaded udev worker1 # [ 8.573805] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.579301] systemd[1]: Starting Virtual Console Setup... lb # [ 8.596115] systemd[1]: Finished Extra networking commands.. lb # [ 8.599761] systemd[1]: Reached target Network. worker2 # [ 8.721297] kvm_amd: TSC scaling supported worker2 # [ 8.721696] kvm_amd: Nested Virtualization enabled worker2 # [ 8.722448] kvm_amd: Nested Paging enabled worker2 # [ 8.722878] kvm_amd: LBR virtualization supported worker2 # [ 8.723545] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.724257] kvm_amd: Virtual GIF supported worker2 # [ 8.724637] kvm_amd: Virtual NMI enabled client # [ 8.587235] dhcpcd[561]: eth0: soliciting a DHCP lease lb # [ 8.609129] systemd[1]: Starting PostgreSQL Server... lb # [ 8.611448] systemd[1]: Starting Permit User Sessions... client # [ 8.729238] NET: Registered PF_PACKET protocol family client # [ 8.600489] dhcpcd[561]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 8.602146] dhcpcd[561]: eth0: probing address 10.0.2.15/24 worker2 # [ 8.742141] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.742806] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.744833] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.745653] cfg80211: failed to load regulatory.db lb # [ 8.771551] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.772000] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.766406] EDAC MC: Ver: 3.0.0 worker2 # [ 8.786496] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.651085] dhcpcd[688]: eth0: waiting for carrier worker2 # [ 8.651799] dhcpcd[688]: libudev: received NULL device worker2 # [ 8.654463] dhcpcd[688]: libudev: received NULL device worker2 # [ 8.656114] dhcpcd[688]: eth0: carrier acquired lb # [ 8.808128] kvm_amd: TSC scaling supported lb # [ 8.808565] kvm_amd: Nested Virtualization enabled lb # [ 8.809011] kvm_amd: Nested Paging enabled worker2 # [ 8.659813] dhcpcd[688]: DUID 00:01:00:01:32:49:5e:63:52:54:00:12:34:56 worker2 # [ 8.661046] dhcpcd[688]: eth0: IAID 00:12:34:56 worker2 # [ 8.661754] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.587418] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.815498] kvm_amd: LBR virtualization supported worker1 # [ 8.804255] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.816026] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.804257] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.825289] kvm_amd: Virtual GIF supported lb # [ 8.825691] kvm_amd: Virtual NMI enabled worker2 # [ 8.681966] systemd-vconsole-setup[653]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.684995] systemd[1]: Finished Virtual Console Setup. lb # [ 8.717087] systemd[1]: Finished Permit User Sessions. lb # [ 8.723152] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.732189] systemd[1]: Started Getty on tty1. worker1 # [ 8.719566] systemd[1]: Finished Post-Boot Actions. worker1 # [ 8.720592] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 8.735405] systemd[1]: Reached target Login Prompts. worker1 # [ 8.749263] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 8.756120] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 8.760220] nix-grpc-daemon[511]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 8.762577] nix-grpc-daemon[511]: E0000 00:00:1790353891.051298 511 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 8.770684] nix-grpc-daemon[511]: E0000 00:00:1790353891.063905 511 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 8.775914] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 8.779610] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 8.789093] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" worker1 # [ 8.792265] nix-grpc-daemon[511]: E0000 00:00:1790353891.090272 570 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # connecting to host... lb # [ 8.955478] EDAC MC: Ver: 3.0.0 lb # [ 8.961764] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.815593] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.816434] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.820313] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.824258] systemd[1]: Starting User Login Management... worker1 # [ 8.829090] nix-grpc-daemon[511]: E0000 00:00:1790353891.125013 570 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 8.835137] nix-grpc-daemon[511]: E0000 00:00:1790353891.125120 570 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 8.837558] nsncd[514]: Sep 25 16:31:31.130 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.997801] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 9.000674] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.855703] nix-grpc-daemon[511]: E0000 00:00:1790353891.151531 570 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 9.004527] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.005395] cfg80211: failed to load regulatory.db worker2 # [ 8.853613] dhcpcd[688]: eth0: soliciting a DHCP lease worker1 # [ 8.863298] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker2 # [ 9.008131] NET: Registered PF_PACKET protocol family worker1 # [ 8.882170] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.877892] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 9.019702] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 9.020413] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 8.880358] dhcpcd[688]: eth0: probing address 10.0.2.15/24 worker1 # [ 8.905215] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.916191] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.917667] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 9.082685] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.936486] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.949788] dhcpcd[717]: eth0: waiting for carrier lb # [ 8.951469] dhcpcd[717]: eth0: carrier acquired lb # [ 8.953555] postgresql-pre-start[733]: The files belonging to this database system will be owned by user "postgres". lb # [ 8.955564] postgresql-pre-start[733]: This user must also own the server process. lb # [ 8.962147] postgresql-pre-start[733]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 8.963428] postgresql-pre-start[733]: The default database encoding has accordingly been set to "UTF8". lb # [ 8.964580] postgresql-pre-start[733]: The default text search configuration will be set to "english". lb # [ 8.965680] postgresql-pre-start[733]: Data page checksums are enabled. lb # [ 8.966558] postgresql-pre-start[733]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 8.968751] postgresql-pre-start[733]: creating subdirectories ... ok lb # [ 8.969941] postgresql-pre-start[733]: selecting dynamic shared memory implementation ... posix lb # [ 8.972068] dhcpcd[717]: DUID 00:01:00:01:32:49:5e:64:52:54:00:12:34:56 lb # [ 8.973030] dhcpcd[717]: eth0: IAID 00:12:34:56 lb # [ 8.974463] dhcpcd[717]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.972621] dbus-broker-launch[518]: Ready lb # [ 9.041843] postgresql-pre-start[733]: selecting default "max_connections" ... 100 worker1 # [ 9.033865] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.034991] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.036697] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.046244] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 9.047232] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 9.048044] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 9.048920] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 9.049755] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 9.058340] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 9.059478] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 9.064374] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 9.069656] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.077746] systemd-logind[592]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 9.093371] postgresql-pre-start[733]: selecting default "shared_buffers" ... 128MB worker1 # [ 9.080837] systemd-logind[592]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 9.084236] systemd-logind[592]: New seat seat0. lb # [ 9.100707] systemd-vconsole-setup[690]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.089713] systemd[1]: Started User Login Management. lb # [ 9.103967] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.092682] systemd[1]: Starting linger-users.service... client: (finished: waiting for unit network-addresses-eth1.service, in 9.76 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.145513] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.147345] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 9.149545] nsncd[640]: Sep 25 16:31:31.445 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.153593] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.160966] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 9.164265] systemd[1]: Finished linger-users.service. lb: (finished: waiting for unit network-addresses-eth1.service, in 0.03 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker1 # [ 9.176377] systemd[1]: Finished resolvconf update. worker1 # [ 9.178366] systemd[1]: Reached target Preparation for Network. worker1 # [ 9.182191] systemd-logind[592]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.183486] systemd[1]: Starting DHCP Client... worker1 # [ 9.186236] systemd[1]: Starting Address configuration of eth1... worker1 # [ 9.188852] systemd[1]: Starting Extra networking commands.... lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.331958] network-addresses-eth1-start[670]: adding address 192.168.1.3/24... done worker1 # [ 9.350065] network-addresses-eth1-start[670]: adding address 2001:db8:1::3/64... done worker1 # [ 9.375125] systemd[1]: Finished Address configuration of eth1. worker1 # [ 9.389830] ppdev: user-space parallel port driver worker1 # [ 9.535008] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.561269] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 9.591637] Console: switching to colour frame buffer device 160x50 worker1 # [ 9.619630] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 9.383274] systemd-vconsole-setup[635]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.487023] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.491373] dhcpcd[682]: dhcpcd-10.3.2 starting worker1 # [ 9.492911] nix-grpc-daemon[511]: ts=2026-09-25T16:31:31Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 9.497133] systemd[1]: Reached target Network. worker1 # [ 9.502439] dhcpcd[742]: dev: loaded udev worker1 # [ 9.640026] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.640496] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.507237] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.511387] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.512959] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.518143] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.566352] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.567168] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.571224] systemd[1]: Started Getty on tty1. worker1 # [ 9.571937] systemd[1]: Reached target Login Prompts. lb # [ 9.654601] postgresql-pre-start[733]: selecting default time zone ... UTC lb # [ 9.657354] postgresql-pre-start[733]: creating configuration files ... ok worker1 # [ 9.792041] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.816464] kvm_amd: TSC scaling supported worker1 # [ 9.816869] kvm_amd: Nested Virtualization enabled worker1 # [ 9.817567] kvm_amd: Nested Paging enabled worker1 # [ 9.817954] kvm_amd: LBR virtualization supported worker1 # [ 9.818706] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.819358] kvm_amd: Virtual GIF supported worker1 # [ 9.819770] kvm_amd: Virtual NMI enabled worker1 # [ 9.836639] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.837326] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.839142] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 9.839970] cfg80211: failed to load regulatory.db worker1 # [ 9.860715] EDAC MC: Ver: 3.0.0 worker1 # [ 9.879766] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 9.744912] dhcpcd[742]: eth0: waiting for carrier worker1 # [ 9.746951] dhcpcd[742]: libudev: received NULL device worker1 # [ 9.748441] dhcpcd[742]: libudev: received NULL device worker1 # [ 9.749734] dhcpcd[742]: eth0: carrier acquired worker1 # [ 9.754703] dhcpcd[742]: DUID 00:01:00:01:32:49:5e:64:52:54:00:12:34:56 worker1 # [ 9.755876] dhcpcd[742]: eth0: IAID 00:12:34:56 worker1 # [ 9.756690] dhcpcd[742]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.821568] postgresql-pre-start[733]: running bootstrap script ... ok worker1 # [ 9.814884] systemd-vconsole-setup[745]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.817538] systemd[1]: Finished Virtual Console Setup. client # [ 9.849327] dhcpcd[561]: eth0: soliciting an IPv6 router client # [ 9.850598] dhcpcd[561]: eth0: Router Advertisement from fe80::2 client # [ 9.851397] dhcpcd[561]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 9.852253] dhcpcd[561]: eth0: adding route to fec0::/64 client # [ 9.853074] dhcpcd[561]: eth0: adding default route via fe80::2 lb # [ 10.202677] postgresql-pre-start[733]: performing post-bootstrap initialization ... ok lb # [ 10.217503] dhcpcd[717]: eth0: soliciting a DHCP lease lb # [ 10.368784] NET: Registered PF_PACKET protocol family lb # [ 10.240702] dhcpcd[717]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 10.242206] dhcpcd[717]: eth0: probing address 10.0.2.15/24 worker1 # [ 10.265932] nix-grpc-daemon[511]: ts=2026-09-25T16:31:32Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 10.348513] postgresql-pre-start[733]: syncing data to disk ... ok lb # [ 10.350225] postgresql-pre-start[733]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.351450] postgresql-pre-start[733]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.353350] postgresql-pre-start[733]: Success. You can now start the database server using: lb # [ 10.354411] postgresql-pre-start[733]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker1: (finished: waiting for unit network-addresses-eth1.service, in 1.16 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.425168] postgres[768]: [768] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.427784] postgres[768]: [768] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.428893] postgres[768]: [768] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.431757] postgres[768]: [768] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 10.442510] postgres[777]: [777] LOG: database system was shut down at 2026-09-25 16:31:33 GMT worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) lb # [ 10.449096] postgres[768]: [768] LOG: database system is ready to accept connections worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 10.454672] systemd[1]: Started PostgreSQL Server. lb # [ 10.459153] systemd[1]: Starting PostgreSQL Setup Scripts... worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service lb # [ 10.603897] postgresql-setup-start[796]: CREATE DATABASE lb # [ 10.632248] postgresql-setup-start[802]: CREATE ROLE lb # [ 10.644194] postgresql-setup-start[804]: ALTER DATABASE lb # [ 10.648461] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.650466] systemd[1]: Reached target PostgreSQL. worker2 # [ 10.742977] dhcpcd[688]: eth0: soliciting an IPv6 router worker2 # [ 10.745835] dhcpcd[688]: eth0: Router Advertisement from fe80::2 worker2 # [ 10.747991] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 10.750356] dhcpcd[688]: eth0: adding route to fec0::/64 worker2 # [ 10.752189] dhcpcd[688]: eth0: adding default route via fe80::2 lb # [ 11.350271] dhcpcd[717]: eth0: soliciting an IPv6 router lb # [ 11.353065] dhcpcd[717]: eth0: Router Advertisement from fe80::2 lb # [ 11.355195] dhcpcd[717]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.357327] dhcpcd[717]: eth0: adding route to fec0::/64 lb # [ 11.359272] dhcpcd[717]: eth0: adding default route via fe80::2 worker1 # [ 11.554879] dhcpcd[742]: eth0: soliciting an IPv6 router worker1 # [ 11.558241] dhcpcd[742]: eth0: Router Advertisement from fe80::2 worker1 # [ 11.560587] dhcpcd[742]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 11.562784] dhcpcd[742]: eth0: adding route to fec0::/64 worker1 # [ 11.564662] dhcpcd[742]: eth0: adding default route via fe80::2 worker1 # [ 11.637191] dhcpcd[742]: eth0: soliciting a DHCP lease worker1 # [ 11.790023] NET: Registered PF_PACKET protocol family worker1 # [ 11.660672] dhcpcd[742]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.664727] dhcpcd[742]: eth0: probing address 10.0.2.15/24 worker1 # [ 11.866423] nix-grpc-daemon[511]: ts=2026-09-25T16:31:34Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" worker2 # [ 13.188756] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 13.191520] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 worker2 # [ 13.193567] dhcpcd[688]: eth0: adding default route via 10.0.2.2 worker2 # [ 13.281616] systemd[1]: Started DHCP Client. worker2 # [ 13.284221] systemd[1]: Reached target Network is Online. worker2 # [ 13.286232] systemd[1]: Starting scheduler-token.service... worker2 # [ 13.320394] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 13.322209] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 13.324139] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 13.325244] systemd[1]: Dependency failed for Nix worker-protocol over gRPC. worker2 # [ 13.327982] systemd[1]: nix-grpc-daemon.service: Job nix-grpc-daemon.service/start failed with result 'dependency'. worker2 # [ 13.330262] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 35ms wall clock time, 3.1M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. worker2 # [ 13.332240] systemd[1]: Reached target Multi-User System. worker2 # [ 13.333751] systemd[1]: Startup finished in 852ms (kernel) + 3.615s (initrd) + 8.859s (userspace) = 13.327s. client # [ 14.273515] dhcpcd[561]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 14.276428] dhcpcd[561]: eth0: adding route to 10.0.2.0/24 client # [ 14.279242] dhcpcd[561]: eth0: adding default route via 10.0.2.2 client # [ 14.360338] systemd[1]: Started DHCP Client. client # [ 14.362684] systemd[1]: Reached target Multi-User System. client # [ 14.363671] systemd[1]: Startup finished in 871ms (kernel) + 3.631s (initrd) + 9.860s (userspace) = 14.363s. worker2 # [ 14.573772] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 1. worker2 # [ 14.580917] systemd[1]: Starting scheduler-token.service... worker2 # [ 14.637427] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 14.640546] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 14.644379] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 14.646616] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 1.316s wall clock time, 2.1M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. worker1 # [ 15.067112] nix-grpc-daemon[511]: ts=2026-09-25T16:31:37Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 15.890555] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 2. worker2 # [ 15.896890] systemd[1]: Starting scheduler-token.service... worker2 # [ 15.946216] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 15.947741] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 15.949670] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 15.950930] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 1.300s wall clock time, 2.3M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. lb # [ 16.043540] dhcpcd[717]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.047499] dhcpcd[717]: eth0: adding route to 10.0.2.0/24 lb # [ 16.050584] dhcpcd[717]: eth0: adding default route via 10.0.2.2 lb # [ 16.131387] rustfs-bucket-start[858]: mb s3://farm lb # [ 16.138728] systemd[1]: Finished rustfs-bucket.service. lb # [ 16.148176] systemd[1]: Starting niks3 server... lb # [ 16.167995] systemd[1]: Started DHCP Client. lb # [ 16.173127] systemd[1]: Reached target Network is Online. lb # [ 16.178638] systemd[1]: Started Envoy reverse proxy. lb # [ 16.184033] systemd[1]: Started mock-oidc.service. lb # [ 16.419409] postgres[936]: [936] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 16.423138] postgres[936]: [936] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 16.468269] niks3-server[915]: 2026/09/25 16:31:39 OK 20241026095416_initial_model.sql (28.06ms) lb # [ 16.477623] niks3-server[915]: 2026/09/25 16:31:39 OK 20251210153512_drop_unused_gin_index.sql (5.93ms) lb # [ 16.480864] mock-oidc-server[923]: Mock OIDC Server running lb # [ 16.482174] mock-oidc-server[923]: OIDC Address: 192.168.1.2:8080 lb # [ 16.483353] mock-oidc-server[923]: Issue Address: 0.0.0.0:8081 lb # [ 16.484439] mock-oidc-server[923]: Issuer: http://192.168.1.2:8080/oidc lb # [ 16.485420] mock-oidc-server[923]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 16.486451] mock-oidc-server[923]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 16.487662] mock-oidc-server[923]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 16.490105] niks3-server[915]: 2026/09/25 16:31:39 OK 20251218171726_add_pins.sql (15.14ms) lb # [ 16.494995] niks3-server[915]: 2026/09/25 16:31:39 OK 20260628120000_add_object_size_and_stats.sql (5.79ms) lb # [ 16.500761] niks3-server[915]: 2026/09/25 16:31:39 OK 20260905000000_add_claims.sql (5.73ms) lb # [ 16.505817] niks3-server[915]: 2026/09/25 16:31:39 OK 20260920000000_drop_claims.sql (4.73ms) lb # [ 16.509296] niks3-server[915]: 2026/09/25 16:31:39 OK 20260923120000_add_pushes.sql (3.84ms) lb # [ 16.510639] niks3-server[915]: 2026/09/25 16:31:39 goose: successfully migrated database to version: 20260923120000 lb # [ 16.516920] niks3-server[915]: 2026/09/25 16:31:39 OK 1_commit_pending_closure.sql (6.25ms) lb # [ 16.520135] niks3-server[915]: 2026/09/25 16:31:39 OK 2_object_stats_trigger.sql (3.15ms) lb # [ 16.523970] niks3-server[915]: 2026/09/25 16:31:39 OK 3_commit_push.sql (3.79ms) lb # [ 16.525478] niks3-server[915]: 2026/09/25 16:31:39 goose: up to current file version: 3 lb # [ 16.530070] niks3-server[915]: 2026/09/25 16:31:39 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 16.580591] niks3-server[915]: 2026/09/25 16:31:39 INFO Read proxy enabled — serving cache objects from S3 lb # [ 16.583391] niks3-server[915]: 2026/09/25 16:31:39 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 16.585526] niks3-server[915]: 2026/09/25 16:31:39 INFO systemd watchdog enabled interval=15s lb # [ 16.586969] systemd[1]: Started niks3 server. lb # [ 16.589080] niks3-server[915]: 2026/09/25 16:31:39 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 16.591058] systemd[1]: Reached target Multi-User System. lb # [ 16.592280] systemd[1]: Startup finished in 851ms (kernel) + 3.654s (initrd) + 12.086s (userspace) = 16.592s. lb # [ 16.663890] envoy[922]: [2026-09-25 16:31:39.830][922][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 16.666770] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 16.668456] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 16.671391] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 16.678296] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 16.684336] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 16.689594] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 16.691942] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 16.694443] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.696931] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 16.699235] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 16.701466] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 16.704600] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 16.708060] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 16.712489] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 16.716351] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 16.717845] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 16.719790] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 16.721662] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 16.723810] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 16.736170] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 16.738064] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 16.739732] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 16.741459] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 16.743276] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 16.746032] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 16.747867] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 16.751696] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 16.753412] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 16.755227] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 16.761213] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 16.763586] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 16.765666] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 16.768348] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 16.771108] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 16.774407] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 16.780798] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 16.782727] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 16.784221] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 16.785883] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 16.787638] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 16.789270] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 16.790621] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 16.792202] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.794188] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 16.795779] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 16.797308] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 16.799603] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 16.805292] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 16.807201] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 16.809184] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 16.811440] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 16.813790] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 16.816740] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 16.818428] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 16.824221] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 16.826024] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 16.828136] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 16.830196] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 16.833453] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 16.835797] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 16.860957] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 16.862633] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 16.864592] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 16.866276] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 16.868669] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 16.870718] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 16.878410] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 16.880081] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 16.882360] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 16.885435] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 16.887825] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 16.891433] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 16.895600] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 16.898577] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 16.902542] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 16.904659] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 16.906810] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 16.910182] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 16.913169] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 16.922539] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 16.925124] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 16.929741] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.932426] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 16.935521] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 16.937706] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 16.941674] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 16.944553] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 16.946786] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 16.950781] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 16.952564] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 16.954285] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 16.955941] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 16.957980] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.960342] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 16.961943] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 16.964979] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 16.967488] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 16.969953] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 16.972231] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 16.975565] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 16.978296] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 16.980968] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 16.982579] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 16.986465] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 16.987954] envoy[922]: [2026-09-25 16:31:39.832][922][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 16.990186] envoy[922]: [2026-09-25 16:31:39.940][922][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 16.991570] envoy[922]: [2026-09-25 16:31:39.970][922][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 17.006050] envoy[922]: [2026-09-25 16:31:39.970][922][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 17.007456] envoy[922]: [2026-09-25 16:31:39.970][922][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 17.015032] envoy[922]: [2026-09-25 16:31:39.970][922][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 17.028919] envoy[922]: [2026-09-25 16:31:40.194][922][info][main] [source/server/server.cc:968] runtime: {} lb # [ 17.032272] envoy[922]: [2026-09-25 16:31:40.198][922][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 17.033842] envoy[922]: [2026-09-25 16:31:40.198][922][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 17.035572] envoy[922]: [2026-09-25 16:31:40.201][922][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 17.037614] envoy[922]: [2026-09-25 16:31:40.204][922][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 17.039392] envoy[922]: [2026-09-25 16:31:40.205][922][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 17.040850] envoy[922]: [2026-09-25 16:31:40.205][922][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 17.062462] envoy[922]: [2026-09-25 16:31:40.228][922][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb: (finished: waiting for unit niks3.service, in 6.60 seconds) lb # [ 17.066459] envoy[922]: [2026-09-25 16:31:40.232][922][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb: waiting for TCP port 5751 on localhost lb # [ 17.068312] envoy[922]: [2026-09-25 16:31:40.234][922][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 17.070900] envoy[922]: [2026-09-25 16:31:40.234][922][info][main] [source/server/server.cc:1077] starting main dispatch loop lb # [ 17.072360] envoy[922]: [2026-09-25 16:31:40.238][922][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 17.074629] envoy[922]: [2026-09-25 16:31:40.240][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:227] cm init: initializing secondary clusters lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.03 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost worker2 # [ 17.198251] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 3. worker2 # [ 17.206146] systemd[1]: Starting scheduler-token.service... worker2 # [ 17.265606] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.269288] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.272116] systemd[1]: scheduler-token.service: Consumed 33ms CPU time over 1.314s wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 17.531671] dhcpcd[742]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 17.534660] dhcpcd[742]: eth0: adding route to 10.0.2.0/24 worker1 # [ 17.536918] dhcpcd[742]: eth0: adding default route via 10.0.2.2 worker1 # [ 17.620547] systemd[1]: Started DHCP Client. worker1 # [ 17.622367] systemd[1]: Reached target Multi-User System. worker1 # [ 17.623480] systemd[1]: Startup finished in 860ms (kernel) + 4.529s (initrd) + 12.233s (userspace) = 17.623s. worker1 # [ 20.067801] nix-grpc-daemon[511]: ts=2026-09-25T16:31:42Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" worker1 # [ 25.068586] nix-grpc-daemon[511]: ts=2026-09-25T16:31:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 26.597961] niks3-server[915]: 2026/09/25 16:31:49 INFO lead: acquired remote=192.168.1.3:43950 worker1 # [ 26.585726] nix-grpc-daemon[511]: ts=2026-09-25T16:31:48Z level=info event=scheduler_take_over worker1 # [ 30.069312] nix-grpc-daemon[511]: ts=2026-09-25T16:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 32.070770] envoy[922]: [2026-09-25 16:31:55.236][922][warning][config] [source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:130] gRPC config: initial fetch timed out for type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment lb # [ 32.077597] envoy[922]: [2026-09-25 16:31:55.236][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 32.081616] envoy[922]: [2026-09-25 16:31:55.236][922][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 32.087627] envoy[922]: [2026-09-25 16:31:55.254][922][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 32.656302] envoy[922]: conn peer=[::1]:47692 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=6 lb: (finished: waiting for TCP port 50051 on localhost, in 15.53 seconds) worker2 # [ 32.740449] systemd[1]: Starting scheduler-token.service... worker2 # [ 32.786091] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 32.787256] systemd[1]: Finished scheduler-token.service. worker2 # [ 32.788473] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 46ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 32.793195] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 32.888586] nix-grpc-daemon[803]: ts=2026-09-25T16:31:56Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 32.898795] nix-grpc-daemon[803]: ts=2026-09-25T16:31:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 32.901237] nix-grpc-daemon[803]: ts=2026-09-25T16:31:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 32.915451] nix-grpc-daemon[803]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 32.917072] nix-grpc-daemon[803]: E0000 00:00:1790353916.089198 803 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 32.922987] nix-grpc-daemon[803]: E0000 00:00:1790353916.096878 803 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 32.926620] nix-grpc-daemon[803]: ts=2026-09-25T16:31:56Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 32.929816] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 32.939072] nix-grpc-daemon[803]: E0000 00:00:1790353916.113030 845 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 32.951964] nix-grpc-daemon[803]: E0000 00:00:1790353916.125986 845 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 32.956054] nix-grpc-daemon[803]: E0000 00:00:1790353916.128328 845 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 32.966400] nix-grpc-daemon[803]: E0000 00:00:1790353916.140439 845 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 32.985071] nix-grpc-daemon[803]: ts=2026-09-25T16:31:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.005143] nix-grpc-daemon[511]: ts=2026-09-25T16:31:55Z level=info event=oidc_jwks provider=mock keys=1 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 33.008327] nix-grpc-daemon[511]: ts=2026-09-25T16:31:55Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36452 worker1 # [ 33.012093] nix-grpc-daemon[511]: ts=2026-09-25T16:31:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 35.070860] nix-grpc-daemon[511]: ts=2026-09-25T16:31:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.075693] nix-grpc-daemon[511]: ts=2026-09-25T16:31:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36452 worker1 # [ 35.079255] nix-grpc-daemon[511]: ts=2026-09-25T16:31:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 38.795779] nix-grpc-daemon[511]: E0000 00:00:1790353921.092617 567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 38.824751] nix-grpc-daemon[511]: E0000 00:00:1790353921.123138 567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 38.835154] nix-grpc-daemon[511]: E0000 00:00:1790353921.128606 567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 38.857559] nix-grpc-daemon[511]: E0000 00:00:1790353921.155604 567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 40.171962] nix-grpc-daemon[511]: ts=2026-09-25T16:32:02Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:36466 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 7.40 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.42 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 40.935524] nix-grpc-daemon[803]: ts=2026-09-25T16:32:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 40.940213] systemd[1]: Started Nix Daemon. worker2 # [ 41.035226] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 41.049527] nix-grpc-daemon[803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5) worker2 # [ 41.147255] nix-grpc-daemon[803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 2/5) worker2 # [ 41.243512] nix-grpc-daemon[803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 387 ms (attempt 3/5) worker2 # [ 41.631643] nix-grpc-daemon[803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 4/5) worker2 # [ 41.692472] nix-grpc-daemon[803]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 41.696564] nix-grpc-daemon[803]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 41.725656] nix-grpc-daemon[511]: ts=2026-09-25T16:32:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 41.739205] systemd[1]: Started Nix Daemon. worker1 # [ 41.873244] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 41.892363] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5) worker1 # [ 41.942904] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5) worker1 # [ 41.992627] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 263 ms (attempt 3/5) worker1 # [ 42.262780] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 164 ms (attempt 4/5) worker1 # [ 42.430301] nix-grpc-daemon[511]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 42.434127] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 42.447743] nix-grpc-daemon[511]: ts=2026-09-25T16:32:04Z level=debug event=path_info_miss path=6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test error="error: path '/nix/store/6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 42.457722] nix-grpc-daemon[511]: ts=2026-09-25T16:32:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 42.466232] nix-grpc-daemon[511]: ts=2026-09-25T16:32:04Z level=debug event=path_info_miss path=6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test error="error: path '/nix/store/6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker2 # [ 42.689297] nix-grpc-daemon[803]: ts=2026-09-25T16:32:05Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 42.693429] nix-grpc-daemon[803]: ts=2026-09-25T16:32:05Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:55220 worker2 # [ 42.702099] nix-grpc-daemon[803]: ts=2026-09-25T16:32:05Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:55220 worker2 # [ 42.713174] nix-grpc-daemon[803]: ts=2026-09-25T16:32:05Z level=debug event=path_info_miss path=6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test error="error: path '/nix/store/6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 42.723166] nix-grpc-daemon[511]: ts=2026-09-25T16:32:05Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36476 worker1 # [ 42.733913] nix-grpc-daemon[511]: ts=2026-09-25T16:32:05Z level=debug event=path_info_miss path=6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test error="error: path '/nix/store/6rlhi5dcdiiclafqnpzgp1y7qxb2ara2-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker2 # [ 42.873161] nix-grpc-daemon[803]: ts=2026-09-25T16:32:06Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 43.006178] nix-grpc-daemon[511]: ts=2026-09-25T16:32:05Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.27 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 43.144473] nix-grpc-daemon[511]: ts=2026-09-25T16:32:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36476 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 43.153482] nix-grpc-daemon[511]: ts=2026-09-25T16:32:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 43.183267] nix-grpc-daemon[511]: ts=2026-09-25T16:32:05Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker1 # [ 43.187250] nix-grpc-daemon[511]: ts=2026-09-25T16:32:05Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 43.194423] nix-grpc-daemon[803]: ts=2026-09-25T16:32:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 43.207229] nix-grpc-daemon[803]: ts=2026-09-25T16:32:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying 1 paths to 'lb:50051'... worker2 # [ 43.218615] nix-grpc-daemon[803]: ts=2026-09-25T16:32:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker2 # [ 43.237293] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 43.266504] nix-grpc-daemon[803]: ts=2026-09-25T16:32:06Z level=info event=niks3_push_started pid=873 worker2 # [ 43.418442] nix-grpc-daemon[873]: time=2026-09-25T16:32:06.592Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 43.508819] nix-daemon[861]: accepted connection from pid 886, user nix-grpc-daemon (trusted) worker2 # [ 43.522133] nix-daemon[861]: reaped child process 889, status = succeeded lb # [ 43.548696] niks3-server[915]: 2026/09/25 16:32:06 INFO Received push request method=POST path=/api/pushes worker2 # [ 43.546298] nix-grpc-daemon[873]: time=2026-09-25T16:32:06.720Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 43.547823] nix-grpc-daemon[873]: time=2026-09-25T16:32:06.721Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 43.609035] niks3-server[915]: 2026/09/25 16:32:06 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign lb # [ 43.614966] niks3-server[915]: 2026/09/25 16:32:06 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 43.628080] niks3-server[915]: 2026/09/25 16:32:06 INFO Signed narinfos id=1 count=1 worker2 # [ 43.615100] nix-grpc-daemon[873]: time=2026-09-25T16:32:06.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.636572] niks3-server[915]: 2026/09/25 16:32:06 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 43.640682] niks3-server[915]: 2026/09/25 16:32:06 INFO Received complete push request method=POST path=/api/pushes/1/complete lb # [ 43.651942] niks3-server[915]: 2026/09/25 16:32:06 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker2 # [ 43.639601] nix-grpc-daemon[873]: time=2026-09-25T16:32:06.813Z level=INFO msg="Upload complete. (216ms)" worker2 # [ 43.644625] nix-grpc-daemon[803]: ts=2026-09-25T16:32:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 43.650420] nix-grpc-daemon[803]: ts=2026-09-25T16:32:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 43.661892] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 43.672221] nix-daemon[861]: reaped child process 871, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker2 # [ 43.681059] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 44.294319] nix-daemon[861]: reaped child process 893, status = succeeded worker2 # [ 44.369312] nix-daemon[861]: accepted connection from pid 909, user nix-grpc-daemon (trusted) worker2 # [ 44.381653] nix-daemon[861]: reaped child process 912, status = succeeded lb # [ 44.405218] niks3-server[915]: 2026/09/25 16:32:07 INFO Received push request method=POST path=/api/pushes worker2 # [ 44.398288] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.572Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 44.399751] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.573Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 44.450258] niks3-server[915]: 2026/09/25 16:32:07 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign worker2 # [ 44.443277] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.617Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.460103] niks3-server[915]: 2026/09/25 16:32:07 INFO Signed narinfos id=2 count=1 lb # [ 44.466070] niks3-server[915]: 2026/09/25 16:32:07 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 44.470652] niks3-server[915]: 2026/09/25 16:32:07 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 44.475099] niks3-server[915]: 2026/09/25 16:32:07 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 44.483651] niks3-server[915]: 2026/09/25 16:32:07 INFO Received complete push request method=POST path=/api/pushes/2/complete lb # [ 44.492181] niks3-server[915]: 2026/09/25 16:32:07 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker2 # [ 44.478994] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.652Z level=INFO msg="Upload complete. (192ms)" worker2 # [ 44.484690] nix-grpc-daemon[803]: ts=2026-09-25T16:32:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 44.497520] nix-grpc-daemon[511]: ts=2026-09-25T16:32:06Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 44.496185] nix-grpc-daemon[803]: ts=2026-09-25T16:32:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 44.501943] nix-grpc-daemon[511]: ts=2026-09-25T16:32:06Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 44.506547] nix-grpc-daemon[803]: ts=2026-09-25T16:32:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 44.511431] nix-daemon[861]: reaped child process 891, status = succeeded worker2 # [ 44.516546] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.690Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 44.527723] nix-grpc-daemon[803]: ts=2026-09-25T16:32:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker2 # [ 44.545324] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 44.640956] nix-daemon[861]: accepted connection from pid 916, user nix-grpc-daemon (trusted) worker2 # [ 44.654194] nix-daemon[861]: reaped child process 919, status = succeeded lb # [ 44.680398] niks3-server[915]: 2026/09/25 16:32:07 INFO Received push request method=POST path=/api/pushes worker2 # [ 44.675401] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.849Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 44.676890] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.850Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 44.717509] niks3-server[915]: 2026/09/25 16:32:07 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign lb # [ 44.721796] niks3-server[915]: 2026/09/25 16:32:07 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls worker2 # [ 44.710188] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.884Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.726849] niks3-server[915]: 2026/09/25 16:32:07 INFO Signed narinfos id=3 count=1 lb # [ 44.741251] niks3-server[915]: 2026/09/25 16:32:07 INFO Received complete push request method=POST path=/api/pushes/3/complete lb # [ 44.744650] niks3-server[915]: 2026/09/25 16:32:07 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 44.757129] niks3-server[915]: 2026/09/25 16:32:07 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker2 # [ 44.744880] nix-grpc-daemon[873]: time=2026-09-25T16:32:07.918Z level=INFO msg="Upload complete. (187ms)" worker2 # [ 44.749385] nix-grpc-daemon[803]: ts=2026-09-25T16:32:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 44.755578] nix-grpc-daemon[803]: ts=2026-09-25T16:32:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 44.767247] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 44.776266] nix-daemon[861]: reaped child process 914, status = succeeded worker2 # [ 44.783559] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 45.418359] nix-daemon[861]: reaped child process 923, status = succeeded worker2 # [ 45.502258] nix-daemon[861]: accepted connection from pid 939, user nix-grpc-daemon (trusted) worker2 # [ 45.513540] nix-daemon[861]: reaped child process 942, status = succeeded lb # [ 45.536848] niks3-server[915]: 2026/09/25 16:32:08 INFO Received push request method=POST path=/api/pushes worker2 # [ 45.528502] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.702Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 45.530285] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.704Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 45.574186] niks3-server[915]: 2026/09/25 16:32:08 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 45.588411] niks3-server[915]: 2026/09/25 16:32:08 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign worker2 # [ 45.577706] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.751Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.594844] niks3-server[915]: 2026/09/25 16:32:08 INFO Signed narinfos id=4 count=1 lb # [ 45.600118] niks3-server[915]: 2026/09/25 16:32:08 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 45.604633] niks3-server[915]: 2026/09/25 16:32:08 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 45.617153] niks3-server[915]: 2026/09/25 16:32:08 INFO Received complete push request method=POST path=/api/pushes/4/complete lb # [ 45.623398] niks3-server[915]: 2026/09/25 16:32:08 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker2 # [ 45.605629] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.779Z level=INFO msg="Upload complete. (214ms)" worker2 # [ 45.611965] nix-grpc-daemon[803]: ts=2026-09-25T16:32:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 45.623726] nix-grpc-daemon[511]: ts=2026-09-25T16:32:07Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 45.621811] nix-grpc-daemon[803]: ts=2026-09-25T16:32:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 45.628381] nix-grpc-daemon[511]: ts=2026-09-25T16:32:07Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.632096] nix-grpc-daemon[803]: ts=2026-09-25T16:32:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 45.641089] nix-daemon[861]: reaped child process 921, status = succeeded worker2 # [ 45.643756] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.817Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker2 # [ 45.650308] nix-grpc-daemon[803]: ts=2026-09-25T16:32:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 45.656712] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 45.739941] nix-daemon[861]: accepted connection from pid 946, user nix-grpc-daemon (trusted) worker2 # [ 45.753570] nix-daemon[861]: reaped child process 949, status = succeeded lb # [ 45.776165] niks3-server[915]: 2026/09/25 16:32:08 INFO Received push request method=POST path=/api/pushes worker2 # [ 45.767543] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.941Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.769025] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.943Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 45.808238] niks3-server[915]: 2026/09/25 16:32:08 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign lb # [ 45.814239] niks3-server[915]: 2026/09/25 16:32:08 INFO Signed narinfos id=5 count=1 worker2 # [ 45.800739] nix-grpc-daemon[873]: time=2026-09-25T16:32:08.974Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.824326] niks3-server[915]: 2026/09/25 16:32:08 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 45.835322] niks3-server[915]: 2026/09/25 16:32:09 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 45.841441] niks3-server[915]: 2026/09/25 16:32:09 INFO Received complete push request method=POST path=/api/pushes/5/complete lb # [ 45.851357] niks3-server[915]: 2026/09/25 16:32:09 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker2 # [ 45.838203] nix-grpc-daemon[873]: time=2026-09-25T16:32:09.012Z level=INFO msg="Upload complete. (175ms)" worker2 # [ 45.842395] nix-grpc-daemon[803]: ts=2026-09-25T16:32:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 45.848650] nix-grpc-daemon[803]: ts=2026-09-25T16:32:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 45.858522] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 45.868860] nix-daemon[861]: reaped child process 944, status = succeeded worker2 # [ 45.874462] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 lb # [ 47.067952] envoy[922]: conn peer=[2001:db8:1::1]:36290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=1551 lb # [ 47.071763] envoy[922]: conn peer=[2001:db8:1::1]:36304 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=361 ms=58 lb # [ 47.075222] envoy[922]: conn peer=[2001:db8:1::1]:44900 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=7 lb # [ 47.078488] envoy[922]: conn peer=[2001:db8:1::1]:44914 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 worker2 # [ 47.111867] nix-daemon[861]: reaped child process 953, status = succeeded worker2 # [ 47.190217] nix-daemon[861]: accepted connection from pid 969, user nix-grpc-daemon (trusted) worker2 # [ 47.203614] nix-daemon[861]: reaped child process 972, status = succeeded lb # [ 47.225568] niks3-server[915]: 2026/09/25 16:32:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 47.217886] nix-grpc-daemon[873]: time=2026-09-25T16:32:10.391Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.219570] nix-grpc-daemon[873]: time=2026-09-25T16:32:10.393Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 47.269917] niks3-server[915]: 2026/09/25 16:32:10 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign lb # [ 47.274199] niks3-server[915]: 2026/09/25 16:32:10 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 47.262311] nix-grpc-daemon[873]: time=2026-09-25T16:32:10.436Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.278789] niks3-server[915]: 2026/09/25 16:32:10 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 47.282196] niks3-server[915]: 2026/09/25 16:32:10 INFO Signed narinfos id=6 count=1 lb # [ 47.287556] niks3-server[915]: 2026/09/25 16:32:10 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 47.300327] niks3-server[915]: 2026/09/25 16:32:10 INFO Received complete push request method=POST path=/api/pushes/6/complete lb # [ 47.304274] niks3-server[915]: 2026/09/25 16:32:10 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker2 # [ 47.292828] nix-grpc-daemon[873]: time=2026-09-25T16:32:10.466Z level=INFO msg="Upload complete. (211ms)" worker2 # [ 47.299525] nix-grpc-daemon[803]: ts=2026-09-25T16:32:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 47.315214] nix-daemon[861]: reaped child process 951, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 4.31 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 4.84 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 48.322407] nix-grpc-daemon[803]: ts=2026-09-25T16:32:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55220 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # [ 48.339605] nix-grpc-daemon[803]: ts=2026-09-25T16:32:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 48.349097] nix-grpc-daemon[873]: time=2026-09-25T16:32:11.522Z level=INFO msg="All 2 paths already cached" worker1 # [ 48.368679] nix-grpc-daemon[511]: ts=2026-09-25T16:32:10Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.20 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.79 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 48.902908] nix-grpc-daemon[803]: ts=2026-09-25T16:32:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 48.909251] nix-grpc-daemon[803]: ts=2026-09-25T16:32:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 48.914963] nix-grpc-daemon[873]: time=2026-09-25T16:32:12.087Z level=INFO msg="All 2 paths already cached" worker1 # [ 48.927235] nix-grpc-daemon[511]: ts=2026-09-25T16:32:11Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker1 # [ 48.932382] nix-grpc-daemon[511]: ts=2026-09-25T16:32:11Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.933586] nix-grpc-daemon[803]: ts=2026-09-25T16:32:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 48.947706] nix-grpc-daemon[803]: ts=2026-09-25T16:32:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 48.965387] nix-grpc-daemon[873]: time=2026-09-25T16:32:12.139Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker2 # [ 48.972714] nix-grpc-daemon[803]: ts=2026-09-25T16:32:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 48.983340] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 49.079995] nix-daemon[861]: accepted connection from pid 998, user nix-grpc-daemon (trusted) worker2 # [ 49.093571] nix-daemon[861]: reaped child process 1001, status = succeeded lb # [ 49.116641] niks3-server[915]: 2026/09/25 16:32:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 49.108286] nix-grpc-daemon[873]: time=2026-09-25T16:32:12.282Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 49.109793] nix-grpc-daemon[873]: time=2026-09-25T16:32:12.283Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 49.156657] niks3-server[915]: 2026/09/25 16:32:12 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 49.159570] niks3-server[915]: 2026/09/25 16:32:12 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign worker2 # [ 49.150177] nix-grpc-daemon[873]: time=2026-09-25T16:32:12.324Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.165938] niks3-server[915]: 2026/09/25 16:32:12 INFO Signed narinfos id=7 count=1 lb # [ 49.173332] niks3-server[915]: 2026/09/25 16:32:12 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 49.184941] niks3-server[915]: 2026/09/25 16:32:12 INFO Received complete push request method=POST path=/api/pushes/7/complete lb # [ 49.192454] niks3-server[915]: 2026/09/25 16:32:12 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker2 # [ 49.179463] nix-grpc-daemon[873]: time=2026-09-25T16:32:12.353Z level=INFO msg="Upload complete. (183ms)" worker2 # [ 49.183751] nix-grpc-daemon[803]: ts=2026-09-25T16:32:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 49.190433] nix-grpc-daemon[803]: ts=2026-09-25T16:32:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 49.201242] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 49.211894] nix-daemon[861]: reaped child process 996, status = succeeded worker2 # [ 49.216284] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 50.252634] nix-daemon[861]: reaped child process 1005, status = succeeded worker2 # [ 50.334160] nix-daemon[861]: accepted connection from pid 1021, user nix-grpc-daemon (trusted) worker2 # [ 50.347763] nix-daemon[861]: reaped child process 1024, status = succeeded lb # [ 50.369962] niks3-server[915]: 2026/09/25 16:32:13 INFO Received push request method=POST path=/api/pushes worker2 # [ 50.364353] nix-grpc-daemon[873]: time=2026-09-25T16:32:13.538Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 50.366240] nix-grpc-daemon[873]: time=2026-09-25T16:32:13.540Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 50.414261] niks3-server[915]: 2026/09/25 16:32:13 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign lb # [ 50.424170] niks3-server[915]: 2026/09/25 16:32:13 INFO Signed narinfos id=8 count=1 worker2 # [ 50.412769] nix-grpc-daemon[873]: time=2026-09-25T16:32:13.586Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.434250] niks3-server[915]: 2026/09/25 16:32:13 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 50.439092] niks3-server[915]: 2026/09/25 16:32:13 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 50.447260] niks3-server[915]: 2026/09/25 16:32:13 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 50.454704] niks3-server[915]: 2026/09/25 16:32:13 INFO Received complete push request method=POST path=/api/pushes/8/complete lb # [ 50.462388] niks3-server[915]: 2026/09/25 16:32:13 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker2 # [ 50.444631] nix-grpc-daemon[873]: time=2026-09-25T16:32:13.618Z level=INFO msg="Upload complete. (220ms)" worker2 # [ 50.450648] nix-grpc-daemon[803]: ts=2026-09-25T16:32:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 50.466727] nix-daemon[861]: reaped child process 1003, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.72 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.05 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 worker1 # [ 50.849228] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36476 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 50.854666] nix-grpc-daemon[803]: ts=2026-09-25T16:32:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 50.879532] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker1 # [ 50.884784] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 50.889825] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 50.901151] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker1 # [ 50.912107] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 50.920853] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 50.942674] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=info event=niks3_push_started pid=929 worker1 # [ 51.067573] nix-grpc-daemon[929]: time=2026-09-25T16:32:13.365Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 51.159103] nix-daemon[870]: accepted connection from pid 942, user nix-grpc-daemon (trusted) worker1 # [ 51.172239] nix-daemon[870]: reaped child process 945, status = succeeded lb # [ 51.191323] niks3-server[915]: 2026/09/25 16:32:14 INFO Received push request method=POST path=/api/pushes worker1 # [ 51.186062] nix-grpc-daemon[929]: time=2026-09-25T16:32:13.484Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 51.187566] nix-grpc-daemon[929]: time=2026-09-25T16:32:13.486Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 51.228858] niks3-server[915]: 2026/09/25 16:32:14 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 51.235502] niks3-server[915]: 2026/09/25 16:32:14 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign lb # [ 51.240957] niks3-server[915]: 2026/09/25 16:32:14 INFO Signed narinfos id=9 count=1 worker1 # [ 51.231787] nix-grpc-daemon[929]: time=2026-09-25T16:32:13.529Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.252270] niks3-server[915]: 2026/09/25 16:32:14 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 51.261228] niks3-server[915]: 2026/09/25 16:32:14 INFO Received complete push request method=POST path=/api/pushes/9/complete worker1 # [ 51.259118] nix-grpc-daemon[929]: time=2026-09-25T16:32:13.557Z level=INFO msg="Upload complete. (187ms)" lb # [ 51.273194] niks3-server[915]: 2026/09/25 16:32:14 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 51.263126] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 51.268138] nix-grpc-daemon[511]: ts=2026-09-25T16:32:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 51.280290] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 51.281676] nix-daemon[870]: reaped child process 927, status = succeeded worker1 # [ 51.286771] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 52.323754] nix-daemon[870]: reaped child process 949, status = succeeded worker1 # [ 52.405348] nix-daemon[870]: accepted connection from pid 965, user nix-grpc-daemon (trusted) worker1 # [ 52.418372] nix-daemon[870]: reaped child process 968, status = succeeded lb # [ 52.437747] niks3-server[915]: 2026/09/25 16:32:15 INFO Received push request method=POST path=/api/pushes worker1 # [ 52.432815] nix-grpc-daemon[929]: time=2026-09-25T16:32:14.731Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.434471] nix-grpc-daemon[929]: time=2026-09-25T16:32:14.732Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 52.474204] niks3-server[915]: 2026/09/25 16:32:15 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 52.485182] niks3-server[915]: 2026/09/25 16:32:15 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign lb # [ 52.489918] niks3-server[915]: 2026/09/25 16:32:15 INFO Signed narinfos id=10 count=1 worker1 # [ 52.479997] nix-grpc-daemon[929]: time=2026-09-25T16:32:14.778Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.499587] niks3-server[915]: 2026/09/25 16:32:15 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 52.506516] niks3-server[915]: 2026/09/25 16:32:15 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 52.517165] niks3-server[915]: 2026/09/25 16:32:15 INFO Received complete push request method=POST path=/api/pushes/10/complete lb # [ 52.524577] niks3-server[915]: 2026/09/25 16:32:15 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker1 # [ 52.511517] nix-grpc-daemon[929]: time=2026-09-25T16:32:14.809Z level=INFO msg="Upload complete. (215ms)" worker1 # [ 52.517746] nix-grpc-daemon[511]: ts=2026-09-25T16:32:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 52.532087] nix-grpc-daemon[511]: ts=2026-09-25T16:32:14Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker1 # [ 52.536593] nix-grpc-daemon[511]: ts=2026-09-25T16:32:14Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.541226] nix-grpc-daemon[511]: ts=2026-09-25T16:32:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 52.550524] nix-daemon[870]: reaped child process 947, status = succeeded worker1 # [ 52.552314] nix-grpc-daemon[511]: ts=2026-09-25T16:32:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 52.657665] nix-grpc-daemon[929]: time=2026-09-25T16:32:14.956Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker1 # [ 52.667935] nix-grpc-daemon[511]: ts=2026-09-25T16:32:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 52.676492] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 52.785740] nix-daemon[870]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker1 # [ 52.801062] nix-daemon[870]: reaped child process 977, status = succeeded lb # [ 52.818171] niks3-server[915]: 2026/09/25 16:32:15 INFO Received push request method=POST path=/api/pushes worker1 # [ 52.812979] nix-grpc-daemon[929]: time=2026-09-25T16:32:15.111Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 52.814481] nix-grpc-daemon[929]: time=2026-09-25T16:32:15.113Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 52.847628] niks3-server[915]: 2026/09/25 16:32:16 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign lb # [ 52.853146] niks3-server[915]: 2026/09/25 16:32:16 INFO Signed narinfos id=11 count=1 worker1 # [ 52.843211] nix-grpc-daemon[929]: time=2026-09-25T16:32:15.141Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.861090] niks3-server[915]: 2026/09/25 16:32:16 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 52.870656] niks3-server[915]: 2026/09/25 16:32:16 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 52.881116] niks3-server[915]: 2026/09/25 16:32:16 INFO Received complete push request method=POST path=/api/pushes/11/complete worker1 # [ 52.879270] nix-grpc-daemon[929]: time=2026-09-25T16:32:15.177Z level=INFO msg="Upload complete. (188ms)" lb # [ 52.892812] niks3-server[915]: 2026/09/25 16:32:16 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker1 # [ 52.883726] nix-grpc-daemon[511]: ts=2026-09-25T16:32:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 52.889989] nix-grpc-daemon[511]: ts=2026-09-25T16:32:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 52.899516] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 52.910183] nix-daemon[870]: reaped child process 972, status = succeeded worker1 # [ 52.913449] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 54.158671] nix-daemon[870]: reaped child process 981, status = succeeded worker1 # [ 54.235663] nix-daemon[870]: accepted connection from pid 997, user nix-grpc-daemon (trusted) worker1 # [ 54.247161] nix-daemon[870]: reaped child process 1000, status = succeeded lb # [ 54.267931] niks3-server[915]: 2026/09/25 16:32:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 54.263965] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.562Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 54.265456] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.564Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 54.303227] niks3-server[915]: 2026/09/25 16:32:17 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign lb # [ 54.305743] niks3-server[915]: 2026/09/25 16:32:17 INFO Signed narinfos id=12 count=1 worker1 # [ 54.292861] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.591Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.309310] niks3-server[915]: 2026/09/25 16:32:17 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 54.312072] niks3-server[915]: 2026/09/25 16:32:17 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 54.317953] niks3-server[915]: 2026/09/25 16:32:17 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 54.322276] niks3-server[915]: 2026/09/25 16:32:17 INFO Received complete push request method=POST path=/api/pushes/12/complete worker1 # [ 54.316515] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.615Z level=INFO msg="Upload complete. (195ms)" lb # [ 54.329886] niks3-server[915]: 2026/09/25 16:32:17 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker1 # [ 54.320709] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 54.329924] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 54.332699] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 54.334452] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 54.339215] nix-daemon[870]: reaped child process 979, status = succeeded worker1 # [ 54.342945] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 54.348191] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.646Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 54.353287] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker1 # [ 54.364312] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 54.447138] nix-daemon[870]: accepted connection from pid 1006, user nix-grpc-daemon (trusted) worker1 # [ 54.460170] nix-daemon[870]: reaped child process 1009, status = succeeded lb # [ 54.479758] niks3-server[915]: 2026/09/25 16:32:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 54.474794] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.773Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 54.476246] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.774Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 54.506937] niks3-server[915]: 2026/09/25 16:32:17 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign worker1 # [ 54.505527] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.803Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.518939] niks3-server[915]: 2026/09/25 16:32:17 INFO Signed narinfos id=13 count=1 lb # [ 54.523576] niks3-server[915]: 2026/09/25 16:32:17 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 54.532143] niks3-server[915]: 2026/09/25 16:32:17 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 54.542477] niks3-server[915]: 2026/09/25 16:32:17 INFO Received complete push request method=POST path=/api/pushes/13/complete lb # [ 54.550905] niks3-server[915]: 2026/09/25 16:32:17 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker1 # [ 54.537564] nix-grpc-daemon[929]: time=2026-09-25T16:32:16.836Z level=INFO msg="Upload complete. (167ms)" worker1 # [ 54.541904] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 54.548131] nix-grpc-daemon[511]: ts=2026-09-25T16:32:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 54.556708] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 54.562294] nix-daemon[870]: reaped child process 1004, status = succeeded worker1 # [ 54.566992] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 56.004458] nix-daemon[870]: reaped child process 1013, status = succeeded worker1 # [ 56.089611] nix-daemon[870]: accepted connection from pid 1029, user nix-grpc-daemon (trusted) worker1 # [ 56.101549] nix-daemon[870]: reaped child process 1032, status = succeeded lb # [ 56.121816] niks3-server[915]: 2026/09/25 16:32:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 56.116985] nix-grpc-daemon[929]: time=2026-09-25T16:32:18.415Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 56.118576] nix-grpc-daemon[929]: time=2026-09-25T16:32:18.417Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 56.159195] niks3-server[915]: 2026/09/25 16:32:19 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 56.175616] niks3-server[915]: 2026/09/25 16:32:19 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign worker1 # [ 56.170642] nix-grpc-daemon[929]: time=2026-09-25T16:32:18.468Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.184120] niks3-server[915]: 2026/09/25 16:32:19 INFO Signed narinfos id=14 count=1 lb # [ 56.186117] niks3-server[915]: 2026/09/25 16:32:19 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 56.190536] niks3-server[915]: 2026/09/25 16:32:19 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 56.201394] niks3-server[915]: 2026/09/25 16:32:19 INFO Received complete push request method=POST path=/api/pushes/14/complete worker1 # [ 56.193263] nix-grpc-daemon[929]: time=2026-09-25T16:32:18.491Z level=INFO msg="Upload complete. (218ms)" lb # [ 56.208056] niks3-server[915]: 2026/09/25 16:32:19 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker1 # [ 56.201218] nix-grpc-daemon[511]: ts=2026-09-25T16:32:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 56.216750] nix-daemon[870]: reaped child process 1011, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.52 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 56.445434] nix-grpc-daemon[511]: ts=2026-09-25T16:32:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:44946 worker1 # [ 56.451646] nix-grpc-daemon[511]: ts=2026-09-25T16:32:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:44946 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.12 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 56.563788] nix-grpc-daemon[803]: ts=2026-09-25T16:32:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43116 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 56.589243] nix-grpc-daemon[803]: ts=2026-09-25T16:32:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:43116 worker2 # [ 56.595704] nix-grpc-daemon[803]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker2 # [ 56.609833] nix-grpc-daemon[803]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker2 # [ 56.621879] nix-grpc-daemon[803]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.20 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/873" client # removing stale temporary roots file "/nix/var/nix/temproots/819" client # removing stale temporary roots file "/nix/var/nix/temproots/860" client # removing stale temporary roots file "/nix/var/nix/temproots/896" client # removing stale temporary roots file "/nix/var/nix/temproots/852" client # removing stale temporary roots file "/nix/var/nix/temproots/804" client # removing stale temporary roots file "/nix/var/nix/temproots/840" client # removing stale temporary roots file "/nix/var/nix/temproots/881" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker1 # [ 56.897991] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36476 worker2 # [ 56.902788] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 56.912749] nix-grpc-daemon[873]: time=2026-09-25T16:32:20.086Z level=INFO msg="All 1 paths already cached" worker2 # [ 56.919087] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 56.930083] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36476 client # copying 3 paths... worker2 # [ 56.936708] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 56.956383] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 56.961915] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 56.960279] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 56.965740] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 56.971136] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 56.975760] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.34 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 6.30 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 57.024534] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: c3a551215c6f43fdb1ecf51043157845 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup lb # [ 57.069102] envoy[922]: conn peer=[2001:db8:1::1]:44916 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9447 tx=4312 ms=4177 lb # [ 57.072829] envoy[922]: conn peer=[2001:db8:1::1]:44926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=476 ms=56 lb # [ 57.076302] envoy[922]: conn peer=[2001:db8:1::1]:44938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4165 tx=1902 ms=1559 lb # [ 57.079836] envoy[922]: conn peer=[2001:db8:1::1]:44948 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9567 tx=4389 ms=5363 lb # [ 57.083323] envoy[922]: conn peer=[2001:db8:1::1]:58902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1034 tx=2872 ms=101 lb # [ 57.086869] envoy[922]: conn peer=[2001:db8:1::1]:58932 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=329 ms=28 lb # [ 57.090281] envoy[922]: conn peer=[2001:db8:1::1]:58916 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=36 lb # [ 57.093655] envoy[922]: conn peer=[2001:db8:1::1]:58906 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=410 ms=42 worker1 # [ 57.154725] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36476 client # [ 57.155812] nix[949]: don't know how to build these paths: client # [ 57.156763] nix[949]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 57.169650] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 57.168988] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 57.173997] nix-grpc-daemon[511]: ts=2026-09-25T16:32:19Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.181109] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 client # [ 57.189139] nix[949]: copying 1 paths to 'lb:50051'... client # [ 57.189947] nix[949]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 57.191761] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 57.202899] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 57.311771] nix-daemon[861]: accepted connection from pid 1031, user nix-grpc-daemon (trusted) worker2 # [ 57.325203] nix-daemon[861]: reaped child process 1034, status = succeeded lb # [ 57.348889] niks3-server[915]: 2026/09/25 16:32:20 INFO Received push request method=POST path=/api/pushes worker2 # [ 57.340327] nix-grpc-daemon[873]: time=2026-09-25T16:32:20.514Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.341767] nix-grpc-daemon[873]: time=2026-09-25T16:32:20.515Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 57.380358] niks3-server[915]: 2026/09/25 16:32:20 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign worker2 # [ 57.368478] nix-grpc-daemon[873]: time=2026-09-25T16:32:20.542Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.385278] niks3-server[915]: 2026/09/25 16:32:20 INFO Signed narinfos id=15 count=1 lb # [ 57.390751] niks3-server[915]: 2026/09/25 16:32:20 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 57.400553] niks3-server[915]: 2026/09/25 16:32:20 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 57.409966] niks3-server[915]: 2026/09/25 16:32:20 INFO Received complete push request method=POST path=/api/pushes/15/complete worker2 # [ 57.403370] nix-grpc-daemon[873]: time=2026-09-25T16:32:20.577Z level=INFO msg="Upload complete. (187ms)" lb # [ 57.421432] niks3-server[915]: 2026/09/25 16:32:20 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 57.406212] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 57.410720] nix-grpc-daemon[803]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 57.422173] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 57.426437] nix-daemon[861]: reaped child process 1029, status = succeeded worker2 # [ 57.431140] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # [ 57.429452] nix[949]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 58.077090] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 93d7fa666fbc4b8aa5fa6ab2c3614fbf client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.06 seconds) worker2 # [ 58.236488] nix-grpc-daemon[803]: ts=2026-09-25T16:32:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55220 client # [ 58.248348] nix[965]: this derivation will be built: worker1 # [ 58.257895] nix-grpc-daemon[511]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 58.268554] nix-grpc-daemon[511]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'... client # [ 58.278285] nix[965]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 58.291122] nix-grpc-daemon[511]: ts=2026-09-25T16:32:20Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 58.297105] nix-grpc-daemon[803]: ts=2026-09-25T16:32:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 client # [ 58.296456] nix[965]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.04 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 61.451706] nix-daemon[861]: reaped child process 1038, status = succeeded worker2 # [ 61.523857] nix-daemon[861]: accepted connection from pid 1068, user nix-grpc-daemon (trusted) worker2 # [ 61.536143] nix-daemon[861]: reaped child process 1071, status = succeeded lb # [ 61.560242] niks3-server[915]: 2026/09/25 16:32:24 INFO Received push request method=POST path=/api/pushes worker2 # [ 61.551665] nix-grpc-daemon[873]: time=2026-09-25T16:32:24.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 61.553534] nix-grpc-daemon[873]: time=2026-09-25T16:32:24.727Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 61.605163] niks3-server[915]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 61.613600] niks3-server[915]: 2026/09/25 16:32:24 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign lb # [ 61.618529] niks3-server[915]: 2026/09/25 16:32:24 INFO Signed narinfos id=16 count=1 worker2 # [ 61.605095] nix-grpc-daemon[873]: time=2026-09-25T16:32:24.779Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.626205] niks3-server[915]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 61.639152] niks3-server[915]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 61.641903] niks3-server[915]: 2026/09/25 16:32:24 INFO Received complete push request method=POST path=/api/pushes/16/complete lb # [ 61.651153] niks3-server[915]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 61.637695] nix-grpc-daemon[873]: time=2026-09-25T16:32:24.811Z level=INFO msg="Upload complete. (194ms)" worker2 # [ 61.644522] nix-grpc-daemon[803]: ts=2026-09-25T16:32:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 61.652278] nix-grpc-daemon[803]: ts=2026-09-25T16:32:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 61.666966] nix-daemon[861]: reaped child process 1036, status = succeeded client # [ 61.687127] systemd[1]: dedup1.service: Deactivated successfully. client # [ 61.691353] systemd[1]: dedup1.service: Consumed 114ms CPU time over 4.665s wall clock time, 43.5M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 61.697414] systemd[1]: dedup2.service: Deactivated successfully. client # [ 61.700651] systemd[1]: dedup2.service: Consumed 142ms CPU time over 3.623s wall clock time, 37.4M memory peak, 6.7K incoming IP traffic, 6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.72 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 62.864453] nix-grpc-daemon[803]: ts=2026-09-25T16:32:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 62.877626] nix-grpc-daemon[511]: ts=2026-09-25T16:32:25Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker1 # [ 62.883563] nix-grpc-daemon[511]: ts=2026-09-25T16:32:25Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 62.887884] nix-grpc-daemon[511]: ts=2026-09-25T16:32:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 62.899286] nix-grpc-daemon[511]: ts=2026-09-25T16:32:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 62.909721] nix-grpc-daemon[511]: ts=2026-09-25T16:32:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 62.920503] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 63.017744] nix-daemon[870]: accepted connection from pid 1064, user nix-grpc-daemon (trusted) worker1 # [ 63.031394] nix-daemon[870]: reaped child process 1067, status = succeeded lb # [ 63.049572] niks3-server[915]: 2026/09/25 16:32:26 INFO Received push request method=POST path=/api/pushes worker1 # [ 63.044959] nix-grpc-daemon[929]: time=2026-09-25T16:32:25.343Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 63.046959] nix-grpc-daemon[929]: time=2026-09-25T16:32:25.345Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 63.079209] niks3-server[915]: 2026/09/25 16:32:26 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign worker1 # [ 63.071472] nix-grpc-daemon[929]: time=2026-09-25T16:32:25.369Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.085256] niks3-server[915]: 2026/09/25 16:32:26 INFO Signed narinfos id=17 count=1 lb # [ 63.092636] niks3-server[915]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 63.104142] niks3-server[915]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 63.110347] niks3-server[915]: 2026/09/25 16:32:26 INFO Received complete push request method=POST path=/api/pushes/17/complete worker1 # [ 63.107748] nix-grpc-daemon[929]: time=2026-09-25T16:32:25.406Z level=INFO msg="Upload complete. (175ms)" lb # [ 63.121223] niks3-server[915]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker1 # [ 63.112096] nix-grpc-daemon[511]: ts=2026-09-25T16:32:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 63.118202] nix-grpc-daemon[511]: ts=2026-09-25T16:32:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 63.130177] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 63.137695] nix-daemon[870]: reaped child process 1062, status = succeeded worker1 # [ 63.142517] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) lb # [ 67.069869] envoy[922]: conn peer=[2001:db8:1::1]:58942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1615 tx=1785 ms=3425 lb # [ 67.073703] envoy[922]: conn peer=[2001:db8:1::1]:58940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2981 tx=1521 ms=4507 worker1 # [ 69.154320] nix-grpc-daemon[511]: ts=2026-09-25T16:32:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 69.167357] nix-daemon[870]: reaped child process 1069, status = succeeded worker1 # [ 69.168341] nix-daemon[870]: reaped child process 1071, status = succeeded worker2 # [ 69.309299] nix-grpc-daemon[803]: ts=2026-09-25T16:32:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 69.321223] nix-grpc-daemon[511]: ts=2026-09-25T16:32:31Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker1 # [ 69.325824] nix-grpc-daemon[511]: ts=2026-09-25T16:32:31Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 69.324311] nix-grpc-daemon[803]: ts=2026-09-25T16:32:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 69.336486] nix-grpc-daemon[803]: ts=2026-09-25T16:32:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 69.347424] nix-grpc-daemon[803]: ts=2026-09-25T16:32:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 69.358171] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 69.460655] nix-daemon[861]: accepted connection from pid 1084, user nix-grpc-daemon (trusted) worker2 # [ 69.475344] nix-daemon[861]: reaped child process 1087, status = succeeded lb # [ 69.496822] niks3-server[915]: 2026/09/25 16:32:32 INFO Received push request method=POST path=/api/pushes worker2 # [ 69.488421] nix-grpc-daemon[873]: time=2026-09-25T16:32:32.662Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 69.490325] nix-grpc-daemon[873]: time=2026-09-25T16:32:32.663Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 69.533679] niks3-server[915]: 2026/09/25 16:32:32 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 69.541402] niks3-server[915]: 2026/09/25 16:32:32 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign worker2 # [ 69.531487] nix-grpc-daemon[873]: time=2026-09-25T16:32:32.705Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.547955] niks3-server[915]: 2026/09/25 16:32:32 INFO Signed narinfos id=18 count=1 lb # [ 69.559839] niks3-server[915]: 2026/09/25 16:32:32 INFO Received complete push request method=POST path=/api/pushes/18/complete lb # [ 69.569981] niks3-server[915]: 2026/09/25 16:32:32 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 69.573330] niks3-server[915]: 2026/09/25 16:32:32 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker2 # [ 69.560597] nix-grpc-daemon[873]: time=2026-09-25T16:32:32.734Z level=INFO msg="Upload complete. (191ms)" worker2 # [ 69.565476] nix-grpc-daemon[803]: ts=2026-09-25T16:32:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 69.571312] nix-grpc-daemon[803]: ts=2026-09-25T16:32:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 69.583107] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 69.590203] nix-daemon[861]: reaped child process 1082, status = succeeded worker2 # [ 69.598531] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 75.411325] nix-grpc-daemon[803]: ts=2026-09-25T16:32:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 75.423445] nix-daemon[861]: reaped child process 1089, status = succeeded worker2 # [ 75.424472] nix-daemon[861]: reaped child process 1091, status = succeeded worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: --timeout and --max-silent-time reach the builder, in 12.90 seconds) subtest: a failing build is counted with its own reason worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 75.847514] nix-grpc-daemon[803]: ts=2026-09-25T16:32:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 75.861616] nix-grpc-daemon[511]: ts=2026-09-25T16:32:38Z level=debug event=want client=9 drv=j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv cached=0 worker1 # [ 75.867721] nix-grpc-daemon[511]: ts=2026-09-25T16:32:38Z level=debug event=assigned drv=j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.872152] nix-grpc-daemon[511]: ts=2026-09-25T16:32:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 75.883880] nix-grpc-daemon[511]: ts=2026-09-25T16:32:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 75.894813] nix-grpc-daemon[511]: ts=2026-09-25T16:32:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 75.905331] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 76.006196] nix-daemon[870]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker1 # [ 76.018944] nix-daemon[870]: reaped child process 1107, status = succeeded lb # [ 76.038457] niks3-server[915]: 2026/09/25 16:32:39 INFO Received push request method=POST path=/api/pushes worker1 # [ 76.034167] nix-grpc-daemon[929]: time=2026-09-25T16:32:38.332Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 76.036157] nix-grpc-daemon[929]: time=2026-09-25T16:32:38.334Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" lb # [ 76.069307] niks3-server[915]: 2026/09/25 16:32:39 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign worker1 # [ 76.063179] nix-grpc-daemon[929]: time=2026-09-25T16:32:38.361Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.075780] niks3-server[915]: 2026/09/25 16:32:39 INFO Signed narinfos id=19 count=1 lb # [ 76.083142] niks3-server[915]: 2026/09/25 16:32:39 INFO Registered completed upload object_key=nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst lb # [ 76.092885] niks3-server[915]: 2026/09/25 16:32:39 INFO Registered completed upload object_key=j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls lb # [ 76.103742] niks3-server[915]: 2026/09/25 16:32:39 INFO Received complete push request method=POST path=/api/pushes/19/complete worker1 # [ 76.098178] nix-grpc-daemon[929]: time=2026-09-25T16:32:38.396Z level=INFO msg="Upload complete. (180ms)" lb # [ 76.112488] niks3-server[915]: 2026/09/25 16:32:39 INFO Registered completed upload object_key=j5sh943zaa0qjagii0xkivjfb4c2c5p0.narinfo worker1 # [ 76.102589] nix-grpc-daemon[511]: ts=2026-09-25T16:32:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=400 worker1 # [ 76.108359] nix-grpc-daemon[511]: ts=2026-09-25T16:32:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 76.118582] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 76.130160] nix-daemon[870]: reaped child process 1102, status = succeeded worker1 # [ 76.133263] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) lb # [ 77.070536] envoy[922]: conn peer=[2001:db8:1::1]:33914 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=957 ms=6301 lb # [ 77.074370] envoy[922]: conn peer=[2001:db8:1::1]:33920 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=935 ms=6119 worker1 # [ 77.743784] nix-grpc-daemon[511]: ts=2026-09-25T16:32:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 drv=j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv assign_id=11 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 77.771766] nix-daemon[870]: reaped child process 1109, status = succeeded worker1 # [ 77.774625] nix-daemon[870]: reaped child process 1111, status = succeeded worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: a failing build is counted with its own reason, in 2.49 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 78.154609] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: c9b6d0bd81974a698be8d1d62f9e77fe client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share worker1 # [ 78.297214] nix-grpc-daemon[511]: ts=2026-09-25T16:32:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36476 client # [ 78.298427] nix[1055]: don't know how to build these paths: client # [ 78.299298] nix[1055]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 78.310924] nix-grpc-daemon[511]: ts=2026-09-25T16:32:40Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 78.315648] nix-grpc-daemon[511]: ts=2026-09-25T16:32:40Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 78.310898] nix-grpc-daemon[803]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 78.322981] nix-grpc-daemon[803]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 client # [ 78.331077] nix[1055]: copying 1 paths to 'lb:50051'... client # [ 78.331881] nix[1055]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 78.333602] nix-grpc-daemon[803]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 78.344856] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 78.445788] nix-daemon[861]: accepted connection from pid 1132, user nix-grpc-daemon (trusted) worker2 # [ 78.457670] nix-daemon[861]: reaped child process 1135, status = succeeded lb # [ 78.482242] niks3-server[915]: 2026/09/25 16:32:41 INFO Received push request method=POST path=/api/pushes worker2 # [ 78.474270] nix-grpc-daemon[873]: time=2026-09-25T16:32:41.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 78.476240] nix-grpc-daemon[873]: time=2026-09-25T16:32:41.649Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 78.510216] niks3-server[915]: 2026/09/25 16:32:41 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 78.520811] niks3-server[915]: 2026/09/25 16:32:41 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign lb # [ 78.525276] niks3-server[915]: 2026/09/25 16:32:41 INFO Signed narinfos id=20 count=1 worker2 # [ 78.512269] nix-grpc-daemon[873]: time=2026-09-25T16:32:41.686Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.535766] niks3-server[915]: 2026/09/25 16:32:41 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 78.546412] niks3-server[915]: 2026/09/25 16:32:41 INFO Received complete push request method=POST path=/api/pushes/20/complete lb # [ 78.556410] niks3-server[915]: 2026/09/25 16:32:41 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 78.539345] nix-grpc-daemon[873]: time=2026-09-25T16:32:41.713Z level=INFO msg="Upload complete. (183ms)" worker2 # [ 78.543229] nix-grpc-daemon[803]: ts=2026-09-25T16:32:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 78.548269] nix-grpc-daemon[803]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 78.559110] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 78.567354] nix-daemon[861]: reaped child process 1130, status = succeeded worker2 # [ 78.571532] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # [ 78.569908] nix[1055]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 79.222897] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: e87450d0ed5d4fc2ae161b7504aecffb client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 79.366084] nix[1071]: don't know how to build these paths: client # [ 79.366949] nix[1071]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 79.368963] nix-grpc-daemon[511]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 79.380262] nix-grpc-daemon[511]: ts=2026-09-25T16:32:41Z level=debug event=want client=11 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 79.379493] nix-grpc-daemon[803]: ts=2026-09-25T16:32:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 client # [ 79.380930] nix[1071]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 81.374341] systemd[1]: share1.service: Sent signal SIGINT to main process 1055 (nix) on client request. client # [ 81.381755] nix[1055]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.05 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 81.389309] nix[1055]: error: interrupted by the user client # [ 81.428907] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 81.430553] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 81.432485] systemd[1]: share1.service: Consumed 112ms CPU time over 3.276s wall clock time, 41.5M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 82.799710] nix-daemon[861]: reaped child process 1139, status = succeeded worker2 # [ 82.878769] nix-daemon[861]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 82.890863] nix-daemon[861]: reaped child process 1172, status = succeeded lb # [ 82.915270] niks3-server[915]: 2026/09/25 16:32:46 INFO Received push request method=POST path=/api/pushes worker2 # [ 82.906998] nix-grpc-daemon[873]: time=2026-09-25T16:32:46.080Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 82.909052] nix-grpc-daemon[873]: time=2026-09-25T16:32:46.082Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 82.966341] niks3-server[915]: 2026/09/25 16:32:46 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 82.972390] niks3-server[915]: 2026/09/25 16:32:46 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 82.979830] niks3-server[915]: 2026/09/25 16:32:46 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign lb # [ 82.984261] niks3-server[915]: 2026/09/25 16:32:46 INFO Signed narinfos id=21 count=1 worker2 # [ 82.970755] nix-grpc-daemon[873]: time=2026-09-25T16:32:46.144Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.996806] niks3-server[915]: 2026/09/25 16:32:46 INFO Received complete push request method=POST path=/api/pushes/21/complete lb # [ 82.999215] niks3-server[915]: 2026/09/25 16:32:46 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 83.004930] niks3-server[915]: 2026/09/25 16:32:46 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 82.987271] nix-grpc-daemon[873]: time=2026-09-25T16:32:46.161Z level=INFO msg="Upload complete. (205ms)" worker2 # [ 82.993982] nix-grpc-daemon[803]: ts=2026-09-25T16:32:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 83.002268] nix-grpc-daemon[803]: ts=2026-09-25T16:32:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 83.015430] nix-daemon[861]: reaped child process 1137, status = succeeded client # [ 83.022761] systemd[1]: share2.service: Deactivated successfully. client # [ 83.026844] systemd[1]: share2.service: Consumed 117ms CPU time over 3.802s wall clock time, 35.4M memory peak, 6.5K incoming IP traffic, 6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 5.64 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 83.833374] systemd[1]: Started Nix Daemon. client # [ 83.913850] nix-daemon[1123]: accepted connection from pid 1120, user root (trusted) worker1 # [ 84.023829] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36476 worker2 # [ 84.024967] nix-grpc-daemon[803]: ts=2026-09-25T16:32:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 84.038692] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=debug event=want client=12 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 84.044142] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 84.050354] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 84.058103] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 84.068878] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 84.074987] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 84.173511] nix-daemon[870]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker1 # [ 84.187295] nix-daemon[870]: reaped child process 1162, status = succeeded lb # [ 84.208435] niks3-server[915]: 2026/09/25 16:32:47 INFO Received push request method=POST path=/api/pushes worker1 # [ 84.203493] nix-grpc-daemon[929]: time=2026-09-25T16:32:46.501Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 84.205498] nix-grpc-daemon[929]: time=2026-09-25T16:32:46.503Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 84.239971] niks3-server[915]: 2026/09/25 16:32:47 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 84.247220] niks3-server[915]: 2026/09/25 16:32:47 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign lb # [ 84.251226] niks3-server[915]: 2026/09/25 16:32:47 INFO Signed narinfos id=22 count=1 worker1 # [ 84.241712] nix-grpc-daemon[929]: time=2026-09-25T16:32:46.540Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.260495] niks3-server[915]: 2026/09/25 16:32:47 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 84.270366] niks3-server[915]: 2026/09/25 16:32:47 INFO Received complete push request method=POST path=/api/pushes/22/complete lb # [ 84.280749] niks3-server[915]: 2026/09/25 16:32:47 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 84.266961] nix-grpc-daemon[929]: time=2026-09-25T16:32:46.565Z level=INFO msg="Upload complete. (187ms)" worker1 # [ 84.270825] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 84.275603] nix-grpc-daemon[511]: ts=2026-09-25T16:32:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 84.284871] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 84.290695] nix-daemon[870]: reaped child process 1157, status = succeeded worker1 # [ 84.294796] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 85.530458] nix-daemon[870]: reaped child process 1166, status = succeeded worker1 # [ 85.610653] nix-daemon[870]: accepted connection from pid 1182, user nix-grpc-daemon (trusted) worker1 # [ 85.622808] nix-daemon[870]: reaped child process 1185, status = succeeded lb # [ 85.646787] niks3-server[915]: 2026/09/25 16:32:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 85.642068] nix-grpc-daemon[929]: time=2026-09-25T16:32:47.940Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 85.643890] nix-grpc-daemon[929]: time=2026-09-25T16:32:47.942Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 85.688818] niks3-server[915]: 2026/09/25 16:32:48 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign lb # [ 85.692881] niks3-server[915]: 2026/09/25 16:32:48 INFO Signed narinfos id=23 count=1 worker1 # [ 85.682873] nix-grpc-daemon[929]: time=2026-09-25T16:32:47.981Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.703113] niks3-server[915]: 2026/09/25 16:32:48 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 85.707604] niks3-server[915]: 2026/09/25 16:32:48 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 85.716571] niks3-server[915]: 2026/09/25 16:32:48 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 85.723173] niks3-server[915]: 2026/09/25 16:32:48 INFO Received complete push request method=POST path=/api/pushes/23/complete worker1 # [ 85.719375] nix-grpc-daemon[929]: time=2026-09-25T16:32:48.017Z level=INFO msg="Upload complete. (216ms)" lb # [ 85.736474] niks3-server[915]: 2026/09/25 16:32:48 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 85.726924] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=13 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 85.734729] nix-grpc-daemon[803]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 85.742622] nix-daemon[870]: reaped child process 1164, status = succeeded worker2 # [ 85.745150] nix-grpc-daemon[803]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 85.774151] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 85.779615] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 85.944728] nix-grpc-daemon[803]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 85.951682] nix-grpc-daemon[803]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 85.961776] nix-grpc-daemon[873]: time=2026-09-25T16:32:49.135Z level=INFO msg="All 1 paths already cached" worker1 # [ 85.979175] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=debug event=want client=13 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 85.984769] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 85.990315] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 86.001657] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 86.014555] nix-grpc-daemon[929]: time=2026-09-25T16:32:48.313Z level=INFO msg="All 1 paths already cached" worker1 # [ 86.021759] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 86.031435] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 86.135982] nix-daemon[870]: accepted connection from pid 1191, user nix-grpc-daemon (trusted) worker1 # [ 86.149965] nix-daemon[870]: reaped child process 1194, status = succeeded lb # [ 86.170134] niks3-server[915]: 2026/09/25 16:32:49 INFO Received push request method=POST path=/api/pushes worker1 # [ 86.164663] nix-grpc-daemon[929]: time=2026-09-25T16:32:48.463Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 86.166665] nix-grpc-daemon[929]: time=2026-09-25T16:32:48.464Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 86.196187] niks3-server[915]: 2026/09/25 16:32:49 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 86.207111] niks3-server[915]: 2026/09/25 16:32:49 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign lb # [ 86.212514] niks3-server[915]: 2026/09/25 16:32:49 INFO Signed narinfos id=24 count=1 worker1 # [ 86.203106] nix-grpc-daemon[929]: time=2026-09-25T16:32:48.501Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.227773] niks3-server[915]: 2026/09/25 16:32:49 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 86.233243] niks3-server[915]: 2026/09/25 16:32:49 INFO Received complete push request method=POST path=/api/pushes/24/complete worker1 # [ 86.232228] nix-grpc-daemon[929]: time=2026-09-25T16:32:48.530Z level=INFO msg="Upload complete. (188ms)" lb # [ 86.245801] niks3-server[915]: 2026/09/25 16:32:49 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 86.237656] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 86.243952] nix-grpc-daemon[511]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 86.256259] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 86.265683] nix-daemon[870]: reaped child process 1189, status = succeeded worker1 # [ 86.270313] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) lb # [ 87.071523] envoy[922]: conn peer=[2001:db8:1::1]:42596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2879 tx=1269 ms=1916 lb # [ 87.075413] envoy[922]: conn peer=[2001:db8:1::1]:42600 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=772 ms=3109 lb # [ 87.078944] envoy[922]: conn peer=[2001:db8:1::1]:42602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1470 tx=1400 ms=3640 lb # [ 87.082618] envoy[922]: conn peer=[2001:db8:1::1]:38660 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=26 lb # [ 87.086523] envoy[922]: conn peer=[2001:db8:1::1]:38650 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3392 tx=1946 ms=1778 worker1 # [ 87.306730] nix-daemon[870]: reaped child process 1198, status = succeeded worker1 # [ 87.389511] nix-daemon[870]: accepted connection from pid 1214, user nix-grpc-daemon (trusted) worker1 # [ 87.400410] nix-daemon[870]: reaped child process 1217, status = succeeded lb # [ 87.423411] niks3-server[915]: 2026/09/25 16:32:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 87.418168] nix-grpc-daemon[929]: time=2026-09-25T16:32:49.716Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 87.419685] nix-grpc-daemon[929]: time=2026-09-25T16:32:49.718Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 87.466346] niks3-server[915]: 2026/09/25 16:32:50 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign lb # [ 87.473862] niks3-server[915]: 2026/09/25 16:32:50 INFO Signed narinfos id=25 count=1 worker1 # [ 87.464505] nix-grpc-daemon[929]: time=2026-09-25T16:32:49.762Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.482945] niks3-server[915]: 2026/09/25 16:32:50 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 87.487610] niks3-server[915]: 2026/09/25 16:32:50 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 87.497312] niks3-server[915]: 2026/09/25 16:32:50 INFO Received complete push request method=POST path=/api/pushes/25/complete lb # [ 87.504223] niks3-server[915]: 2026/09/25 16:32:50 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 87.512858] niks3-server[915]: 2026/09/25 16:32:50 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 87.499573] nix-grpc-daemon[929]: time=2026-09-25T16:32:49.798Z level=INFO msg="Upload complete. (221ms)" worker1 # [ 87.507601] nix-grpc-daemon[511]: ts=2026-09-25T16:32:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=14 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 87.517142] nix-grpc-daemon[511]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 87.527572] nix-grpc-daemon[511]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 87.531553] nix-grpc-daemon[511]: ts=2026-09-25T16:32:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 87.536563] nix-daemon[870]: reaped child process 1196, status = succeeded worker2 # [ 87.687488] nix-grpc-daemon[803]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 87.693521] nix-grpc-daemon[511]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 87.703801] nix-grpc-daemon[929]: time=2026-09-25T16:32:50.002Z level=INFO msg="All 2 paths already cached" worker1 # [ 87.718697] nix-grpc-daemon[511]: ts=2026-09-25T16:32:50Z level=debug event=want client=14 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 87.724730] nix-grpc-daemon[511]: ts=2026-09-25T16:32:50Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 87.729517] nix-grpc-daemon[511]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 87.740349] nix-grpc-daemon[511]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 87.752677] nix-grpc-daemon[929]: time=2026-09-25T16:32:50.051Z level=INFO msg="All 2 paths already cached" worker1 # [ 87.760643] nix-grpc-daemon[511]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 87.770155] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 87.872792] nix-daemon[870]: accepted connection from pid 1223, user nix-grpc-daemon (trusted) worker1 # [ 87.887058] nix-daemon[870]: reaped child process 1226, status = succeeded lb # [ 87.907095] niks3-server[915]: 2026/09/25 16:32:51 INFO Received push request method=POST path=/api/pushes worker1 # [ 87.902335] nix-grpc-daemon[929]: time=2026-09-25T16:32:50.200Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 87.904024] nix-grpc-daemon[929]: time=2026-09-25T16:32:50.202Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 87.936813] niks3-server[915]: 2026/09/25 16:32:51 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign worker1 # [ 87.930816] nix-grpc-daemon[929]: time=2026-09-25T16:32:50.229Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.945162] niks3-server[915]: 2026/09/25 16:32:51 INFO Signed narinfos id=26 count=1 lb # [ 87.950981] niks3-server[915]: 2026/09/25 16:32:51 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 87.960636] niks3-server[915]: 2026/09/25 16:32:51 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 87.971173] niks3-server[915]: 2026/09/25 16:32:51 INFO Received complete push request method=POST path=/api/pushes/26/complete lb # [ 87.979611] niks3-server[915]: 2026/09/25 16:32:51 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 87.969814] nix-grpc-daemon[929]: time=2026-09-25T16:32:50.268Z level=INFO msg="Upload complete. (187ms)" worker1 # [ 87.972961] nix-grpc-daemon[511]: ts=2026-09-25T16:32:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 87.977793] nix-grpc-daemon[511]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 87.990110] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 87.993905] nix-daemon[870]: reaped child process 1221, status = succeeded worker1 # [ 87.999212] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 89.214156] nix-daemon[870]: reaped child process 1230, status = succeeded worker1 # [ 89.292916] nix-daemon[870]: accepted connection from pid 1246, user nix-grpc-daemon (trusted) worker1 # [ 89.304196] nix-daemon[870]: reaped child process 1249, status = succeeded lb # [ 89.326514] niks3-server[915]: 2026/09/25 16:32:52 INFO Received push request method=POST path=/api/pushes worker1 # [ 89.321832] nix-grpc-daemon[929]: time=2026-09-25T16:32:51.620Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 89.323325] nix-grpc-daemon[929]: time=2026-09-25T16:32:51.621Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 89.370873] niks3-server[915]: 2026/09/25 16:32:52 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 89.378917] niks3-server[915]: 2026/09/25 16:32:52 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign worker1 # [ 89.371695] nix-grpc-daemon[929]: time=2026-09-25T16:32:51.670Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.384439] niks3-server[915]: 2026/09/25 16:32:52 INFO Signed narinfos id=27 count=1 lb # [ 89.392134] niks3-server[915]: 2026/09/25 16:32:52 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 89.396475] niks3-server[915]: 2026/09/25 16:32:52 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 89.404185] niks3-server[915]: 2026/09/25 16:32:52 INFO Received complete push request method=POST path=/api/pushes/27/complete lb # [ 89.411775] niks3-server[915]: 2026/09/25 16:32:52 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 89.398445] nix-grpc-daemon[929]: time=2026-09-25T16:32:51.696Z level=INFO msg="Upload complete. (192ms)" worker1 # [ 89.406542] nix-grpc-daemon[511]: ts=2026-09-25T16:32:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=15 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 89.407549] nix-grpc-daemon[803]: ts=2026-09-25T16:32:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 89.421771] nix-daemon[870]: reaped child process 1228, status = succeeded worker2 # [ 89.419825] nix-grpc-daemon[803]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 89.429863] nix-grpc-daemon[803]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 89.451420] nix-grpc-daemon[803]: ts=2026-09-25T16:32:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 89.456432] nix-grpc-daemon[803]: ts=2026-09-25T16:32:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_out=232 client # [ 89.533711] nix-daemon[1123]: reaped child process 1125, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.79 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.84 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.22 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 90.156699] nix-daemon[1123]: accepted connection from pid 1205, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker1 # [ 90.273635] nix-grpc-daemon[511]: ts=2026-09-25T16:32:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36476 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 90.279684] nix-grpc-daemon[511]: ts=2026-09-25T16:32:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 90.384703] nix-daemon[870]: accepted connection from pid 1256, user nix-grpc-daemon (trusted) worker1 # [ 90.396524] nix-daemon[870]: reaped child process 1259, status = succeeded lb # [ 90.417172] niks3-server[915]: 2026/09/25 16:32:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 90.412266] nix-grpc-daemon[929]: time=2026-09-25T16:32:52.710Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 90.414196] nix-grpc-daemon[929]: time=2026-09-25T16:32:52.712Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 90.449352] niks3-server[915]: 2026/09/25 16:32:53 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign lb # [ 90.452718] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 90.449028] nix-grpc-daemon[929]: time=2026-09-25T16:32:52.747Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.463513] niks3-server[915]: 2026/09/25 16:32:53 INFO Signed narinfos id=28 count=1 lb # [ 90.467983] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 90.480657] niks3-server[915]: 2026/09/25 16:32:53 INFO Received complete push request method=POST path=/api/pushes/28/complete worker1 # [ 90.475738] nix-grpc-daemon[929]: time=2026-09-25T16:32:52.774Z level=INFO msg="Upload complete. (197ms)" lb # [ 90.491314] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker1 # [ 90.495550] nix-grpc-daemon[511]: ts=2026-09-25T16:32:52Z level=debug event=want client=15 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 90.495263] nix-grpc-daemon[803]: ts=2026-09-25T16:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 90.499995] nix-grpc-daemon[511]: ts=2026-09-25T16:32:52Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 90.505332] nix-grpc-daemon[803]: ts=2026-09-25T16:32:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 90.519704] nix-grpc-daemon[803]: ts=2026-09-25T16:32:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 90.531644] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 90.641333] nix-daemon[861]: accepted connection from pid 1182, user nix-grpc-daemon (trusted) worker2 # [ 90.654754] nix-daemon[861]: reaped child process 1185, status = succeeded lb # [ 90.677709] niks3-server[915]: 2026/09/25 16:32:53 INFO Received push request method=POST path=/api/pushes worker2 # [ 90.670610] nix-grpc-daemon[873]: time=2026-09-25T16:32:53.844Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 90.673169] nix-grpc-daemon[873]: time=2026-09-25T16:32:53.846Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker2 # [ 90.675234] nix-grpc-daemon[873]: time=2026-09-25T16:32:53.846Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 90.719514] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 90.726424] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 90.738760] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 90.744884] niks3-server[915]: 2026/09/25 16:32:53 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign lb # [ 90.748574] niks3-server[915]: 2026/09/25 16:32:53 INFO Signed narinfos id=29 count=2 worker2 # [ 90.735400] nix-grpc-daemon[873]: time=2026-09-25T16:32:53.908Z level=INFO msg="Uploading 2 narinfos" lb # [ 90.756256] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 90.762976] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 90.765728] niks3-server[915]: 2026/09/25 16:32:53 INFO Received complete push request method=POST path=/api/pushes/29/complete worker2 # [ 90.755885] nix-grpc-daemon[873]: time=2026-09-25T16:32:53.929Z level=INFO msg="Upload complete. (208ms)" lb # [ 90.774308] niks3-server[915]: 2026/09/25 16:32:53 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo worker2 # [ 90.761569] nix-grpc-daemon[803]: ts=2026-09-25T16:32:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 90.767100] nix-grpc-daemon[803]: ts=2026-09-25T16:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 90.779114] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 90.787179] nix-daemon[861]: reaped child process 1180, status = succeeded worker2 # [ 90.796528] nix-grpc-daemon[803]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 90.803514] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 92.218889] nix-daemon[861]: reaped child process 1190, status = succeeded worker2 # [ 92.293616] nix-daemon[861]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker2 # [ 92.304988] nix-daemon[861]: reaped child process 1209, status = succeeded lb # [ 92.328761] niks3-server[915]: 2026/09/25 16:32:55 INFO Received push request method=POST path=/api/pushes worker2 # [ 92.321647] nix-grpc-daemon[873]: time=2026-09-25T16:32:55.495Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 92.361941] niks3-server[915]: 2026/09/25 16:32:55 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign worker2 # [ 92.354610] nix-grpc-daemon[873]: time=2026-09-25T16:32:55.528Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.370709] niks3-server[915]: 2026/09/25 16:32:55 INFO Signed narinfos id=30 count=1 lb # [ 92.378450] niks3-server[915]: 2026/09/25 16:32:55 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 92.384709] niks3-server[915]: 2026/09/25 16:32:55 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 92.393703] niks3-server[915]: 2026/09/25 16:32:55 INFO Received complete push request method=POST path=/api/pushes/30/complete worker2 # [ 92.384527] nix-grpc-daemon[873]: time=2026-09-25T16:32:55.558Z level=INFO msg="Upload complete. (173ms)" lb # [ 92.406159] niks3-server[915]: 2026/09/25 16:32:55 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 92.389820] nix-grpc-daemon[803]: ts=2026-09-25T16:32:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=1 input_bytes=120 input_s=0 client # copying 1 paths... worker2 # [ 92.396938] nix-grpc-daemon[803]: ts=2026-09-25T16:32:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 92.406859] nix-daemon[861]: reaped child process 1187, status = succeeded worker1 # [ 92.421710] nix-grpc-daemon[511]: ts=2026-09-25T16:32:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 92.432707] nix-grpc-daemon[511]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... worker1 # [ 92.445347] nix-grpc-daemon[511]: ts=2026-09-25T16:32:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_out=120 client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.46 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 92.517748] nix-daemon[1123]: reaped child process 1208, status = succeeded client # [ 92.600919] nix-daemon[1123]: accepted connection from pid 1227, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 92.709769] nix-grpc-daemon[803]: ts=2026-09-25T16:32:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55220 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 92.717310] nix-grpc-daemon[511]: ts=2026-09-25T16:32:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 92.727189] nix-grpc-daemon[929]: time=2026-09-25T16:32:55.025Z level=INFO msg="All 1 paths already cached" worker1 # [ 92.741200] nix-grpc-daemon[511]: ts=2026-09-25T16:32:55Z level=debug event=want client=16 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 92.746789] nix-grpc-daemon[511]: ts=2026-09-25T16:32:55Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 92.752880] nix-grpc-daemon[511]: ts=2026-09-25T16:32:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 92.763730] nix-grpc-daemon[511]: ts=2026-09-25T16:32:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 92.780205] nix-grpc-daemon[511]: ts=2026-09-25T16:32:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 92.791177] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 92.806169] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5) worker1 # [ 92.891701] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 2/5) worker1 # [ 92.944692] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 301 ms (attempt 3/5) worker1 # [ 93.247893] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 586 ms (attempt 4/5) worker1 # [ 93.836902] nix-grpc-daemon[511]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 93.841275] nix-grpc-daemon[511]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 93.846983] nix-grpc-daemon[511]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 93.965447] nix-daemon[870]: accepted connection from pid 1273, user nix-grpc-daemon (trusted) worker1 # [ 93.982410] nix-daemon[870]: reaped child process 1276, status = succeeded lb # [ 93.999913] niks3-server[915]: 2026/09/25 16:32:57 INFO Received push request method=POST path=/api/pushes worker1 # [ 93.995418] nix-grpc-daemon[929]: time=2026-09-25T16:32:56.293Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 93.996959] nix-grpc-daemon[929]: time=2026-09-25T16:32:56.295Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 94.031779] niks3-server[915]: 2026/09/25 16:32:57 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign worker1 # [ 94.026741] nix-grpc-daemon[929]: time=2026-09-25T16:32:56.325Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.039245] niks3-server[915]: 2026/09/25 16:32:57 INFO Signed narinfos id=31 count=1 lb # [ 94.043835] niks3-server[915]: 2026/09/25 16:32:57 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 94.057889] niks3-server[915]: 2026/09/25 16:32:57 INFO Received complete push request method=POST path=/api/pushes/31/complete lb # [ 94.065426] niks3-server[915]: 2026/09/25 16:32:57 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls worker1 # [ 94.059561] nix-grpc-daemon[929]: time=2026-09-25T16:32:56.358Z level=INFO msg="Upload complete. (193ms)" lb # [ 94.074153] niks3-server[915]: 2026/09/25 16:32:57 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 94.064422] nix-grpc-daemon[511]: ts=2026-09-25T16:32:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=1 paths=1 nar_bytes_in=560 worker1 # [ 94.071490] nix-grpc-daemon[511]: ts=2026-09-25T16:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 94.082479] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) worker1 # [ 94.092632] nix-daemon[870]: reaped child process 1266, status = succeeded worker1 # [ 94.097694] nix-daemon[870]: accepted connection from pid 511, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 94.733906] nix-daemon[870]: reaped child process 1280, status = succeeded worker1 # [ 94.815454] nix-daemon[870]: accepted connection from pid 1296, user nix-grpc-daemon (trusted) worker1 # [ 94.828310] nix-daemon[870]: reaped child process 1299, status = succeeded lb # [ 94.847304] niks3-server[915]: 2026/09/25 16:32:58 INFO Received push request method=POST path=/api/pushes worker1 # [ 94.842587] nix-grpc-daemon[929]: time=2026-09-25T16:32:57.141Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 94.877114] niks3-server[915]: 2026/09/25 16:32:58 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign lb # [ 94.883645] niks3-server[915]: 2026/09/25 16:32:58 INFO Signed narinfos id=32 count=1 worker1 # [ 94.875629] nix-grpc-daemon[929]: time=2026-09-25T16:32:57.174Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.892870] niks3-server[915]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 94.896603] niks3-server[915]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 94.905820] niks3-server[915]: 2026/09/25 16:32:58 INFO Received complete push request method=POST path=/api/pushes/32/complete lb # [ 94.914717] niks3-server[915]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker1 # [ 94.901171] nix-grpc-daemon[929]: time=2026-09-25T16:32:57.199Z level=INFO msg="Upload complete. (197ms)" worker1 # [ 94.906870] nix-grpc-daemon[511]: ts=2026-09-25T16:32:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=17 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 client # copying 1 paths... worker1 # [ 94.920477] nix-daemon[870]: reaped child process 1278, status = succeeded worker2 # [ 94.914448] nix-grpc-daemon[803]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 94.922703] nix-grpc-daemon[803]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 94.952602] nix-grpc-daemon[511]: ts=2026-09-25T16:32:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 94.957939] nix-grpc-daemon[511]: ts=2026-09-25T16:32:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36476 duration_s=0 paths=1 nar_bytes_out=120 client # [ 95.021494] nix-daemon[1123]: reaped child process 1230, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.52 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 95.121097] nix-daemon[1123]: accepted connection from pid 1249, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 95.239159] nix-grpc-daemon[803]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:55220 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 95.250733] nix-grpc-daemon[511]: ts=2026-09-25T16:32:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 95.261298] nix-grpc-daemon[929]: time=2026-09-25T16:32:57.559Z level=INFO msg="All 1 paths already cached" worker1 # [ 95.275769] nix-grpc-daemon[511]: ts=2026-09-25T16:32:57Z level=debug event=want client=17 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 95.275098] nix-grpc-daemon[803]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker1 # [ 95.281375] nix-grpc-daemon[511]: ts=2026-09-25T16:32:57Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 95.287951] nix-grpc-daemon[803]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 95.301310] nix-grpc-daemon[873]: time=2026-09-25T16:32:58.474Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 95.308706] nix-grpc-daemon[803]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 95.319571] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 95.416599] nix-daemon[861]: accepted connection from pid 1214, user nix-grpc-daemon (trusted) worker2 # [ 95.429186] nix-daemon[861]: reaped child process 1217, status = succeeded lb # [ 95.454118] niks3-server[915]: 2026/09/25 16:32:58 INFO Received push request method=POST path=/api/pushes worker2 # [ 95.445068] nix-grpc-daemon[873]: time=2026-09-25T16:32:58.618Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 95.446414] nix-grpc-daemon[873]: time=2026-09-25T16:32:58.618Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 95.480682] niks3-server[915]: 2026/09/25 16:32:58 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign lb # [ 95.482961] niks3-server[915]: 2026/09/25 16:32:58 INFO Signed narinfos id=33 count=1 worker2 # [ 95.466696] nix-grpc-daemon[873]: time=2026-09-25T16:32:58.640Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.485520] niks3-server[915]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 95.491387] niks3-server[915]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 95.493218] niks3-server[915]: 2026/09/25 16:32:58 INFO Received complete push request method=POST path=/api/pushes/33/complete worker2 # [ 95.483733] nix-grpc-daemon[873]: time=2026-09-25T16:32:58.657Z level=INFO msg="Upload complete. (152ms)" worker2 # [ 95.485823] nix-grpc-daemon[803]: ts=2026-09-25T16:32:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 95.503349] niks3-server[915]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 95.489486] nix-grpc-daemon[803]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 95.495694] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) worker2 # [ 95.497984] nix-daemon[861]: reaped child process 1212, status = succeeded worker2 # [ 95.503178] nix-daemon[861]: accepted connection from pid 803, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 96.917427] nix-daemon[861]: reaped child process 1221, status = succeeded worker2 # [ 96.993643] nix-daemon[861]: accepted connection from pid 1237, user nix-grpc-daemon (trusted) worker2 # [ 97.006292] nix-daemon[861]: reaped child process 1240, status = succeeded lb # [ 97.029827] niks3-server[915]: 2026/09/25 16:33:00 INFO Received push request method=POST path=/api/pushes worker2 # [ 97.022435] nix-grpc-daemon[873]: time=2026-09-25T16:33:00.196Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 97.064157] niks3-server[915]: 2026/09/25 16:33:00 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign lb # [ 97.069088] niks3-server[915]: 2026/09/25 16:33:00 INFO Signed narinfos id=34 count=1 worker2 # [ 97.056180] nix-grpc-daemon[873]: time=2026-09-25T16:33:00.230Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.074627] envoy[922]: conn peer=[2001:db8:1::1]:38668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3876 tx=2160 ms=1594 lb # [ 97.079163] envoy[922]: conn peer=[2001:db8:1::1]:38674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=17 lb # [ 97.083983] envoy[922]: conn peer=[2001:db8:1::1]:38690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=21 lb # [ 97.086846] envoy[922]: conn peer=[2001:db8:1::1]:38682 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4285 tx=2368 ms=1786 lb # [ 97.089559] envoy[922]: conn peer=[2001:db8:1::1]:38692 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3833 tx=2024 ms=2183 lb # [ 97.092305] envoy[922]: conn peer=[2001:db8:1::1]:38700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=460 tx=308 ms=37 lb # [ 97.096193] envoy[922]: conn peer=[2001:db8:1::1]:38706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=2108 ms=2255 lb # [ 97.099169] envoy[922]: conn peer=[2001:db8:1::1]:40670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=17 lb # [ 97.102344] niks3-server[915]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 97.109237] niks3-server[915]: 2026/09/25 16:33:00 INFO Received complete push request method=POST path=/api/pushes/34/complete lb # [ 97.111699] niks3-server[915]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 97.115566] niks3-server[915]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 97.098544] nix-grpc-daemon[873]: time=2026-09-25T16:33:00.272Z level=INFO msg="Upload complete. (188ms)" client # copying 1 paths... worker2 # [ 97.104716] nix-grpc-daemon[803]: ts=2026-09-25T16:33:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=18 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 97.113968] nix-grpc-daemon[803]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:55220 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 97.125118] nix-daemon[861]: reaped child process 1219, status = succeeded worker2 # [ 97.131901] nix-grpc-daemon[803]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55220 worker2 # [ 97.135914] nix-grpc-daemon[803]: ts=2026-09-25T16:33:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55220 duration_s=0 paths=1 nar_bytes_out=120 client # [ 97.203775] nix-daemon[1123]: reaped child process 1252, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.18 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.61 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds) worker2 # [ 97.947316] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 97.954109] nix-grpc-daemon[803]: ts=2026-09-25T16:33:01Z level=info event=signal_exit worker1 # [ 99.956597] nix-grpc-daemon[511]: ts=2026-09-25T16:33:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36452 worker1 # [ 99.960262] nix-grpc-daemon[511]: ts=2026-09-25T16:33:02Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 99.948621] nix-grpc-daemon[803]: ts=2026-09-25T16:33:03Z level=info event=scheduler_restarting worker2 # [ 99.967824] nix-grpc-daemon[803]: ts=2026-09-25T16:33:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 99.987736] nix-daemon[861]: reaped child process 863, status = succeeded worker2 # [ 100.162450] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 100.166299] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 100.170738] systemd[1]: nix-grpc-daemon.service: Consumed 2.012s CPU time over 1min 7.372s wall clock time, 65.8M memory peak, 174K incoming IP traffic, 342.4K outgoing IP traffic. lb: waiting until exactly ['worker1'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1'] are healthy members of x86_64-linux, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 100.383982] nix-grpc-daemon[511]: ts=2026-09-25T16:33:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36476 worker1 # [ 100.390697] nix-grpc-daemon[511]: ts=2026-09-25T16:33:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36476 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.17 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 100.467515] systemd[1]: Starting scheduler-token.service... worker2 # [ 100.502305] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 100.503972] systemd[1]: Finished scheduler-token.service. worker2 # [ 100.505364] systemd[1]: scheduler-token.service: Consumed 15ms CPU time over 36ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 100.509509] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 100.584291] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 100.588712] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 100.591639] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 100.595410] nix-grpc-daemon[1264]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 100.596744] nix-grpc-daemon[1264]: E0000 00:00:1790353983.765665 1264 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 100.598960] nix-grpc-daemon[1264]: E0000 00:00:1790353983.769293 1264 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 100.601681] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:03Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 100.605121] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 100.613081] nix-grpc-daemon[1264]: E0000 00:00:1790353983.784763 1304 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 100.624088] nix-grpc-daemon[1264]: E0000 00:00:1790353983.798167 1304 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 100.627129] nix-grpc-daemon[1264]: E0000 00:00:1790353983.800470 1304 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 100.638343] nix-grpc-daemon[1264]: E0000 00:00:1790353983.812381 1304 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 100.647760] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.655060] nix-grpc-daemon[511]: ts=2026-09-25T16:33:02Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36452 worker1 # [ 100.662275] nix-grpc-daemon[511]: ts=2026-09-25T16:33:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 100.676910] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 100.806635] nix-grpc-daemon[511]: ts=2026-09-25T16:33:03Z level=info event=signal_exit lb # [ 101.598868] niks3-server[915]: 2026/09/25 16:33:04 INFO lead: released remote=192.168.1.3:43950 worker2 # [ 102.585319] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:05Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 102.589688] nix-grpc-daemon[511]: ts=2026-09-25T16:33:04Z level=info event=scheduler_restarting lb # [ 102.600441] envoy[922]: [2026-09-25 16:33:05.764][922][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 102.592638] nix-grpc-daemon[511]: ts=2026-09-25T16:33:04Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 102.597957] nix-grpc-daemon[511]: ts=2026-09-25T16:33:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36452 worker1 # [ 102.603506] nix-grpc-daemon[511]: ts=2026-09-25T16:33:04Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 102.606924] nix-grpc-daemon[511]: ts=2026-09-25T16:33:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36452 worker1 # [ 102.610700] nix-grpc-daemon[511]: ts=2026-09-25T16:33:04Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 102.634248] nix-daemon[870]: reaped child process 873, status = succeeded worker2 # [ 102.785761] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.789833] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.805391] nix-grpc-daemon[511]: ts=2026-09-25T16:33:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 102.990650] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.994599] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.195615] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.199556] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.400749] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.404618] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.606180] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.609924] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.811342] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.815250] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.016291] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.020225] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.129856] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 104.133579] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 104.136889] systemd[1]: nix-grpc-daemon.service: Consumed 2.420s CPU time over 1min 35.625s wall clock time, 66.6M memory peak, 443.8K incoming IP traffic, 435.7K outgoing IP traffic. lb: waiting until exactly ['worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker2'] are healthy members of x86_64-linux, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 104.221332] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.226278] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.343155] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 104.354954] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 104.371247] nix-grpc-daemon[1264]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5) worker2 # [ 104.388452] nix-grpc-daemon[1264]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 2/5) worker2 # [ 104.427511] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.431325] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.513553] nix-grpc-daemon[1264]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 3/5) worker2 # [ 104.582215] nix-grpc-daemon[1264]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 358 ms (attempt 4/5) worker2 # [ 104.633087] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.636817] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.838178] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.842348] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.942786] nix-grpc-daemon[1264]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 104.946317] nix-grpc-daemon[1264]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 104.968131] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 104.980365] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 105.004437] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=niks3_push_started pid=1324 worker2 # [ 105.044802] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.046385] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.110214] nix-grpc-daemon[1324]: time=2026-09-25T16:33:08.282Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 105.195097] nix-daemon[861]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 105.206803] nix-daemon[861]: reaped child process 1340, status = succeeded lb # [ 105.231184] niks3-server[915]: 2026/09/25 16:33:08 INFO Received push request method=POST path=/api/pushes worker2 # [ 105.223492] nix-grpc-daemon[1324]: time=2026-09-25T16:33:08.397Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 105.225080] nix-grpc-daemon[1324]: time=2026-09-25T16:33:08.399Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 105.227724] nix-grpc-daemon[1324]: time=2026-09-25T16:33:08.401Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 105.246922] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.248539] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 105.286100] niks3-server[915]: 2026/09/25 16:33:08 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign worker2 # [ 105.279067] nix-grpc-daemon[1324]: time=2026-09-25T16:33:08.452Z level=INFO msg="Uploading 2 narinfos" lb # [ 105.296142] niks3-server[915]: 2026/09/25 16:33:08 INFO Signed narinfos id=35 count=2 lb # [ 105.301831] niks3-server[915]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 105.307730] niks3-server[915]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 105.323363] niks3-server[915]: 2026/09/25 16:33:08 INFO Received complete push request method=POST path=/api/pushes/35/complete lb # [ 105.326976] niks3-server[915]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 105.329035] niks3-server[915]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 105.333613] niks3-server[915]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo worker2 # [ 105.316227] nix-grpc-daemon[1324]: time=2026-09-25T16:33:08.490Z level=INFO msg="Upload complete. (206ms)" lb # [ 105.336620] niks3-server[915]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls worker2 # [ 105.321625] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 105.334612] nix-daemon[861]: reaped child process 1322, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.15 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 105.418866] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 105.449729] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.453734] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.508338] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:07Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 105.510492] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 105.513773] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 105.518057] nix-grpc-daemon[1324]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 105.519388] nix-grpc-daemon[1324]: E0000 00:00:1790353987.816452 1324 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 105.523152] nix-grpc-daemon[1324]: E0000 00:00:1790353987.821623 1324 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 105.526733] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:07Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 105.529910] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 105.534798] nix-grpc-daemon[1324]: E0000 00:00:1790353987.833402 1366 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 105.548854] niks3-server[915]: 2026/09/25 16:33:08 INFO lead: acquired remote=192.168.1.3:36914 worker1 # [ 105.540252] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:07Z level=info event=scheduler_take_over lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 105.549356] nix-grpc-daemon[1324]: E0000 00:00:1790353987.847907 1366 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 105.553129] nix-grpc-daemon[1324]: E0000 00:00:1790353987.850073 1366 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 105.563672] nix-grpc-daemon[1324]: E0000 00:00:1790353987.861733 1366 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 105.577649] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.579540] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2 # [ 105.655335] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.658934] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.780591] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.784576] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.857445] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.861329] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.985470] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.989493] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.062337] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.066277] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.190657] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.194595] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.267210] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.282174] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 106.286224] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52270 worker1 # [ 106.290124] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 106.395523] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.400476] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:52270 worker1 # [ 106.404076] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 1.11 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.44 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 106.741800] systemd[1]: Stopping niks3 server... lb # [ 106.742850] niks3-server[915]: 2026/09/25 16:33:09 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 106.747101] niks3-server[915]: 2026/09/25 16:33:09 INFO lead: released remote=192.168.1.3:36914 worker2 # [ 106.731597] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:09Z level=info event=scheduler_lock_lost status=200 worker1 # [ 106.739503] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:09Z level=info event=scheduler_lock_lost status=200 lb # [ 106.764754] systemd[1]: niks3.service: Deactivated successfully. lb # [ 106.766331] systemd[1]: Stopped niks3 server. lb # [ 106.767150] systemd[1]: niks3.service: Consumed 761ms CPU time over 1min 30.618s wall clock time, 29.2M memory peak, 99.1K incoming IP traffic, 142.6K outgoing IP traffic. lb # [ 106.774468] systemd[1]: Starting niks3 server... lb # [ 106.823363] niks3-server[1130]: 2026/09/25 16:33:09 goose: no migrations to run. current version: 20260923120000 lb # [ 106.829173] niks3-server[1130]: 2026/09/25 16:33:09 OK 1_commit_pending_closure.sql (4.28ms) lb # [ 106.832628] niks3-server[1130]: 2026/09/25 16:33:09 OK 2_object_stats_trigger.sql (2.08ms) lb # [ 106.836021] niks3-server[1130]: 2026/09/25 16:33:10 OK 3_commit_push.sql (3.03ms) lb # [ 106.837061] niks3-server[1130]: 2026/09/25 16:33:10 goose: up to current file version: 3 lb # [ 106.838369] niks3-server[1130]: 2026/09/25 16:33:10 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 106.849227] niks3-server[1130]: 2026/09/25 16:33:10 INFO Read proxy enabled — serving cache objects from S3 lb # [ 106.850463] niks3-server[1130]: 2026/09/25 16:33:10 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 106.852846] niks3-server[1130]: 2026/09/25 16:33:10 INFO systemd watchdog enabled interval=15s lb # [ 106.854174] systemd[1]: Started niks3 server. lb # [ 106.855683] niks3-server[1130]: 2026/09/25 16:33:10 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 lb # [ 107.073462] envoy[922]: conn peer=[2001:db8:1::1]:40680 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3725 tx=2086 ms=1907 lb # [ 107.075080] envoy[922]: conn peer=[2001:db8:1::1]:40684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=13 lb # [ 107.076540] envoy[922]: conn peer=[2001:db8:1::4]:55260 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2974 tx=1021 ms=66975 lb # [ 107.078369] envoy[922]: conn peer=[2001:db8:1::1]:40688 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=20 lb # [ 107.079801] envoy[922]: conn peer=192.168.1.3:48438 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2370 tx=1122 ms=69417 lb # [ 107.081459] envoy[922]: conn peer=[2001:db8:1::1]:47442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=305 ms=992 worker2 # [ 107.170692] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34624 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 107.179444] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 worker1 # [ 107.210169] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:09Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 107.214110] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:09Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 107.217981] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 107.229180] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 107.243290] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 107.254115] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 107.355569] nix-daemon[861]: accepted connection from pid 1347, user nix-grpc-daemon (trusted) worker2 # [ 107.368551] nix-daemon[861]: reaped child process 1350, status = succeeded lb # [ 107.391059] niks3-server[1130]: 2026/09/25 16:33:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 107.389633] nix-grpc-daemon[1324]: time=2026-09-25T16:33:10.563Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 107.391864] nix-grpc-daemon[1324]: time=2026-09-25T16:33:10.565Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 107.429124] niks3-server[1130]: 2026/09/25 16:33:10 INFO Received sign narinfos request method=POST path=/api/pushes/36/sign lb # [ 107.447524] niks3-server[1130]: 2026/09/25 16:33:10 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 107.455413] niks3-server[1130]: 2026/09/25 16:33:10 INFO Signed narinfos id=36 count=1 worker2 # [ 107.441801] nix-grpc-daemon[1324]: time=2026-09-25T16:33:10.614Z level=INFO msg="Uploading 1 narinfos" lb # [ 107.464053] niks3-server[1130]: 2026/09/25 16:33:10 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 107.466802] niks3-server[1130]: 2026/09/25 16:33:10 INFO Received complete push request method=POST path=/api/pushes/36/complete lb # [ 107.471410] niks3-server[1130]: 2026/09/25 16:33:10 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker2 # [ 107.461367] nix-grpc-daemon[1324]: time=2026-09-25T16:33:10.635Z level=INFO msg="Upload complete. (195ms)" worker2 # [ 107.465823] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 107.471825] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 107.485099] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 107.494251] nix-daemon[861]: reaped child process 1345, status = succeeded client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... worker2 # [ 107.500511] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 107.756555] niks3-server[1130]: 2026/09/25 16:33:10 INFO lead: acquired remote=192.168.1.3:36924 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 108.526899] nix-daemon[861]: reaped child process 1354, status = succeeded worker2 # [ 108.604868] nix-daemon[861]: accepted connection from pid 1372, user nix-grpc-daemon (trusted) worker2 # [ 108.617797] nix-daemon[861]: reaped child process 1375, status = succeeded lb # [ 108.640701] niks3-server[1130]: 2026/09/25 16:33:11 INFO Received push request method=POST path=/api/pushes worker2 # [ 108.635364] nix-grpc-daemon[1324]: time=2026-09-25T16:33:11.809Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 108.636992] nix-grpc-daemon[1324]: time=2026-09-25T16:33:11.810Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 108.687920] niks3-server[1130]: 2026/09/25 16:33:11 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign lb # [ 108.699756] niks3-server[1130]: 2026/09/25 16:33:11 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 108.705237] niks3-server[1130]: 2026/09/25 16:33:11 INFO Signed narinfos id=37 count=1 worker2 # [ 108.688953] nix-grpc-daemon[1324]: time=2026-09-25T16:33:11.862Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.708985] niks3-server[1130]: 2026/09/25 16:33:11 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 108.723436] niks3-server[1130]: 2026/09/25 16:33:11 INFO Received complete push request method=POST path=/api/pushes/37/complete lb # [ 108.726269] niks3-server[1130]: 2026/09/25 16:33:11 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls worker2 # [ 108.716717] nix-grpc-daemon[1324]: time=2026-09-25T16:33:11.890Z level=INFO msg="Upload complete. (208ms)" lb # [ 108.734923] niks3-server[1130]: 2026/09/25 16:33:11 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 108.722776] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 108.734370] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:11Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 108.733611] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker1 # [ 108.738969] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:11Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 108.745508] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 108.752974] nix-daemon[861]: reaped child process 1352, status = succeeded worker2 # [ 108.755591] nix-grpc-daemon[1324]: time=2026-09-25T16:33:11.929Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 108.761961] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 108.769293] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 108.850376] nix-daemon[861]: accepted connection from pid 1379, user nix-grpc-daemon (trusted) worker2 # [ 108.863958] nix-daemon[861]: reaped child process 1382, status = succeeded lb # [ 108.885055] niks3-server[1130]: 2026/09/25 16:33:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 108.876740] nix-grpc-daemon[1324]: time=2026-09-25T16:33:12.050Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 108.878670] nix-grpc-daemon[1324]: time=2026-09-25T16:33:12.052Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 108.916610] niks3-server[1130]: 2026/09/25 16:33:12 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign lb # [ 108.921813] niks3-server[1130]: 2026/09/25 16:33:12 INFO Signed narinfos id=38 count=1 worker2 # [ 108.908879] nix-grpc-daemon[1324]: time=2026-09-25T16:33:12.082Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.930789] niks3-server[1130]: 2026/09/25 16:33:12 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 108.939869] niks3-server[1130]: 2026/09/25 16:33:12 INFO Received complete push request method=POST path=/api/pushes/38/complete lb # [ 108.951247] niks3-server[1130]: 2026/09/25 16:33:12 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo lb # [ 108.955684] niks3-server[1130]: 2026/09/25 16:33:12 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls worker2 # [ 108.942685] nix-grpc-daemon[1324]: time=2026-09-25T16:33:12.116Z level=INFO msg="Upload complete. (168ms)" worker2 # [ 108.947418] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 108.952873] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 108.962724] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 108.970740] nix-daemon[861]: reaped child process 1377, status = succeeded worker2 # [ 108.975300] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 110.011533] nix-daemon[861]: reaped child process 1386, status = succeeded worker2 # [ 110.093645] nix-daemon[861]: accepted connection from pid 1402, user nix-grpc-daemon (trusted) worker2 # [ 110.105057] nix-daemon[861]: reaped child process 1405, status = succeeded lb # [ 110.128938] niks3-server[1130]: 2026/09/25 16:33:13 INFO Received push request method=POST path=/api/pushes worker2 # [ 110.120690] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.294Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 110.122246] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.296Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 110.172471] niks3-server[1130]: 2026/09/25 16:33:13 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign lb # [ 110.183910] niks3-server[1130]: 2026/09/25 16:33:13 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 110.191567] niks3-server[1130]: 2026/09/25 16:33:13 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 110.196446] niks3-server[1130]: 2026/09/25 16:33:13 INFO Signed narinfos id=39 count=1 worker2 # [ 110.180310] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.354Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.199180] niks3-server[1130]: 2026/09/25 16:33:13 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 110.210274] niks3-server[1130]: 2026/09/25 16:33:13 INFO Received complete push request method=POST path=/api/pushes/39/complete lb # [ 110.215226] niks3-server[1130]: 2026/09/25 16:33:13 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 110.201902] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.375Z level=INFO msg="Upload complete. (219ms)" worker2 # [ 110.207885] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 110.218170] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:12Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 110.218257] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker1 # [ 110.222526] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:12Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 110.229510] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 110.237174] nix-daemon[861]: reaped child process 1384, status = succeeded worker2 # [ 110.241352] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.413Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 110.247876] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 110.254391] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 110.336834] nix-daemon[861]: accepted connection from pid 1409, user nix-grpc-daemon (trusted) worker2 # [ 110.349960] nix-daemon[861]: reaped child process 1412, status = succeeded lb # [ 110.372220] niks3-server[1130]: 2026/09/25 16:33:13 INFO Received push request method=POST path=/api/pushes worker2 # [ 110.363825] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.537Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 110.365738] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.539Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 110.401234] niks3-server[1130]: 2026/09/25 16:33:13 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 110.409069] niks3-server[1130]: 2026/09/25 16:33:13 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign lb # [ 110.416645] niks3-server[1130]: 2026/09/25 16:33:13 INFO Signed narinfos id=40 count=1 worker2 # [ 110.403947] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.577Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.425190] niks3-server[1130]: 2026/09/25 16:33:13 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 110.435472] niks3-server[1130]: 2026/09/25 16:33:13 INFO Received complete push request method=POST path=/api/pushes/40/complete lb # [ 110.444966] niks3-server[1130]: 2026/09/25 16:33:13 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 110.432816] nix-grpc-daemon[1324]: time=2026-09-25T16:33:13.606Z level=INFO msg="Upload complete. (172ms)" worker2 # [ 110.436994] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 110.443205] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 110.453461] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 110.462377] nix-daemon[861]: reaped child process 1407, status = succeeded worker2 # [ 110.467556] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 111.505317] nix-daemon[861]: reaped child process 1416, status = succeeded worker2 # [ 111.580777] nix-daemon[861]: accepted connection from pid 1432, user nix-grpc-daemon (trusted) worker2 # [ 111.594986] nix-daemon[861]: reaped child process 1435, status = succeeded lb # [ 111.616693] niks3-server[1130]: 2026/09/25 16:33:14 INFO Received push request method=POST path=/api/pushes worker2 # [ 111.610477] nix-grpc-daemon[1324]: time=2026-09-25T16:33:14.784Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 111.612343] nix-grpc-daemon[1324]: time=2026-09-25T16:33:14.786Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 111.657842] niks3-server[1130]: 2026/09/25 16:33:14 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign lb # [ 111.667740] niks3-server[1130]: 2026/09/25 16:33:14 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 111.674573] niks3-server[1130]: 2026/09/25 16:33:14 INFO Signed narinfos id=41 count=1 worker2 # [ 111.661882] nix-grpc-daemon[1324]: time=2026-09-25T16:33:14.835Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.679104] niks3-server[1130]: 2026/09/25 16:33:14 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 111.683141] niks3-server[1130]: 2026/09/25 16:33:14 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 111.692466] niks3-server[1130]: 2026/09/25 16:33:14 INFO Received complete push request method=POST path=/api/pushes/41/complete lb # [ 111.696936] niks3-server[1130]: 2026/09/25 16:33:14 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 111.683720] nix-grpc-daemon[1324]: time=2026-09-25T16:33:14.857Z level=INFO msg="Upload complete. (208ms)" worker2 # [ 111.689451] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 111.704666] nix-daemon[861]: reaped child process 1414, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 4.70 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath worker1 # [ 111.736766] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:14Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:52290 client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.11 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 5.18 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 112.000941] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 112.532217] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:14Z level=info event=signal_exit lb # [ 112.759512] niks3-server[1130]: 2026/09/25 16:33:15 INFO lead: released remote=192.168.1.3:36924 worker1 # [ 113.748706] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:16Z level=info event=scheduler_restarting lb # [ 113.760220] envoy[922]: [2026-09-25 16:33:16.925][922][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 113.751992] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:16Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 113.756162] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:16Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 113.761864] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52270 worker1 # [ 113.765823] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:16Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 113.768921] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52270 worker1 # [ 113.772525] nix-grpc-daemon[1324]: ts=2026-09-25T16:33:16Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 113.952584] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.956579] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.157637] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.161685] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.362647] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.366593] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.567862] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.571795] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.773610] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.777458] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.971683] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 114.975653] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 114.980170] systemd[1]: nix-grpc-daemon.service: Consumed 220ms CPU time over 9.555s wall clock time, 13.6M memory peak, 146.7K incoming IP traffic, 34K outgoing IP traffic. worker2 # [ 114.978583] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.982787] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 115.183838] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.187736] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.389227] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.393271] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.594340] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.598294] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.799929] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.803724] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.004978] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.009135] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.210156] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.214333] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.415438] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.419552] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.620438] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.624335] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.826299] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.829785] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.030774] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.034707] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 117.074749] envoy[922]: conn peer=[2001:db8:1::1]:47452 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9705 tx=4378 ms=4531 lb # [ 117.078511] envoy[922]: conn peer=[2001:db8:1::3]:53434 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1348 tx=372 ms=8395 worker2 # [ 117.235868] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.239879] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.440862] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.444809] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.645697] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.649674] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.738292] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:20Z level=info event=scheduler_take_over lb # [ 117.754904] niks3-server[1130]: 2026/09/25 16:33:20 INFO lead: acquired remote=192.168.1.4:38290 worker2 # [ 117.851640] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.855498] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.056728] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.060657] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 3.20 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 118.261304] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.278141] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 118.282247] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48252 worker2 # [ 118.286208] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 118.533174] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:21Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:48256 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker2 # [ 119.401649] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34624 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 119.410190] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 119.433581] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 119.439555] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 119.444327] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 119.455061] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 119.467333] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 119.475997] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 119.569630] nix-daemon[861]: accepted connection from pid 1471, user nix-grpc-daemon (trusted) worker2 # [ 119.581453] nix-daemon[861]: reaped child process 1474, status = succeeded lb # [ 119.610285] niks3-server[1130]: 2026/09/25 16:33:22 INFO Received push request method=POST path=/api/pushes worker2 # [ 119.598938] nix-grpc-daemon[1324]: time=2026-09-25T16:33:22.772Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 119.600838] nix-grpc-daemon[1324]: time=2026-09-25T16:33:22.774Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 119.637668] niks3-server[1130]: 2026/09/25 16:33:22 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign worker2 # [ 119.628214] nix-grpc-daemon[1324]: time=2026-09-25T16:33:22.802Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.644296] niks3-server[1130]: 2026/09/25 16:33:22 INFO Signed narinfos id=42 count=1 lb # [ 119.658392] niks3-server[1130]: 2026/09/25 16:33:22 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 119.666679] niks3-server[1130]: 2026/09/25 16:33:22 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 119.675498] niks3-server[1130]: 2026/09/25 16:33:22 INFO Received complete push request method=POST path=/api/pushes/42/complete worker2 # [ 119.663930] nix-grpc-daemon[1324]: time=2026-09-25T16:33:22.837Z level=INFO msg="Upload complete. (176ms)" lb # [ 119.682290] niks3-server[1130]: 2026/09/25 16:33:22 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker2 # [ 119.667933] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 119.674299] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 119.685255] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 119.694716] nix-daemon[861]: reaped child process 1469, status = succeeded worker2 # [ 119.697887] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 120.712824] nix-daemon[861]: reaped child process 1478, status = succeeded worker2 # [ 120.784745] nix-daemon[861]: accepted connection from pid 1494, user nix-grpc-daemon (trusted) worker2 # [ 120.797748] nix-daemon[861]: reaped child process 1497, status = succeeded lb # [ 120.820358] niks3-server[1130]: 2026/09/25 16:33:23 INFO Received push request method=POST path=/api/pushes worker2 # [ 120.812588] nix-grpc-daemon[1324]: time=2026-09-25T16:33:23.986Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.815063] nix-grpc-daemon[1324]: time=2026-09-25T16:33:23.988Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 120.856566] niks3-server[1130]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 120.869529] niks3-server[1130]: 2026/09/25 16:33:24 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign lb # [ 120.875523] niks3-server[1130]: 2026/09/25 16:33:24 INFO Signed narinfos id=43 count=1 worker2 # [ 120.862149] nix-grpc-daemon[1324]: time=2026-09-25T16:33:24.036Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.882860] niks3-server[1130]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 120.887143] niks3-server[1130]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 120.896832] niks3-server[1130]: 2026/09/25 16:33:24 INFO Received complete push request method=POST path=/api/pushes/43/complete lb # [ 120.903334] niks3-server[1130]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker2 # [ 120.885679] nix-grpc-daemon[1324]: time=2026-09-25T16:33:24.059Z level=INFO msg="Upload complete. (181ms)" worker2 # [ 120.892635] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 120.907768] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 120.911572] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 120.916235] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 120.924811] nix-daemon[861]: reaped child process 1476, status = succeeded worker2 # [ 120.926253] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 120.933335] nix-grpc-daemon[1324]: time=2026-09-25T16:33:24.107Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 120.938801] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 120.944536] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 121.026246] nix-daemon[861]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker2 # [ 121.039710] nix-daemon[861]: reaped child process 1506, status = succeeded lb # [ 121.061421] niks3-server[1130]: 2026/09/25 16:33:24 INFO Received push request method=POST path=/api/pushes worker2 # [ 121.053808] nix-grpc-daemon[1324]: time=2026-09-25T16:33:24.227Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 121.055739] nix-grpc-daemon[1324]: time=2026-09-25T16:33:24.229Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 121.091234] niks3-server[1130]: 2026/09/25 16:33:24 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign worker2 # [ 121.085304] nix-grpc-daemon[1324]: time=2026-09-25T16:33:24.259Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.101603] niks3-server[1130]: 2026/09/25 16:33:24 INFO Signed narinfos id=44 count=1 lb # [ 121.112496] niks3-server[1130]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 121.126959] niks3-server[1130]: 2026/09/25 16:33:24 INFO Received complete push request method=POST path=/api/pushes/44/complete worker2 # [ 121.116571] nix-grpc-daemon[1324]: time=2026-09-25T16:33:24.290Z level=INFO msg="Upload complete. (167ms)" lb # [ 121.134903] niks3-server[1130]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo lb # [ 121.139129] niks3-server[1130]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls worker2 # [ 121.120862] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 121.127309] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 121.135890] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 121.144727] nix-daemon[861]: reaped child process 1501, status = succeeded worker2 # [ 121.149409] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 122.163508] nix-daemon[861]: reaped child process 1510, status = succeeded worker2 # [ 122.237042] nix-daemon[861]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker2 # [ 122.250040] nix-daemon[861]: reaped child process 1529, status = succeeded lb # [ 122.272704] niks3-server[1130]: 2026/09/25 16:33:25 INFO Received push request method=POST path=/api/pushes worker2 # [ 122.271280] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.444Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 122.272650] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.444Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 122.322715] niks3-server[1130]: 2026/09/25 16:33:25 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 122.328327] niks3-server[1130]: 2026/09/25 16:33:25 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign lb # [ 122.333995] niks3-server[1130]: 2026/09/25 16:33:25 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 122.338869] niks3-server[1130]: 2026/09/25 16:33:25 INFO Signed narinfos id=45 count=1 worker2 # [ 122.323072] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.496Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.344694] niks3-server[1130]: 2026/09/25 16:33:25 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 122.354413] niks3-server[1130]: 2026/09/25 16:33:25 INFO Received complete push request method=POST path=/api/pushes/45/complete lb # [ 122.360039] niks3-server[1130]: 2026/09/25 16:33:25 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 122.342360] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.516Z level=INFO msg="Upload complete. (186ms)" worker2 # [ 122.349598] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 122.361853] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 122.366353] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 122.371219] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 122.380273] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 122.382450] nix-daemon[861]: reaped child process 1508, status = succeeded worker2 # [ 122.387558] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.561Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 122.392977] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 122.397981] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 122.480919] nix-daemon[861]: accepted connection from pid 1535, user nix-grpc-daemon (trusted) worker2 # [ 122.493410] nix-daemon[861]: reaped child process 1538, status = succeeded lb # [ 122.516986] niks3-server[1130]: 2026/09/25 16:33:25 INFO Received push request method=POST path=/api/pushes worker2 # [ 122.508958] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.682Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 122.510363] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.682Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 122.542949] niks3-server[1130]: 2026/09/25 16:33:25 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign worker2 # [ 122.533369] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.550278] niks3-server[1130]: 2026/09/25 16:33:25 INFO Signed narinfos id=46 count=1 lb # [ 122.556194] niks3-server[1130]: 2026/09/25 16:33:25 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 122.565919] niks3-server[1130]: 2026/09/25 16:33:25 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 122.573645] niks3-server[1130]: 2026/09/25 16:33:25 INFO Received complete push request method=POST path=/api/pushes/46/complete lb # [ 122.584706] niks3-server[1130]: 2026/09/25 16:33:25 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 122.571387] nix-grpc-daemon[1324]: time=2026-09-25T16:33:25.745Z level=INFO msg="Upload complete. (167ms)" worker2 # [ 122.575491] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 122.581160] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 122.589877] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 122.595909] nix-daemon[861]: reaped child process 1533, status = succeeded worker2 # [ 122.599940] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 123.414394] nix-daemon[861]: reaped child process 1542, status = succeeded worker2 # [ 123.488203] nix-daemon[861]: accepted connection from pid 1558, user nix-grpc-daemon (trusted) worker2 # [ 123.502103] nix-daemon[861]: reaped child process 1561, status = succeeded lb # [ 123.523968] niks3-server[1130]: 2026/09/25 16:33:26 INFO Received push request method=POST path=/api/pushes worker2 # [ 123.516404] nix-grpc-daemon[1324]: time=2026-09-25T16:33:26.690Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 123.517891] nix-grpc-daemon[1324]: time=2026-09-25T16:33:26.691Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 123.565690] niks3-server[1130]: 2026/09/25 16:33:26 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign worker2 # [ 123.553788] nix-grpc-daemon[1324]: time=2026-09-25T16:33:26.727Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.571360] niks3-server[1130]: 2026/09/25 16:33:26 INFO Signed narinfos id=47 count=1 lb # [ 123.578953] niks3-server[1130]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 123.585867] niks3-server[1130]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 123.592278] niks3-server[1130]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 123.599935] niks3-server[1130]: 2026/09/25 16:33:26 INFO Received complete push request method=POST path=/api/pushes/47/complete worker2 # [ 123.589051] nix-grpc-daemon[1324]: time=2026-09-25T16:33:26.763Z level=INFO msg="Upload complete. (182ms)" lb # [ 123.607089] niks3-server[1130]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 123.598194] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 123.612240] nix-daemon[861]: reaped child process 1540, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 4.37 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds) worker1 # [ 123.773984] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 123.849346] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 123.851626] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 123.855494] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 123.860060] nix-grpc-daemon[1407]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 123.861395] nix-grpc-daemon[1407]: E0000 00:00:1790354006.157798 1407 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 123.864460] nix-grpc-daemon[1407]: E0000 00:00:1790354006.162957 1407 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 123.867057] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:26Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 123.869801] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 123.877102] nix-grpc-daemon[1407]: E0000 00:00:1790354006.175482 1449 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 123.890066] nix-grpc-daemon[1407]: E0000 00:00:1790354006.188593 1449 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 123.894124] nix-grpc-daemon[1407]: E0000 00:00:1790354006.190809 1449 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 123.904248] nix-grpc-daemon[1407]: E0000 00:00:1790354006.202804 1449 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 123.913662] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.911758] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48252 worker2 # [ 123.918827] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.24 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 124.121565] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: aa66dd83335d4e5faffdf851ade07a1e client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) worker2 # [ 124.253627] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34624 client # [ 124.259621] nix[1376]: don't know how to build these paths: client # [ 124.260567] nix[1376]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 124.267362] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 124.272955] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 124.278787] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 124.289662] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34624 client # [ 124.298032] nix[1376]: copying 1 paths to 'lb:50051'... client # [ 124.298954] nix[1376]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 124.300278] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 124.310053] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 124.397824] nix-daemon[861]: accepted connection from pid 1574, user nix-grpc-daemon (trusted) worker2 # [ 124.411161] nix-daemon[861]: reaped child process 1577, status = succeeded lb # [ 124.432622] niks3-server[1130]: 2026/09/25 16:33:27 INFO Received push request method=POST path=/api/pushes worker2 # [ 124.423952] nix-grpc-daemon[1324]: time=2026-09-25T16:33:27.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 124.425420] nix-grpc-daemon[1324]: time=2026-09-25T16:33:27.599Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 124.463530] niks3-server[1130]: 2026/09/25 16:33:27 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 124.473474] niks3-server[1130]: 2026/09/25 16:33:27 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign worker2 # [ 124.461508] nix-grpc-daemon[1324]: time=2026-09-25T16:33:27.635Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.478240] niks3-server[1130]: 2026/09/25 16:33:27 INFO Signed narinfos id=48 count=1 lb # [ 124.486368] niks3-server[1130]: 2026/09/25 16:33:27 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 124.494838] niks3-server[1130]: 2026/09/25 16:33:27 INFO Received complete push request method=POST path=/api/pushes/48/complete lb # [ 124.504987] niks3-server[1130]: 2026/09/25 16:33:27 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 124.487697] nix-grpc-daemon[1324]: time=2026-09-25T16:33:27.661Z level=INFO msg="Upload complete. (168ms)" worker2 # [ 124.492629] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 124.499286] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 worker2 # [ 124.508590] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 124.517328] nix-daemon[861]: reaped child process 1572, status = succeeded worker2 # [ 124.521912] nix-daemon[861]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) client # [ 124.520202] nix[1376]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 126.785620] systemd-journald[283]: Received client request to rotate journal, rotating. worker1 # [ 126.804310] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ba9e9b0f224d4d3789babb65c081dfcf. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 126.704550] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 lb # [ 127.076415] envoy[922]: conn peer=[2001:db8:1::1]:39990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9543 tx=4336 ms=4206 worker2 # [ 127.610468] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:30Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 131.941372] nix-daemon[861]: reaped child process 1581, status = succeeded worker2 # [ 132.015367] nix-daemon[861]: accepted connection from pid 1622, user nix-grpc-daemon (trusted) worker2 # [ 132.027769] nix-daemon[861]: reaped child process 1625, status = succeeded lb # [ 132.052742] niks3-server[1130]: 2026/09/25 16:33:35 INFO Received push request method=POST path=/api/pushes worker2 # [ 132.047441] nix-grpc-daemon[1324]: time=2026-09-25T16:33:35.221Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 132.048991] nix-grpc-daemon[1324]: time=2026-09-25T16:33:35.223Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" worker2 # [ 132.084287] nix-grpc-daemon[1324]: time=2026-09-25T16:33:35.258Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.100892] niks3-server[1130]: 2026/09/25 16:33:35 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign lb # [ 132.103521] niks3-server[1130]: 2026/09/25 16:33:35 INFO Signed narinfos id=49 count=1 lb # [ 132.111282] niks3-server[1130]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 132.117186] niks3-server[1130]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 132.124887] niks3-server[1130]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 132.130179] niks3-server[1130]: 2026/09/25 16:33:35 INFO Received complete push request method=POST path=/api/pushes/49/complete worker2 # [ 132.119525] nix-grpc-daemon[1324]: time=2026-09-25T16:33:35.293Z level=INFO msg="Upload complete. (185ms)" lb # [ 132.138091] niks3-server[1130]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 132.126706] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34624 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 132.142328] nix-daemon[861]: reaped child process 1579, status = succeeded client # [ 132.162265] systemd[1]: rs.service: Deactivated successfully. client # [ 132.165142] systemd[1]: rs.service: Consumed 121ms CPU time over 8.040s wall clock time, 43.4M memory peak, 7K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 132.612566] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:35Z level=info event=signal_exit lb # [ 132.754235] niks3-server[1130]: 2026/09/25 16:33:35 INFO lead: released remote=192.168.1.4:38290 worker2 # [ 133.739752] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:36Z level=info event=scheduler_restarting lb # [ 133.755255] envoy[922]: [2026-09-25 16:33:36.920][922][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 133.746804] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:36Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 133.750868] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 133.753692] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48252 worker2 # [ 133.757318] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:36Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 133.760810] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48252 worker2 # [ 133.764323] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:36Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 133.788412] nix-daemon[861]: reaped child process 1316, status = succeeded lb # [ 133.889568] niks3-server[1130]: 2026/09/25 16:33:37 INFO lead: acquired remote=192.168.1.3:53858 worker1 # [ 133.879864] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_take_over worker1 # [ 133.955238] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 133.959098] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 133.961504] nix-grpc-daemon[1264]: ts=2026-09-25T16:33:37Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 134.005417] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 134.009341] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 134.012736] systemd[1]: nix-grpc-daemon.service: Consumed 1.628s CPU time over 33.498s wall clock time, 46.2M memory peak, 381.9K incoming IP traffic, 267.7K outgoing IP traffic. worker2 # [ 134.026132] systemd[1]: Starting scheduler-token.service... worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.13 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 134.069059] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 134.071067] systemd[1]: Finished scheduler-token.service. worker2 # [ 134.071801] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 44ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 134.075602] systemd[1]: Starting Nix worker-protocol over gRPC... client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 134.150608] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 134.152731] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 134.155979] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 134.159961] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.161061] nix-grpc-daemon[1636]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 134.163979] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 134.162395] nix-grpc-daemon[1636]: E0000 00:00:1790354017.334285 1636 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 134.165494] nix-grpc-daemon[1636]: E0000 00:00:1790354017.339504 1636 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 134.169813] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 134.172694] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 134.176065] nix-grpc-daemon[1636]: E0000 00:00:1790354017.349519 1678 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 134.187541] nix-grpc-daemon[1636]: E0000 00:00:1790354017.361619 1678 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 134.191137] nix-grpc-daemon[1636]: E0000 00:00:1790354017.363848 1678 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 134.201674] nix-grpc-daemon[1636]: E0000 00:00:1790354017.375715 1678 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 134.210864] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.212422] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.364674] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.368593] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 134.413757] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.417686] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.569478] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.573671] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 134.618627] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.622644] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.775958] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.779443] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 134.823690] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.827960] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.976937] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.980973] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 135.029084] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 135.033086] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 135.181715] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 135.185690] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 135.235439] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 135.238664] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 135.386552] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 135.398123] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44112 worker1 # [ 135.402836] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 135.436815] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 135.448130] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 135.451161] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44112 worker1 # [ 135.455474] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 135.688350] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:37Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:44116 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.28 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 136.398693] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: fdd9bde5550f4e93bf322366aa305a8f client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker2 # [ 136.543271] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 136.554244] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # [ 136.565110] nix[1412]: don't know how to build these paths: client # [ 136.566056] nix[1412]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 136.580239] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:38Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 136.587233] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:38Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 136.594706] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44126 worker1 # [ 136.605734] nix-daemon[870]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 136.621281] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5) worker1 # [ 136.710940] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5) worker1 # [ 136.777982] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 3/5) worker1 # [ 136.799651] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 101 ms (attempt 4/5) worker1 # [ 136.903356] nix-grpc-daemon[1407]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 136.906307] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 136.923498] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44126 client # [ 136.928935] nix[1412]: copying 1 paths to 'lb:50051'... client # [ 136.932130] nix[1412]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 136.938342] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44126 worker1 # [ 136.946780] nix-daemon[870]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 136.971555] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:39Z level=info event=niks3_push_started pid=1529 lb # [ 137.076800] envoy[922]: conn peer=[2001:db8:1::1]:51986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=1499 ms=7889 lb # [ 137.080576] envoy[922]: conn peer=[2001:db8:1::4]:38458 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=35707 tx=2236 ms=33306 worker1 # [ 137.074775] nix-grpc-daemon[1529]: time=2026-09-25T16:33:39.372Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 137.159398] nix-daemon[870]: accepted connection from pid 1542, user nix-grpc-daemon (trusted) worker1 # [ 137.172830] nix-daemon[870]: reaped child process 1545, status = succeeded lb # [ 137.191317] niks3-server[1130]: 2026/09/25 16:33:40 INFO Received push request method=POST path=/api/pushes worker1 # [ 137.188826] nix-grpc-daemon[1529]: time=2026-09-25T16:33:39.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.190329] nix-grpc-daemon[1529]: time=2026-09-25T16:33:39.488Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 137.230847] niks3-server[1130]: 2026/09/25 16:33:40 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign lb # [ 137.238899] niks3-server[1130]: 2026/09/25 16:33:40 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 137.252594] niks3-server[1130]: 2026/09/25 16:33:40 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 137.261590] niks3-server[1130]: 2026/09/25 16:33:40 INFO Signed narinfos id=50 count=1 worker1 # [ 137.249471] nix-grpc-daemon[1529]: time=2026-09-25T16:33:39.547Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.270819] niks3-server[1130]: 2026/09/25 16:33:40 INFO Received complete push request method=POST path=/api/pushes/50/complete lb # [ 137.275336] niks3-server[1130]: 2026/09/25 16:33:40 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 137.270129] nix-grpc-daemon[1529]: time=2026-09-25T16:33:39.568Z level=INFO msg="Upload complete. (195ms)" worker1 # [ 137.275641] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44126 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 137.281479] nix-grpc-daemon[1407]: ts=2026-09-25T16:33:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44126 worker1 # [ 137.291502] nix-daemon[870]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 137.303132] nix-daemon[870]: reaped child process 1527, status = succeeded worker1 # [ 137.306484] nix-daemon[870]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # [ 137.301352] nix[1412]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 138.889331] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1407 (nix-grpc-daemon) on client request. worker1 # [ 138.892345] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 138.908842] niks3-server[1130]: 2026/09/25 16:33:42 INFO lead: released remote=192.168.1.3:53858 lb # [ 138.914356] envoy[922]: [2026-09-25 16:33:42.079][922][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination} client # [ 138.896501] nix[1412]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 138.897884] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 138.901186] nix[1412]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 138.908541] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 138.910191] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 138.916159] systemd[1]: nix-grpc-daemon.service: Consumed 394ms CPU time over 15.136s wall clock time, 35.8M memory peak, 160.9K incoming IP traffic, 55.6K outgoing IP traffic. worker1 # [ 138.921252] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 138.925549] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 138.953716] nix-daemon[870]: reaped child process 1521, status = succeeded worker1 # [ 138.955717] nix-daemon[870]: reaped child process 1547, status = succeeded worker1 # [ 138.969660] nix-daemon[1549]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 138.976386] nix-daemon[870]: reaped child process 1549, status = failed with exit code 1 worker1 # [ 139.013548] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 139.015622] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 139.018749] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 139.023056] nix-grpc-daemon[1585]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 139.025155] nix-grpc-daemon[1585]: E0000 00:00:1790354021.321482 1585 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 139.028385] nix-grpc-daemon[1585]: E0000 00:00:1790354021.326900 1585 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 139.034075] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 139.036940] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 139.041066] nix-grpc-daemon[1585]: E0000 00:00:1790354021.338873 1628 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 139.053640] niks3-server[1130]: 2026/09/25 16:33:42 INFO lead: acquired remote=192.168.1.3:58504 worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.18 seconds) client: must succeed: sleep 5.0 worker1 # [ 139.044418] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=scheduler_take_over worker1 # [ 139.054300] nix-grpc-daemon[1585]: E0000 00:00:1790354021.352879 1628 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 139.058789] nix-grpc-daemon[1585]: E0000 00:00:1790354021.355335 1628 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 139.068328] nix-grpc-daemon[1585]: E0000 00:00:1790354021.366887 1628 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 139.078358] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 139.084843] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44148 worker1 # [ 139.086557] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 139.098462] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 139.106719] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 139.108138] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44148 worker1 # [ 139.109750] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 139.143480] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:44152 worker1 # [ 139.414783] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 139.420275] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 139.433133] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44170 worker1 # [ 139.441373] nix-daemon[870]: accepted connection from pid 1585, user nix-grpc-daemon (trusted) worker1 # [ 139.456459] nix-daemon[870]: accepted connection from pid 1585, user nix-grpc-daemon (trusted) client # [ 139.462195] nix[1412]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 139.468428] nix-daemon[870]: accepted connection from pid 1585, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 144.285847] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:46Z level=info event=niks3_push_started pid=1669 worker1 # [ 144.300496] nix-daemon[870]: reaped child process 1644, status = succeeded worker1 # [ 144.381452] nix-grpc-daemon[1669]: time=2026-09-25T16:33:46.679Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 144.466815] nix-daemon[870]: accepted connection from pid 1682, user nix-grpc-daemon (trusted) worker1 # [ 144.478127] nix-daemon[870]: reaped child process 1685, status = succeeded lb # [ 144.499715] niks3-server[1130]: 2026/09/25 16:33:47 INFO Received push request method=POST path=/api/pushes worker1 # [ 144.498090] nix-grpc-daemon[1669]: time=2026-09-25T16:33:46.796Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.499602] nix-grpc-daemon[1669]: time=2026-09-25T16:33:46.798Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 144.551242] niks3-server[1130]: 2026/09/25 16:33:47 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign worker1 # [ 144.549430] nix-grpc-daemon[1669]: time=2026-09-25T16:33:46.847Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.562128] niks3-server[1130]: 2026/09/25 16:33:47 INFO Signed narinfos id=51 count=1 lb # [ 144.568797] niks3-server[1130]: 2026/09/25 16:33:47 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 144.573107] niks3-server[1130]: 2026/09/25 16:33:47 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 144.586535] niks3-server[1130]: 2026/09/25 16:33:47 INFO Received complete push request method=POST path=/api/pushes/51/complete lb # [ 144.592699] niks3-server[1130]: 2026/09/25 16:33:47 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 144.595760] niks3-server[1130]: 2026/09/25 16:33:47 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 144.587755] nix-grpc-daemon[1669]: time=2026-09-25T16:33:46.886Z level=INFO msg="Upload complete. (203ms)" worker1 # [ 144.594477] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44170 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 144.611578] nix-daemon[870]: reaped child process 1642, status = succeeded client # [ 144.627889] systemd[1]: mid.service: Deactivated successfully. client # [ 144.631574] systemd[1]: mid.service: Consumed 139ms CPU time over 8.232s wall clock time, 41.4M memory peak, 8.7K incoming IP traffic, 10.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.01 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 145.382447] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 495bef564ef041c2a32bb0cf23caf844 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.02 seconds) worker1 # [ 145.509319] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44170 client # [ 145.510846] nix[1448]: don't know how to build these paths: client # [ 145.511814] nix[1448]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 145.524209] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:47Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 145.528784] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:47Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 145.526377] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 145.536268] nix-grpc-daemon[1636]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 1/5) worker2 # [ 145.549619] nix-grpc-daemon[1636]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 2/5) worker2 # [ 145.731776] nix-grpc-daemon[1636]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 241 ms (attempt 3/5) worker2 # [ 145.998646] nix-grpc-daemon[1636]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 574 ms (attempt 4/5) worker2 # [ 146.577726] nix-grpc-daemon[1636]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 146.581862] nix-grpc-daemon[1636]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 146.601182] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 client # [ 146.606778] nix[1448]: copying 1 paths to 'lb:50051'... worker2 # [ 146.608202] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 client # [ 146.608676] nix[1448]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 146.620376] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 146.633931] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:49Z level=info event=niks3_push_started pid=1728 worker2 # [ 146.722366] nix-grpc-daemon[1728]: time=2026-09-25T16:33:49.895Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 146.808464] nix-daemon[861]: accepted connection from pid 1741, user nix-grpc-daemon (trusted) worker2 # [ 146.819851] nix-daemon[861]: reaped child process 1744, status = succeeded lb # [ 146.844480] niks3-server[1130]: 2026/09/25 16:33:50 INFO Received push request method=POST path=/api/pushes worker2 # [ 146.838551] nix-grpc-daemon[1728]: time=2026-09-25T16:33:50.012Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 146.840177] nix-grpc-daemon[1728]: time=2026-09-25T16:33:50.014Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 146.886259] niks3-server[1130]: 2026/09/25 16:33:50 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 146.892654] niks3-server[1130]: 2026/09/25 16:33:50 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign lb # [ 146.900061] niks3-server[1130]: 2026/09/25 16:33:50 INFO Signed narinfos id=52 count=1 worker2 # [ 146.886685] nix-grpc-daemon[1728]: time=2026-09-25T16:33:50.060Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.905662] niks3-server[1130]: 2026/09/25 16:33:50 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 146.918311] niks3-server[1130]: 2026/09/25 16:33:50 INFO Received complete push request method=POST path=/api/pushes/52/complete lb # [ 146.927136] niks3-server[1130]: 2026/09/25 16:33:50 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 146.910051] nix-grpc-daemon[1728]: time=2026-09-25T16:33:50.083Z level=INFO msg="Upload complete. (184ms)" worker2 # [ 146.914551] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 146.919550] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 146.928719] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 146.934557] nix-daemon[861]: reaped child process 1726, status = succeeded worker2 # [ 146.939240] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # [ 146.937394] nix[1448]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... lb # [ 147.077271] envoy[922]: conn peer=[2001:db8:1::3]:53118 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2204 tx=607 ms=14991 lb # [ 147.081089] envoy[922]: conn peer=[2001:db8:1::1]:43172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3878 tx=1919 ms=8070 client: must succeed: systemctl kill -s INT intr client # [ 148.820252] systemd[1]: intr.service: Sent signal SIGINT to main process 1448 (nix) on client request. worker2 # [ 148.824188] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:51Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 148.827573] nix[1448]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 148.833185] nix[1448]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 148.862744] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 148.865590] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 148.869543] systemd[1]: intr.service: Consumed 116ms CPU time over 3.485s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 148.957136] nix-daemon[861]: reaped child process 1746, status = succeeded worker2 # [ 148.958669] nix-daemon[1748]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 148.963406] nix-daemon[861]: reaped child process 1748, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.65 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 150.059994] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 7d1026ee567d4eeea08bb3889a930a7a client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds) worker2 # [ 150.197561] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50594 client # [ 150.202183] nix[1469]: don't know how to build these paths: client # [ 150.203129] nix[1469]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 150.217195] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:52Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 150.223822] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:52Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.228246] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44170 worker1 # [ 150.237836] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 1/5) worker1 # [ 150.338328] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 2/5) worker1 # [ 150.438241] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 3/5) worker1 # [ 150.485307] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 290 ms (attempt 4/5) worker1 # [ 150.782894] nix-grpc-daemon[1585]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 150.785836] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 150.802674] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44170 client # [ 150.808510] nix[1469]: copying 1 paths to 'lb:50051'... client # [ 150.812137] nix[1469]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 150.817667] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44170 worker1 # [ 150.828939] nix-daemon[870]: accepted connection from pid 1585, user nix-grpc-daemon (trusted) worker1 # [ 150.929995] nix-daemon[870]: accepted connection from pid 1725, user nix-grpc-daemon (trusted) worker1 # [ 150.943704] nix-daemon[870]: reaped child process 1728, status = succeeded lb # [ 150.964086] niks3-server[1130]: 2026/09/25 16:33:54 INFO Received push request method=POST path=/api/pushes worker1 # [ 150.959959] nix-grpc-daemon[1669]: time=2026-09-25T16:33:53.258Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.962351] nix-grpc-daemon[1669]: time=2026-09-25T16:33:53.260Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 150.996771] niks3-server[1130]: 2026/09/25 16:33:54 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 151.002565] niks3-server[1130]: 2026/09/25 16:33:54 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign worker1 # [ 150.995106] nix-grpc-daemon[1669]: time=2026-09-25T16:33:53.293Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.007635] niks3-server[1130]: 2026/09/25 16:33:54 INFO Signed narinfos id=53 count=1 lb # [ 151.016307] niks3-server[1130]: 2026/09/25 16:33:54 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 151.022858] niks3-server[1130]: 2026/09/25 16:33:54 INFO Received complete push request method=POST path=/api/pushes/53/complete worker1 # [ 151.015922] nix-grpc-daemon[1669]: time=2026-09-25T16:33:53.314Z level=INFO msg="Upload complete. (175ms)" lb # [ 151.030522] niks3-server[1130]: 2026/09/25 16:33:54 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 151.020363] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44170 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 151.025146] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44170 worker1 # [ 151.034743] nix-daemon[870]: accepted connection from pid 1585, user nix-grpc-daemon (trusted) worker1 # [ 151.039766] nix-daemon[870]: reaped child process 1723, status = succeeded worker1 # [ 151.044293] nix-daemon[870]: accepted connection from pid 1585, user nix-grpc-daemon (trusted) client # [ 151.038982] nix[1469]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 152.479165] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 152.505283] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker2 # [ 152.691752] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50594 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 152.699635] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 worker1 # [ 152.724177] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:55Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 152.727139] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:55Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 152.725458] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 152.736724] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 152.748060] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 152.760397] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 152.859974] nix-daemon[861]: accepted connection from pid 1799, user nix-grpc-daemon (trusted) worker2 # [ 152.873162] nix-daemon[861]: reaped child process 1802, status = succeeded lb # [ 152.896799] niks3-server[1130]: 2026/09/25 16:33:56 INFO Received push request method=POST path=/api/pushes worker2 # [ 152.891293] nix-grpc-daemon[1728]: time=2026-09-25T16:33:56.065Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 152.893637] nix-grpc-daemon[1728]: time=2026-09-25T16:33:56.066Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 152.930066] niks3-server[1130]: 2026/09/25 16:33:56 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 152.937134] niks3-server[1130]: 2026/09/25 16:33:56 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign lb # [ 152.941988] niks3-server[1130]: 2026/09/25 16:33:56 INFO Signed narinfos id=54 count=1 worker2 # [ 152.930878] nix-grpc-daemon[1728]: time=2026-09-25T16:33:56.104Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.952304] niks3-server[1130]: 2026/09/25 16:33:56 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 152.962592] niks3-server[1130]: 2026/09/25 16:33:56 INFO Received complete push request method=POST path=/api/pushes/54/complete lb # [ 152.972927] niks3-server[1130]: 2026/09/25 16:33:56 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 152.959418] nix-grpc-daemon[1728]: time=2026-09-25T16:33:56.133Z level=INFO msg="Upload complete. (186ms)" worker2 # [ 152.964171] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 152.970339] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 152.982277] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 152.992126] nix-daemon[861]: reaped child process 1797, status = succeeded worker2 # [ 152.995600] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 153.037573] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:55Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 154.435923] nix-daemon[861]: reaped child process 1806, status = succeeded worker2 # [ 154.516478] nix-daemon[861]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker2 # [ 154.530544] nix-daemon[861]: reaped child process 1825, status = succeeded lb # [ 154.553806] niks3-server[1130]: 2026/09/25 16:33:57 INFO Received push request method=POST path=/api/pushes worker2 # [ 154.543991] nix-grpc-daemon[1728]: time=2026-09-25T16:33:57.717Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 154.545557] nix-grpc-daemon[1728]: time=2026-09-25T16:33:57.719Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 154.588563] niks3-server[1130]: 2026/09/25 16:33:57 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 154.607110] niks3-server[1130]: 2026/09/25 16:33:57 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign lb # [ 154.611676] niks3-server[1130]: 2026/09/25 16:33:57 INFO Signed narinfos id=55 count=1 worker2 # [ 154.598063] nix-grpc-daemon[1728]: time=2026-09-25T16:33:57.771Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.621911] niks3-server[1130]: 2026/09/25 16:33:57 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 154.629857] niks3-server[1130]: 2026/09/25 16:33:57 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 154.632626] niks3-server[1130]: 2026/09/25 16:33:57 INFO Received complete push request method=POST path=/api/pushes/55/complete lb # [ 154.637509] niks3-server[1130]: 2026/09/25 16:33:57 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 154.624324] nix-grpc-daemon[1728]: time=2026-09-25T16:33:57.798Z level=INFO msg="Upload complete. (220ms)" worker1 # [ 154.638574] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:56Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 154.640350] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:56Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 154.630695] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 154.640602] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 154.653835] nix-daemon[861]: reaped child process 1804, status = succeeded worker2 # [ 154.657423] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 154.666140] nix-grpc-daemon[1728]: time=2026-09-25T16:33:57.840Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 154.673348] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 154.690527] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 154.780661] nix-daemon[861]: accepted connection from pid 1829, user nix-grpc-daemon (trusted) worker2 # [ 154.794130] nix-daemon[861]: reaped child process 1832, status = succeeded lb # [ 154.816287] niks3-server[1130]: 2026/09/25 16:33:57 INFO Received push request method=POST path=/api/pushes worker2 # [ 154.807643] nix-grpc-daemon[1728]: time=2026-09-25T16:33:57.981Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 154.809556] nix-grpc-daemon[1728]: time=2026-09-25T16:33:57.983Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 154.845676] niks3-server[1130]: 2026/09/25 16:33:58 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign lb # [ 154.850513] niks3-server[1130]: 2026/09/25 16:33:58 INFO Signed narinfos id=56 count=1 worker2 # [ 154.837250] nix-grpc-daemon[1728]: time=2026-09-25T16:33:58.011Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.862666] niks3-server[1130]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 154.867914] niks3-server[1130]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 154.879209] niks3-server[1130]: 2026/09/25 16:33:58 INFO Received complete push request method=POST path=/api/pushes/56/complete lb # [ 154.887463] niks3-server[1130]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 154.874293] nix-grpc-daemon[1728]: time=2026-09-25T16:33:58.048Z level=INFO msg="Upload complete. (172ms)" worker2 # [ 154.878716] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 154.884581] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 154.894751] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 154.903503] nix-daemon[861]: reaped child process 1827, status = succeeded worker2 # [ 154.908600] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 155.549364] nix-daemon[861]: reaped child process 1836, status = succeeded worker2 # [ 155.624761] nix-daemon[861]: accepted connection from pid 1852, user nix-grpc-daemon (trusted) worker2 # [ 155.637616] nix-daemon[861]: reaped child process 1855, status = succeeded lb # [ 155.662707] niks3-server[1130]: 2026/09/25 16:33:58 INFO Received push request method=POST path=/api/pushes worker2 # [ 155.652987] nix-grpc-daemon[1728]: time=2026-09-25T16:33:58.826Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 155.655246] nix-grpc-daemon[1728]: time=2026-09-25T16:33:58.828Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 155.699559] niks3-server[1130]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 155.707816] niks3-server[1130]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 155.718981] niks3-server[1130]: 2026/09/25 16:33:58 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign lb # [ 155.722931] niks3-server[1130]: 2026/09/25 16:33:58 INFO Signed narinfos id=57 count=1 worker2 # [ 155.709720] nix-grpc-daemon[1728]: time=2026-09-25T16:33:58.883Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.726050] niks3-server[1130]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 155.737618] niks3-server[1130]: 2026/09/25 16:33:58 INFO Received complete push request method=POST path=/api/pushes/57/complete lb # [ 155.741928] niks3-server[1130]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 155.724655] nix-grpc-daemon[1728]: time=2026-09-25T16:33:58.898Z level=INFO msg="Upload complete. (209ms)" worker1 # [ 155.739295] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:58Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 155.741144] nix-grpc-daemon[1585]: ts=2026-09-25T16:33:58Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 155.730811] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 155.741582] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 155.752519] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 155.758881] nix-daemon[861]: reaped child process 1834, status = succeeded worker2 # [ 155.765165] nix-grpc-daemon[1728]: time=2026-09-25T16:33:58.939Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 155.774221] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 155.793134] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 155.882171] nix-daemon[861]: accepted connection from pid 1859, user nix-grpc-daemon (trusted) worker2 # [ 155.895801] nix-daemon[861]: reaped child process 1862, status = succeeded lb # [ 155.917459] niks3-server[1130]: 2026/09/25 16:33:59 INFO Received push request method=POST path=/api/pushes worker2 # [ 155.909455] nix-grpc-daemon[1728]: time=2026-09-25T16:33:59.083Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 155.911040] nix-grpc-daemon[1728]: time=2026-09-25T16:33:59.085Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 155.951241] niks3-server[1130]: 2026/09/25 16:33:59 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign worker2 # [ 155.940782] nix-grpc-daemon[1728]: time=2026-09-25T16:33:59.114Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.957575] niks3-server[1130]: 2026/09/25 16:33:59 INFO Signed narinfos id=58 count=1 lb # [ 155.961631] niks3-server[1130]: 2026/09/25 16:33:59 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 155.970897] niks3-server[1130]: 2026/09/25 16:33:59 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 155.978371] niks3-server[1130]: 2026/09/25 16:33:59 INFO Received complete push request method=POST path=/api/pushes/58/complete worker2 # [ 155.971708] nix-grpc-daemon[1728]: time=2026-09-25T16:33:59.145Z level=INFO msg="Upload complete. (169ms)" lb # [ 155.988648] niks3-server[1130]: 2026/09/25 16:33:59 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 155.975183] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 155.980230] nix-grpc-daemon[1636]: ts=2026-09-25T16:33:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 155.989897] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 155.995682] nix-daemon[861]: reaped child process 1857, status = succeeded worker2 # [ 156.000468] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 157.078127] envoy[922]: conn peer=[2001:db8:1::1]:55938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2993 tx=828 ms=3344 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 157.424076] nix-daemon[861]: reaped child process 1866, status = succeeded worker2 # [ 157.496423] nix-daemon[861]: accepted connection from pid 1882, user nix-grpc-daemon (trusted) worker2 # [ 157.508492] nix-daemon[861]: reaped child process 1885, status = succeeded lb # [ 157.533965] niks3-server[1130]: 2026/09/25 16:34:00 INFO Received push request method=POST path=/api/pushes worker2 # [ 157.527826] nix-grpc-daemon[1728]: time=2026-09-25T16:34:00.701Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 157.529501] nix-grpc-daemon[1728]: time=2026-09-25T16:34:00.703Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 157.574546] niks3-server[1130]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 157.586861] niks3-server[1130]: 2026/09/25 16:34:00 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign lb # [ 157.591908] niks3-server[1130]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 157.598825] niks3-server[1130]: 2026/09/25 16:34:00 INFO Signed narinfos id=59 count=1 worker2 # [ 157.585464] nix-grpc-daemon[1728]: time=2026-09-25T16:34:00.759Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.605815] niks3-server[1130]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 157.616234] niks3-server[1130]: 2026/09/25 16:34:00 INFO Received complete push request method=POST path=/api/pushes/59/complete lb # [ 157.621358] niks3-server[1130]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 157.604376] nix-grpc-daemon[1728]: time=2026-09-25T16:34:00.778Z level=INFO msg="Upload complete. (196ms)" worker2 # [ 157.610630] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 157.626163] nix-daemon[861]: reaped child process 1864, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 5.10 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 157.863504] nix-daemon[870]: reaped child process 1732, status = succeeded worker1 # [ 157.939368] nix-daemon[870]: accepted connection from pid 1779, user nix-grpc-daemon (trusted) worker1 # [ 157.951380] nix-daemon[870]: reaped child process 1782, status = succeeded lb # [ 157.972350] niks3-server[1130]: 2026/09/25 16:34:01 INFO Received push request method=POST path=/api/pushes worker1 # [ 157.968305] nix-grpc-daemon[1669]: time=2026-09-25T16:34:00.266Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 157.969845] nix-grpc-daemon[1669]: time=2026-09-25T16:34:00.268Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 158.013162] niks3-server[1130]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 158.020902] niks3-server[1130]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 158.028112] niks3-server[1130]: 2026/09/25 16:34:01 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign lb # [ 158.034791] niks3-server[1130]: 2026/09/25 16:34:01 INFO Signed narinfos id=60 count=1 worker1 # [ 158.024505] nix-grpc-daemon[1669]: time=2026-09-25T16:34:00.322Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.038087] niks3-server[1130]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 158.050676] niks3-server[1130]: 2026/09/25 16:34:01 INFO Received complete push request method=POST path=/api/pushes/60/complete worker1 # [ 158.042342] nix-grpc-daemon[1669]: time=2026-09-25T16:34:00.340Z level=INFO msg="Upload complete. (186ms)" lb # [ 158.056495] niks3-server[1130]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 158.048614] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44170 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 158.065068] nix-daemon[870]: reaped child process 1730, status = succeeded client # [ 158.079372] systemd[1]: sw.service: Deactivated successfully. client # [ 158.083606] systemd[1]: sw.service: Consumed 126ms CPU time over 8.022s wall clock time, 43.4M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.04 seconds) lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 159.040911] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:01Z level=info event=signal_exit lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb # [ 160.056834] niks3-server[1130]: 2026/09/25 16:34:03 INFO lead: released remote=192.168.1.3:58504 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 161.045602] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:03Z level=info event=scheduler_restarting worker2 # [ 161.041867] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:04Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 161.058781] envoy[922]: [2026-09-25 16:34:04.223][922][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 161.052553] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:03Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 161.060146] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44148 worker1 # [ 161.064092] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:03Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 161.067887] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44148 worker1 # [ 161.071314] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:03Z level=info event=worker_gone addr=192.168.1.3:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 161.092137] nix-daemon[870]: reaped child process 1640, status = succeeded worker2 # [ 161.246176] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.250252] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 161.266257] nix-grpc-daemon[1585]: ts=2026-09-25T16:34:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 161.451358] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.455265] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 161.656422] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.660294] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 161.861437] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 161.865412] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.067723] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.070926] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 162.268936] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.272890] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.474136] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.478108] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.679139] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.682980] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 162.884258] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 162.888295] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 163.067303] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 163.071474] systemd[1]: nix-grpc-daemon.service: Consumed 583ms CPU time over 24.163s wall clock time, 36.4M memory peak, 236.2K incoming IP traffic, 68.9K outgoing IP traffic. worker2 # [ 163.090337] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 163.093962] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 163.248341] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 2. worker1 # [ 163.257950] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 163.295141] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 163.299150] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 163.357804] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 163.362126] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 163.366188] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 163.368981] nix-grpc-daemon[1795]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 163.370310] nix-grpc-daemon[1795]: E0000 00:00:1790354045.663398 1795 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 163.372425] nix-grpc-daemon[1795]: E0000 00:00:1790354045.667291 1795 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 163.375055] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 163.378150] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 163.383071] nix-grpc-daemon[1795]: E0000 00:00:1790354045.680937 1838 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 163.396992] niks3-server[1130]: 2026/09/25 16:34:06 INFO lead: acquired remote=192.168.1.3:57190 worker1 # [ 163.387126] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=scheduler_take_over worker1 # [ 163.395797] nix-grpc-daemon[1795]: E0000 00:00:1790354045.694340 1838 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 163.400051] nix-grpc-daemon[1795]: E0000 00:00:1790354045.696687 1838 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 163.410027] nix-grpc-daemon[1795]: E0000 00:00:1790354045.708565 1838 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 163.418920] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 163.420525] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 163.500306] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 163.504227] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 163.621897] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 163.625761] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 163.705308] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 163.709327] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 163.826641] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 163.830670] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 163.910296] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 163.914271] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 164.031368] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 164.035266] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 164.116171] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 164.119981] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 164.235969] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 164.240092] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 164.321379] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 164.325434] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 164.441874] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 164.448574] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:35508 worker1 # [ 164.453352] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 164.526356] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 164.537162] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 164.541321] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:35508 worker1 # [ 164.545238] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 166.176293] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:08Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:35514 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 7.40 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.38 seconds) subtest: queue gauges show a burst while every build blocks lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]' client # [ 166.544353] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # Running as unit: burst.service; invocation ID: c32f0c7fe8c64301bb7d88ea42f54e17 client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 166.686913] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 166.696641] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client # [ 166.701647] nix[1525]: don't know how to build these paths: client # [ 166.702503] nix[1525]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv client # [ 166.703437] nix[1525]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv client # [ 166.705109] nix[1525]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv client # [ 166.706290] nix[1525]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker1 # [ 166.716303] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:09Z level=debug event=want client=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=0 worker1 # [ 166.720522] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:09Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.725780] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:09Z level=debug event=want client=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=0 worker2 # [ 166.721708] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker1 # [ 166.729589] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:09Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.4:50051 clients=1 worker1 # [ 166.731512] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:09Z level=debug event=want client=1 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=0 worker1 # [ 166.733078] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:09Z level=debug event=want client=1 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=0 worker1 # [ 166.734737] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 166.738869] nix-grpc-daemon[1795]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5) worker2 # [ 166.734532] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 client # [ 166.743080] nix[1525]: copying 1 paths to 'lb:50051'... client # [ 166.744624] nix[1525]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'... worker2 # [ 166.744894] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 166.756227] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker1 # [ 166.839239] nix-grpc-daemon[1795]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 2/5) worker2 # [ 166.858206] nix-daemon[861]: accepted connection from pid 1889, user nix-grpc-daemon (trusted) worker2 # [ 166.870220] nix-daemon[861]: reaped child process 1892, status = succeeded lb # [ 166.894346] niks3-server[1130]: 2026/09/25 16:34:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 166.885815] nix-grpc-daemon[1728]: time=2026-09-25T16:34:10.059Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 166.887794] nix-grpc-daemon[1728]: time=2026-09-25T16:34:10.061Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)" lb # [ 166.925751] niks3-server[1130]: 2026/09/25 16:34:10 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls lb # [ 166.937663] niks3-server[1130]: 2026/09/25 16:34:10 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign worker2 # [ 166.929312] nix-grpc-daemon[1728]: time=2026-09-25T16:34:10.103Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.945708] niks3-server[1130]: 2026/09/25 16:34:10 INFO Signed narinfos id=61 count=1 lb # [ 166.956814] niks3-server[1130]: 2026/09/25 16:34:10 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst lb # [ 166.961406] niks3-server[1130]: 2026/09/25 16:34:10 INFO Received complete push request method=POST path=/api/pushes/61/complete lb # [ 166.969070] niks3-server[1130]: 2026/09/25 16:34:10 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo worker2 # [ 166.951920] nix-grpc-daemon[1728]: time=2026-09-25T16:34:10.125Z level=INFO msg="Upload complete. (184ms)" worker2 # [ 166.956653] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 166.962531] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 166.972953] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 166.984136] nix-daemon[861]: reaped child process 1887, status = succeeded worker2 # [ 166.987206] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # [ 166.985478] nix[1525]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051... worker1 # [ 166.995482] nix-grpc-daemon[1795]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 318 ms (attempt 3/5) lb # [ 167.078992] envoy[922]: conn peer=[2001:db8:1::1]:55954 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9607 tx=4360 ms=4938 lb # [ 167.083672] envoy[922]: conn peer=[2001:db8:1::1]:55952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1518 ms=7864 lb # [ 167.087278] envoy[922]: conn peer=[2001:db8:1::3]:47258 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1061 tx=459 ms=22182 worker1 # [ 167.315985] nix-grpc-daemon[1795]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 396 ms (attempt 4/5) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 167.713762] nix-grpc-daemon[1795]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 167.717578] nix-grpc-daemon[1795]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 167.735697] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 client # [ 167.743634] nix[1525]: copying 1 paths to 'lb:50051'... client # [ 167.747143] nix[1525]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'... worker1 # [ 167.752324] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 167.763505] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 167.782892] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:10Z level=info event=niks3_push_started pid=1866 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 167.910297] nix-grpc-daemon[1866]: time=2026-09-25T16:34:10.206Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 167.997135] nix-daemon[870]: accepted connection from pid 1886, user nix-grpc-daemon (trusted) worker2 # [ 168.002790] nix-daemon[861]: reaped child process 1896, status = succeeded worker1 # [ 168.009427] nix-daemon[870]: reaped child process 1889, status = succeeded lb # [ 168.030555] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received push request method=POST path=/api/pushes worker1 # [ 168.029336] nix-grpc-daemon[1866]: time=2026-09-25T16:34:10.327Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 168.030903] nix-grpc-daemon[1866]: time=2026-09-25T16:34:10.329Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)" lb # [ 168.069318] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign lb # [ 168.074556] niks3-server[1130]: 2026/09/25 16:34:11 INFO Signed narinfos id=62 count=1 worker1 # [ 168.064294] nix-grpc-daemon[1866]: time=2026-09-25T16:34:10.362Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.082099] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst lb # [ 168.086962] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls worker2 # [ 168.076751] nix-daemon[861]: accepted connection from pid 1917, user nix-grpc-daemon (trusted) lb # [ 168.096085] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received complete push request method=POST path=/api/pushes/62/complete worker1 # [ 168.087240] nix-grpc-daemon[1866]: time=2026-09-25T16:34:10.385Z level=INFO msg="Upload complete. (178ms)" lb # [ 168.101695] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo worker1 # [ 168.089669] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 168.088894] nix-daemon[861]: reaped child process 1920, status = succeeded worker1 # [ 168.093177] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 lb # [ 168.109975] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received push request method=POST path=/api/pushes worker1 # [ 168.099534] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 168.101870] nix-daemon[870]: reaped child process 1864, status = succeeded worker2 # [ 168.098140] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.271Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 168.099962] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.273Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)" worker1 # [ 168.106867] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) client # [ 168.101628] nix[1525]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051... lb # [ 168.132082] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign lb # [ 168.134336] niks3-server[1130]: 2026/09/25 16:34:11 INFO Signed narinfos id=63 count=1 worker2 # [ 168.119658] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.293Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.138812] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv lb # [ 168.141292] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls lb # [ 168.146755] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received complete push request method=POST path=/api/pushes/63/complete lb # [ 168.149449] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst lb # [ 168.156198] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo worker2 # [ 168.148913] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.322Z level=INFO msg="Upload complete. (155ms)" worker2 # [ 168.151533] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=2 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 168.156262] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:10Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 168.158328] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 168.161774] nix-daemon[861]: reaped child process 1894, status = succeeded worker2 # [ 168.165463] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 client # [ 168.169238] nix[1525]: copying 1 paths to 'lb:50051'... worker2 # [ 168.171056] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 client # [ 168.171347] nix[1525]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'... worker2 # [ 168.178686] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 168.262278] nix-daemon[861]: accepted connection from pid 1924, user nix-grpc-daemon (trusted) worker2 # [ 168.274870] nix-daemon[861]: reaped child process 1927, status = succeeded lb # [ 168.298372] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received push request method=POST path=/api/pushes worker2 # [ 168.291878] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.465Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 168.293771] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.467Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)" lb # [ 168.332829] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls lb # [ 168.336411] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign lb # [ 168.340717] niks3-server[1130]: 2026/09/25 16:34:11 INFO Signed narinfos id=64 count=1 worker2 # [ 168.326708] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.500Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.347340] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst lb # [ 168.356204] niks3-server[1130]: 2026/09/25 16:34:11 INFO Received complete push request method=POST path=/api/pushes/64/complete worker2 # [ 168.344858] nix-grpc-daemon[1728]: time=2026-09-25T16:34:11.518Z level=INFO msg="Upload complete. (160ms)" lb # [ 168.362775] niks3-server[1130]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo worker2 # [ 168.347718] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 168.353078] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 168.359693] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 168.368270] nix-daemon[861]: reaped child process 1922, status = succeeded worker2 # [ 168.371089] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # [ 168.369270] nix[1525]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051... worker1 # [ 170.336548] nix-daemon[870]: reaped child process 1893, status = succeeded worker2 # [ 170.411482] nix-daemon[861]: reaped child process 1931, status = succeeded worker1 # [ 170.419990] nix-daemon[870]: accepted connection from pid 1918, user nix-grpc-daemon (trusted) worker1 # [ 170.431226] nix-daemon[870]: reaped child process 1921, status = succeeded lb # [ 170.452484] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received push request method=POST path=/api/pushes worker1 # [ 170.450443] nix-grpc-daemon[1866]: time=2026-09-25T16:34:12.748Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 170.452030] nix-grpc-daemon[1866]: time=2026-09-25T16:34:12.750Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)" lb # [ 170.493330] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv lb # [ 170.503967] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign worker2 # [ 170.492224] nix-daemon[861]: accepted connection from pid 1956, user nix-grpc-daemon (trusted) worker1 # [ 170.499981] nix-grpc-daemon[1866]: time=2026-09-25T16:34:12.798Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.512445] niks3-server[1130]: 2026/09/25 16:34:13 INFO Signed narinfos id=65 count=1 worker2 # [ 170.504680] nix-daemon[861]: reaped child process 1959, status = succeeded lb # [ 170.519098] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst lb # [ 170.526314] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received push request method=POST path=/api/pushes lb # [ 170.532810] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls lb # [ 170.535864] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received complete push request method=POST path=/api/pushes/65/complete worker2 # [ 170.522799] nix-grpc-daemon[1728]: time=2026-09-25T16:34:13.696Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" lb # [ 170.541588] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo worker1 # [ 170.527707] nix-grpc-daemon[1866]: time=2026-09-25T16:34:12.826Z level=INFO msg="Upload complete. (211ms)" worker2 # [ 170.527326] nix-grpc-daemon[1728]: time=2026-09-25T16:34:13.698Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)" worker1 # [ 170.536577] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=2 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 170.545679] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:12Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.3:50051 clients=1 lb # [ 170.562934] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker1 # [ 170.549949] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 lb # [ 170.569320] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign lb # [ 170.573170] niks3-server[1130]: 2026/09/25 16:34:13 INFO Signed narinfos id=66 count=1 worker2 # [ 170.558590] nix-grpc-daemon[1728]: time=2026-09-25T16:34:13.732Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.574934] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls worker1 # [ 170.562110] nix-daemon[870]: reaped child process 1891, status = succeeded worker1 # [ 170.564150] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 lb # [ 170.578792] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst lb # [ 170.585044] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received complete push request method=POST path=/api/pushes/66/complete worker2 # [ 170.573093] nix-grpc-daemon[1728]: time=2026-09-25T16:34:13.747Z level=INFO msg="Upload complete. (193ms)" lb # [ 170.590509] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo client # [ 170.572829] nix[1525]: copying 1 paths to 'lb:50051'... worker1 # [ 170.578224] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker2 # [ 170.576060] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=3 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 client # [ 170.576130] nix[1525]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'... worker2 # [ 170.583139] nix-daemon[861]: reaped child process 1929, status = succeeded worker1 # [ 170.590200] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 170.677940] nix-daemon[870]: accepted connection from pid 1925, user nix-grpc-daemon (trusted) worker1 # [ 170.690648] nix-daemon[870]: reaped child process 1928, status = succeeded lb # [ 170.710735] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received push request method=POST path=/api/pushes worker1 # [ 170.705921] nix-grpc-daemon[1866]: time=2026-09-25T16:34:13.004Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 170.707481] nix-grpc-daemon[1866]: time=2026-09-25T16:34:13.006Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)" lb # [ 170.741741] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst lb # [ 170.749361] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign worker1 # [ 170.742968] nix-grpc-daemon[1866]: time=2026-09-25T16:34:13.041Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.755789] niks3-server[1130]: 2026/09/25 16:34:13 INFO Signed narinfos id=67 count=1 lb # [ 170.767501] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls lb # [ 170.773077] niks3-server[1130]: 2026/09/25 16:34:13 INFO Received complete push request method=POST path=/api/pushes/67/complete worker1 # [ 170.767825] nix-grpc-daemon[1866]: time=2026-09-25T16:34:13.066Z level=INFO msg="Upload complete. (169ms)" lb # [ 170.782279] niks3-server[1130]: 2026/09/25 16:34:13 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo worker1 # [ 170.771909] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 170.777538] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 170.785697] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 170.794267] nix-daemon[870]: reaped child process 1923, status = succeeded worker1 # [ 170.798673] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) client # [ 170.793531] nix[1525]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051... worker1 # [ 172.641528] nix-daemon[870]: reaped child process 1932, status = succeeded worker1 # [ 172.716980] nix-daemon[870]: accepted connection from pid 1957, user nix-grpc-daemon (trusted) worker1 # [ 172.729443] nix-daemon[870]: reaped child process 1960, status = succeeded lb # [ 172.750494] niks3-server[1130]: 2026/09/25 16:34:15 INFO Received push request method=POST path=/api/pushes worker1 # [ 172.744958] nix-grpc-daemon[1866]: time=2026-09-25T16:34:15.043Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.746454] nix-grpc-daemon[1866]: time=2026-09-25T16:34:15.045Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)" lb # [ 172.786143] niks3-server[1130]: 2026/09/25 16:34:15 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls lb # [ 172.797120] niks3-server[1130]: 2026/09/25 16:34:15 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign worker1 # [ 172.788419] nix-grpc-daemon[1866]: time=2026-09-25T16:34:15.086Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.801790] niks3-server[1130]: 2026/09/25 16:34:15 INFO Signed narinfos id=68 count=1 lb # [ 172.810816] niks3-server[1130]: 2026/09/25 16:34:15 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv lb # [ 172.817817] niks3-server[1130]: 2026/09/25 16:34:15 INFO Received complete push request method=POST path=/api/pushes/68/complete lb # [ 172.826964] niks3-server[1130]: 2026/09/25 16:34:15 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 172.833135] niks3-server[1130]: 2026/09/25 16:34:15 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo worker1 # [ 172.818732] nix-grpc-daemon[1866]: time=2026-09-25T16:34:15.117Z level=INFO msg="Upload complete. (212ms)" worker1 # [ 172.825636] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 172.841251] nix-daemon[870]: reaped child process 1930, status = succeeded client # [ 172.856519] systemd[1]: burst.service: Deactivated successfully. client # [ 172.860541] systemd[1]: burst.service: Consumed 157ms CPU time over 6.316s wall clock time, 51.9M memory peak, 14K incoming IP traffic, 18.7K outgoing IP traffic. client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; } client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: queue gauges show a burst while every build blocks, in 7.52 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 174.065069] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35518 worker2 # [ 174.065859] nix-grpc-daemon[1636]: ts=2026-09-25T16:34:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 worker1 # [ 174.109985] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=want client=2 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker1 # [ 174.116388] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 174.121215] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=want client=2 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker1 # [ 174.125111] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=want client=2 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 174.128973] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 174.139566] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 174.151909] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 174.162221] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 174.257884] nix-daemon[870]: accepted connection from pid 1976, user nix-grpc-daemon (trusted) worker1 # [ 174.270473] nix-daemon[870]: reaped child process 1979, status = succeeded lb # [ 174.290776] niks3-server[1130]: 2026/09/25 16:34:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 174.286880] nix-grpc-daemon[1866]: time=2026-09-25T16:34:16.585Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 174.288874] nix-grpc-daemon[1866]: time=2026-09-25T16:34:16.586Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 174.323198] niks3-server[1130]: 2026/09/25 16:34:17 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign lb # [ 174.326569] niks3-server[1130]: 2026/09/25 16:34:17 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls worker1 # [ 174.322388] nix-grpc-daemon[1866]: time=2026-09-25T16:34:16.620Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.334860] niks3-server[1130]: 2026/09/25 16:34:17 INFO Signed narinfos id=69 count=1 lb # [ 174.340990] niks3-server[1130]: 2026/09/25 16:34:17 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 174.350333] niks3-server[1130]: 2026/09/25 16:34:17 INFO Received complete push request method=POST path=/api/pushes/69/complete worker1 # [ 174.342046] nix-grpc-daemon[1866]: time=2026-09-25T16:34:16.640Z level=INFO msg="Upload complete. (169ms)" lb # [ 174.356822] niks3-server[1130]: 2026/09/25 16:34:17 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 174.345740] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 174.350642] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 174.361136] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 174.364875] nix-daemon[870]: reaped child process 1974, status = succeeded worker1 # [ 174.369662] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 175.803612] nix-daemon[870]: reaped child process 1983, status = succeeded worker1 # [ 175.887925] nix-daemon[870]: accepted connection from pid 1999, user nix-grpc-daemon (trusted) worker1 # [ 175.900148] nix-daemon[870]: reaped child process 2002, status = succeeded lb # [ 175.921476] niks3-server[1130]: 2026/09/25 16:34:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 175.917821] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.216Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 175.919638] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.217Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 175.962127] niks3-server[1130]: 2026/09/25 16:34:19 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign worker1 # [ 175.953715] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.252Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.967094] niks3-server[1130]: 2026/09/25 16:34:19 INFO Signed narinfos id=70 count=1 lb # [ 175.977064] niks3-server[1130]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 175.985119] niks3-server[1130]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 175.990843] niks3-server[1130]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 175.999067] niks3-server[1130]: 2026/09/25 16:34:19 INFO Received complete push request method=POST path=/api/pushes/70/complete worker1 # [ 175.990434] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.288Z level=INFO msg="Upload complete. (210ms)" lb # [ 176.004411] niks3-server[1130]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 176.001183] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 176.009838] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 176.014660] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 176.018187] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=debug event=want client=2 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 176.028284] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 176.031220] nix-daemon[870]: reaped child process 1981, status = succeeded worker1 # [ 176.035877] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 176.039432] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 176.123535] nix-daemon[870]: accepted connection from pid 2008, user nix-grpc-daemon (trusted) worker1 # [ 176.137474] nix-daemon[870]: reaped child process 2011, status = succeeded lb # [ 176.155205] niks3-server[1130]: 2026/09/25 16:34:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 176.150317] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.448Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 176.152440] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.450Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 176.183227] niks3-server[1130]: 2026/09/25 16:34:19 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign lb # [ 176.188471] niks3-server[1130]: 2026/09/25 16:34:19 INFO Signed narinfos id=71 count=1 worker1 # [ 176.178568] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.477Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.198515] niks3-server[1130]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 176.207878] niks3-server[1130]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 176.215084] niks3-server[1130]: 2026/09/25 16:34:19 INFO Received complete push request method=POST path=/api/pushes/71/complete lb # [ 176.225669] niks3-server[1130]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 176.211988] nix-grpc-daemon[1866]: time=2026-09-25T16:34:18.510Z level=INFO msg="Upload complete. (167ms)" worker1 # [ 176.216319] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 176.221328] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 176.230536] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 176.236189] nix-daemon[870]: reaped child process 2006, status = succeeded worker1 # [ 176.241535] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) lb # [ 177.079876] envoy[922]: conn peer=[2001:db8:1::1]:48862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9664 tx=5201 ms=6157 worker1 # [ 177.479526] nix-daemon[870]: reaped child process 2015, status = succeeded worker1 # [ 177.560583] nix-daemon[870]: accepted connection from pid 2031, user nix-grpc-daemon (trusted) worker1 # [ 177.572831] nix-daemon[870]: reaped child process 2034, status = succeeded lb # [ 177.594573] niks3-server[1130]: 2026/09/25 16:34:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 177.589940] nix-grpc-daemon[1866]: time=2026-09-25T16:34:19.888Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 177.591440] nix-grpc-daemon[1866]: time=2026-09-25T16:34:19.890Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 177.637610] niks3-server[1130]: 2026/09/25 16:34:20 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 177.643536] niks3-server[1130]: 2026/09/25 16:34:20 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 177.650114] niks3-server[1130]: 2026/09/25 16:34:20 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign lb # [ 177.654146] niks3-server[1130]: 2026/09/25 16:34:20 INFO Signed narinfos id=72 count=1 worker1 # [ 177.644466] nix-grpc-daemon[1866]: time=2026-09-25T16:34:19.942Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.663987] niks3-server[1130]: 2026/09/25 16:34:20 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 177.675469] niks3-server[1130]: 2026/09/25 16:34:20 INFO Received complete push request method=POST path=/api/pushes/72/complete worker1 # [ 177.666689] nix-grpc-daemon[1866]: time=2026-09-25T16:34:19.965Z level=INFO msg="Upload complete. (218ms)" lb # [ 177.681539] niks3-server[1130]: 2026/09/25 16:34:20 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 177.672763] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=6 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 177.685633] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:19Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 177.690230] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 177.694238] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:19Z level=debug event=want client=2 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 177.704276] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 177.706512] nix-daemon[870]: reaped child process 2013, status = succeeded worker1 # [ 177.710931] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 177.714677] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 177.799483] nix-daemon[870]: accepted connection from pid 2040, user nix-grpc-daemon (trusted) worker1 # [ 177.811702] nix-daemon[870]: reaped child process 2043, status = succeeded lb # [ 177.832398] niks3-server[1130]: 2026/09/25 16:34:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 177.828518] nix-grpc-daemon[1866]: time=2026-09-25T16:34:20.127Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 177.830025] nix-grpc-daemon[1866]: time=2026-09-25T16:34:20.128Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 177.864822] niks3-server[1130]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 177.870790] niks3-server[1130]: 2026/09/25 16:34:21 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign lb # [ 177.877233] niks3-server[1130]: 2026/09/25 16:34:21 INFO Signed narinfos id=73 count=1 worker1 # [ 177.867580] nix-grpc-daemon[1866]: time=2026-09-25T16:34:20.166Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.888945] niks3-server[1130]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 177.899136] niks3-server[1130]: 2026/09/25 16:34:21 INFO Received complete push request method=POST path=/api/pushes/73/complete worker1 # [ 177.893174] nix-grpc-daemon[1866]: time=2026-09-25T16:34:20.191Z level=INFO msg="Upload complete. (173ms)" lb # [ 177.907764] niks3-server[1130]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 177.897182] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 177.903250] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 177.912484] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 177.918878] nix-daemon[870]: reaped child process 2038, status = succeeded worker1 # [ 177.923638] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 179.338253] nix-daemon[870]: reaped child process 2047, status = succeeded worker1 # [ 179.415024] nix-daemon[870]: accepted connection from pid 2063, user nix-grpc-daemon (trusted) worker1 # [ 179.426145] nix-daemon[870]: reaped child process 2066, status = succeeded lb # [ 179.447473] niks3-server[1130]: 2026/09/25 16:34:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 179.443039] nix-grpc-daemon[1866]: time=2026-09-25T16:34:21.741Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 179.444511] nix-grpc-daemon[1866]: time=2026-09-25T16:34:21.743Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 179.493297] niks3-server[1130]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 179.496643] niks3-server[1130]: 2026/09/25 16:34:22 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign lb # [ 179.501877] niks3-server[1130]: 2026/09/25 16:34:22 INFO Signed narinfos id=74 count=1 worker1 # [ 179.492033] nix-grpc-daemon[1866]: time=2026-09-25T16:34:21.790Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.510580] niks3-server[1130]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 179.519596] niks3-server[1130]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 179.528087] niks3-server[1130]: 2026/09/25 16:34:22 INFO Received complete push request method=POST path=/api/pushes/74/complete lb # [ 179.535956] niks3-server[1130]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 179.522455] nix-grpc-daemon[1866]: time=2026-09-25T16:34:21.820Z level=INFO msg="Upload complete. (192ms)" worker1 # [ 179.532487] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=7 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 179.542481] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:21Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 179.547202] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 179.550589] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:21Z level=debug event=want client=2 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 179.561422] nix-daemon[870]: reaped child process 2045, status = succeeded worker1 # [ 179.562825] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 179.570419] nix-grpc-daemon[1866]: time=2026-09-25T16:34:21.868Z level=INFO msg="All 1 paths already cached" worker1 # [ 179.574884] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 179.579357] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 179.664106] nix-daemon[870]: accepted connection from pid 2072, user nix-grpc-daemon (trusted) worker1 # [ 179.677694] nix-daemon[870]: reaped child process 2075, status = succeeded lb # [ 179.696421] niks3-server[1130]: 2026/09/25 16:34:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 179.690835] nix-grpc-daemon[1866]: time=2026-09-25T16:34:21.989Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 179.692638] nix-grpc-daemon[1866]: time=2026-09-25T16:34:21.990Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 179.724812] niks3-server[1130]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 179.732172] niks3-server[1130]: 2026/09/25 16:34:22 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign worker1 # [ 179.723962] nix-grpc-daemon[1866]: time=2026-09-25T16:34:22.022Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.738080] niks3-server[1130]: 2026/09/25 16:34:22 INFO Signed narinfos id=75 count=1 lb # [ 179.753930] niks3-server[1130]: 2026/09/25 16:34:22 INFO Received complete push request method=POST path=/api/pushes/75/complete lb # [ 179.756760] niks3-server[1130]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls worker1 # [ 179.750896] nix-grpc-daemon[1866]: time=2026-09-25T16:34:22.049Z level=INFO msg="Upload complete. (166ms)" lb # [ 179.766260] niks3-server[1130]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 179.755104] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 179.759922] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 179.769259] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 179.775142] nix-daemon[870]: reaped child process 2070, status = succeeded worker1 # [ 179.778514] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 180.992756] nix-daemon[870]: reaped child process 2079, status = succeeded worker1 # [ 181.068067] nix-daemon[870]: accepted connection from pid 2095, user nix-grpc-daemon (trusted) worker1 # [ 181.080295] nix-daemon[870]: reaped child process 2098, status = succeeded lb # [ 181.101826] niks3-server[1130]: 2026/09/25 16:34:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 181.097085] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.395Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 181.098616] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.397Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 181.142989] niks3-server[1130]: 2026/09/25 16:34:24 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign lb # [ 181.147201] niks3-server[1130]: 2026/09/25 16:34:24 INFO Signed narinfos id=76 count=1 worker1 # [ 181.136999] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.435Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.153960] niks3-server[1130]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 181.158652] niks3-server[1130]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 181.166267] niks3-server[1130]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 181.175389] niks3-server[1130]: 2026/09/25 16:34:24 INFO Received complete push request method=POST path=/api/pushes/76/complete worker1 # [ 181.166780] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.465Z level=INFO msg="Upload complete. (181ms)" lb # [ 181.181159] niks3-server[1130]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 181.175711] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=8 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 181.181000] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 181.188634] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 181.192183] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=debug event=want client=2 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 181.201290] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 181.203253] nix-daemon[870]: reaped child process 2077, status = succeeded worker1 # [ 181.208839] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.507Z level=INFO msg="All 1 paths already cached" worker1 # [ 181.213136] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 181.217667] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 181.301253] nix-daemon[870]: accepted connection from pid 2104, user nix-grpc-daemon (trusted) worker1 # [ 181.313398] nix-daemon[870]: reaped child process 2107, status = succeeded lb # [ 181.334542] niks3-server[1130]: 2026/09/25 16:34:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 181.329191] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.627Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 181.331224] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.629Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 181.364362] niks3-server[1130]: 2026/09/25 16:34:24 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign lb # [ 181.369546] niks3-server[1130]: 2026/09/25 16:34:24 INFO Signed narinfos id=77 count=1 worker1 # [ 181.359648] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.658Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.377642] niks3-server[1130]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 181.389824] niks3-server[1130]: 2026/09/25 16:34:24 INFO Received complete push request method=POST path=/api/pushes/77/complete lb # [ 181.396735] niks3-server[1130]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls worker1 # [ 181.389065] nix-grpc-daemon[1866]: time=2026-09-25T16:34:23.687Z level=INFO msg="Upload complete. (167ms)" lb # [ 181.406888] niks3-server[1130]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 181.393061] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 181.398193] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 181.408060] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 181.413122] nix-daemon[870]: reaped child process 2102, status = succeeded worker1 # [ 181.416363] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 182.455073] nix-daemon[870]: reaped child process 2111, status = succeeded worker1 # [ 182.533736] nix-daemon[870]: accepted connection from pid 2127, user nix-grpc-daemon (trusted) worker1 # [ 182.547462] nix-daemon[870]: reaped child process 2130, status = succeeded lb # [ 182.566285] niks3-server[1130]: 2026/09/25 16:34:25 INFO Received push request method=POST path=/api/pushes worker1 # [ 182.561331] nix-grpc-daemon[1866]: time=2026-09-25T16:34:24.859Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 182.562987] nix-grpc-daemon[1866]: time=2026-09-25T16:34:24.861Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 182.610333] niks3-server[1130]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 182.618067] niks3-server[1130]: 2026/09/25 16:34:25 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign worker1 # [ 182.610873] nix-grpc-daemon[1866]: time=2026-09-25T16:34:24.909Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.623130] niks3-server[1130]: 2026/09/25 16:34:25 INFO Signed narinfos id=78 count=1 lb # [ 182.632529] niks3-server[1130]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 182.643401] niks3-server[1130]: 2026/09/25 16:34:25 INFO Received complete push request method=POST path=/api/pushes/78/complete lb # [ 182.647592] niks3-server[1130]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker1 # [ 182.639138] nix-grpc-daemon[1866]: time=2026-09-25T16:34:24.937Z level=INFO msg="Upload complete. (214ms)" lb # [ 182.654304] niks3-server[1130]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 182.651266] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=9 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 182.659354] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:24Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 182.664186] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 182.667324] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:24Z level=debug event=want client=2 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 182.676502] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 182.679947] nix-daemon[870]: reaped child process 2109, status = succeeded worker1 # [ 182.684537] nix-grpc-daemon[1866]: time=2026-09-25T16:34:24.983Z level=INFO msg="All 1 paths already cached" worker1 # [ 182.688781] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 182.692716] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 182.777187] nix-daemon[870]: accepted connection from pid 2136, user nix-grpc-daemon (trusted) worker1 # [ 182.790545] nix-daemon[870]: reaped child process 2139, status = succeeded lb # [ 182.809528] niks3-server[1130]: 2026/09/25 16:34:25 INFO Received push request method=POST path=/api/pushes worker1 # [ 182.804378] nix-grpc-daemon[1866]: time=2026-09-25T16:34:25.102Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 182.805859] nix-grpc-daemon[1866]: time=2026-09-25T16:34:25.104Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 182.842897] niks3-server[1130]: 2026/09/25 16:34:26 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign worker1 # [ 182.835337] nix-grpc-daemon[1866]: time=2026-09-25T16:34:25.133Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.848659] niks3-server[1130]: 2026/09/25 16:34:26 INFO Signed narinfos id=79 count=1 lb # [ 182.851913] niks3-server[1130]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 182.866068] niks3-server[1130]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 182.869391] niks3-server[1130]: 2026/09/25 16:34:26 INFO Received complete push request method=POST path=/api/pushes/79/complete worker1 # [ 182.865847] nix-grpc-daemon[1866]: time=2026-09-25T16:34:25.164Z level=INFO msg="Upload complete. (167ms)" lb # [ 182.881203] niks3-server[1130]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 182.869819] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 182.874652] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 182.886136] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 182.891125] nix-daemon[870]: reaped child process 2134, status = succeeded worker1 # [ 182.894145] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 184.109659] nix-daemon[870]: reaped child process 2143, status = succeeded worker1 # [ 184.186477] nix-daemon[870]: accepted connection from pid 2159, user nix-grpc-daemon (trusted) worker1 # [ 184.198817] nix-daemon[870]: reaped child process 2162, status = succeeded lb # [ 184.219926] niks3-server[1130]: 2026/09/25 16:34:27 INFO Received push request method=POST path=/api/pushes worker1 # [ 184.215888] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.514Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 184.217451] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.516Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 184.270237] niks3-server[1130]: 2026/09/25 16:34:27 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign lb # [ 184.271780] niks3-server[1130]: 2026/09/25 16:34:27 INFO Signed narinfos id=80 count=1 worker1 # [ 184.260360] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.277289] niks3-server[1130]: 2026/09/25 16:34:27 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 184.280566] niks3-server[1130]: 2026/09/25 16:34:27 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 184.283228] niks3-server[1130]: 2026/09/25 16:34:27 INFO Received complete push request method=POST path=/api/pushes/80/complete lb # [ 184.288514] niks3-server[1130]: 2026/09/25 16:34:27 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 184.291545] niks3-server[1130]: 2026/09/25 16:34:27 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 184.277853] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.576Z level=INFO msg="Upload complete. (176ms)" worker1 # [ 184.287347] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=10 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 184.294599] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 184.298219] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 184.300099] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=debug event=want client=2 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 184.306862] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 184.308972] nix-daemon[870]: reaped child process 2141, status = succeeded worker1 # [ 184.312850] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.611Z level=INFO msg="All 2 paths already cached" worker1 # [ 184.316701] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 184.320415] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 184.405167] nix-daemon[870]: accepted connection from pid 2168, user nix-grpc-daemon (trusted) worker1 # [ 184.417436] nix-daemon[870]: reaped child process 2171, status = succeeded lb # [ 184.438742] niks3-server[1130]: 2026/09/25 16:34:27 INFO Received push request method=POST path=/api/pushes worker1 # [ 184.433622] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.732Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 184.435626] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.733Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 184.467346] niks3-server[1130]: 2026/09/25 16:34:27 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign lb # [ 184.474552] niks3-server[1130]: 2026/09/25 16:34:27 INFO Signed narinfos id=81 count=1 worker1 # [ 184.464132] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.762Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.479083] niks3-server[1130]: 2026/09/25 16:34:27 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 184.489696] niks3-server[1130]: 2026/09/25 16:34:27 INFO Received complete push request method=POST path=/api/pushes/81/complete lb # [ 184.493445] niks3-server[1130]: 2026/09/25 16:34:27 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 184.497382] niks3-server[1130]: 2026/09/25 16:34:27 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 184.489156] nix-grpc-daemon[1866]: time=2026-09-25T16:34:26.787Z level=INFO msg="Upload complete. (163ms)" worker1 # [ 184.492783] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 184.497652] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 184.507477] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 184.511128] nix-daemon[870]: reaped child process 2166, status = succeeded worker1 # [ 184.516047] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 185.551169] nix-daemon[870]: reaped child process 2175, status = succeeded worker1 # [ 185.636285] nix-daemon[870]: accepted connection from pid 2191, user nix-grpc-daemon (trusted) worker1 # [ 185.650828] nix-daemon[870]: reaped child process 2194, status = succeeded lb # [ 185.669925] niks3-server[1130]: 2026/09/25 16:34:28 INFO Received push request method=POST path=/api/pushes worker1 # [ 185.666341] nix-grpc-daemon[1866]: time=2026-09-25T16:34:27.964Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 185.667893] nix-grpc-daemon[1866]: time=2026-09-25T16:34:27.966Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 185.708800] niks3-server[1130]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 185.715624] niks3-server[1130]: 2026/09/25 16:34:28 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign lb # [ 185.720515] niks3-server[1130]: 2026/09/25 16:34:28 INFO Signed narinfos id=82 count=1 worker1 # [ 185.710651] nix-grpc-daemon[1866]: time=2026-09-25T16:34:28.009Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.727629] niks3-server[1130]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 185.735796] niks3-server[1130]: 2026/09/25 16:34:28 INFO Received complete push request method=POST path=/api/pushes/82/complete lb # [ 185.738119] niks3-server[1130]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 185.744705] niks3-server[1130]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 185.730588] nix-grpc-daemon[1866]: time=2026-09-25T16:34:28.029Z level=INFO msg="Upload complete. (205ms)" worker1 # [ 185.739062] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=11 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 185.745522] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:28Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 185.749577] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 185.759302] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 185.762583] nix-daemon[870]: reaped child process 2173, status = succeeded worker1 # [ 185.766583] nix-grpc-daemon[1866]: time=2026-09-25T16:34:28.065Z level=INFO msg="All 2 paths already cached" worker1 # [ 185.770580] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 185.774361] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 185.858253] nix-daemon[870]: accepted connection from pid 2198, user nix-grpc-daemon (trusted) worker1 # [ 185.870584] nix-daemon[870]: reaped child process 2201, status = succeeded lb # [ 185.892155] niks3-server[1130]: 2026/09/25 16:34:29 INFO Received push request method=POST path=/api/pushes worker1 # [ 185.888375] nix-grpc-daemon[1866]: time=2026-09-25T16:34:28.186Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 185.890378] nix-grpc-daemon[1866]: time=2026-09-25T16:34:28.188Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 185.921683] niks3-server[1130]: 2026/09/25 16:34:29 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign lb # [ 185.926927] niks3-server[1130]: 2026/09/25 16:34:29 INFO Signed narinfos id=83 count=1 worker1 # [ 185.917721] nix-grpc-daemon[1866]: time=2026-09-25T16:34:28.216Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.936129] niks3-server[1130]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 185.943626] niks3-server[1130]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 185.952593] niks3-server[1130]: 2026/09/25 16:34:29 INFO Received complete push request method=POST path=/api/pushes/83/complete worker1 # [ 185.942850] nix-grpc-daemon[1866]: time=2026-09-25T16:34:28.241Z level=INFO msg="Upload complete. (163ms)" lb # [ 185.957675] niks3-server[1130]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 185.945216] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 185.950484] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 185.958252] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 185.963418] nix-daemon[870]: reaped child process 2196, status = succeeded worker1 # [ 185.967850] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 187.408753] nix-daemon[870]: reaped child process 2205, status = succeeded worker1 # [ 187.487086] nix-daemon[870]: accepted connection from pid 2221, user nix-grpc-daemon (trusted) worker1 # [ 187.498218] nix-daemon[870]: reaped child process 2224, status = succeeded lb # [ 187.520340] niks3-server[1130]: 2026/09/25 16:34:30 INFO Received push request method=POST path=/api/pushes worker1 # [ 187.516318] nix-grpc-daemon[1866]: time=2026-09-25T16:34:29.814Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 187.518189] nix-grpc-daemon[1866]: time=2026-09-25T16:34:29.816Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 187.559861] niks3-server[1130]: 2026/09/25 16:34:30 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 187.565889] niks3-server[1130]: 2026/09/25 16:34:30 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 187.575123] niks3-server[1130]: 2026/09/25 16:34:30 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign worker1 # [ 187.567768] nix-grpc-daemon[1866]: time=2026-09-25T16:34:29.866Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.579992] niks3-server[1130]: 2026/09/25 16:34:30 INFO Signed narinfos id=84 count=1 lb # [ 187.592242] niks3-server[1130]: 2026/09/25 16:34:30 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 187.599174] niks3-server[1130]: 2026/09/25 16:34:30 INFO Received complete push request method=POST path=/api/pushes/84/complete lb # [ 187.603454] niks3-server[1130]: 2026/09/25 16:34:30 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 187.593421] nix-grpc-daemon[1866]: time=2026-09-25T16:34:29.891Z level=INFO msg="Upload complete. (217ms)" worker1 # [ 187.602323] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=12 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 187.609898] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:29Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 187.614960] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 187.626557] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 187.632542] nix-daemon[870]: reaped child process 2203, status = succeeded worker1 # [ 187.639061] nix-grpc-daemon[1866]: time=2026-09-25T16:34:29.937Z level=INFO msg="All 2 paths already cached" worker1 # [ 187.645889] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 187.651853] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 187.736759] nix-daemon[870]: accepted connection from pid 2228, user nix-grpc-daemon (trusted) worker1 # [ 187.750687] nix-daemon[870]: reaped child process 2231, status = succeeded lb # [ 187.768364] niks3-server[1130]: 2026/09/25 16:34:30 INFO Received push request method=POST path=/api/pushes worker1 # [ 187.763928] nix-grpc-daemon[1866]: time=2026-09-25T16:34:30.062Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 187.765842] nix-grpc-daemon[1866]: time=2026-09-25T16:34:30.063Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 187.799591] niks3-server[1130]: 2026/09/25 16:34:30 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 187.807992] niks3-server[1130]: 2026/09/25 16:34:30 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign worker1 # [ 187.801304] nix-grpc-daemon[1866]: time=2026-09-25T16:34:30.099Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.815355] niks3-server[1130]: 2026/09/25 16:34:30 INFO Signed narinfos id=85 count=1 lb # [ 187.821463] niks3-server[1130]: 2026/09/25 16:34:30 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 187.831541] niks3-server[1130]: 2026/09/25 16:34:30 INFO Received complete push request method=POST path=/api/pushes/85/complete worker1 # [ 187.827849] nix-grpc-daemon[1866]: time=2026-09-25T16:34:30.126Z level=INFO msg="Upload complete. (170ms)" lb # [ 187.841955] niks3-server[1130]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 187.831273] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 187.836587] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1 # [ 187.846202] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 187.853870] nix-daemon[870]: reaped child process 2226, status = succeeded worker1 # [ 187.858511] nix-daemon[870]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 189.294759] nix-daemon[870]: reaped child process 2235, status = succeeded worker1 # [ 189.373353] nix-daemon[870]: accepted connection from pid 2251, user nix-grpc-daemon (trusted) worker1 # [ 189.386342] nix-daemon[870]: reaped child process 2254, status = succeeded lb # [ 189.406442] niks3-server[1130]: 2026/09/25 16:34:32 INFO Received push request method=POST path=/api/pushes worker1 # [ 189.402372] nix-grpc-daemon[1866]: time=2026-09-25T16:34:31.700Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 189.404543] nix-grpc-daemon[1866]: time=2026-09-25T16:34:31.702Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 189.449630] niks3-server[1130]: 2026/09/25 16:34:32 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign worker1 # [ 189.441677] nix-grpc-daemon[1866]: time=2026-09-25T16:34:31.740Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.454581] niks3-server[1130]: 2026/09/25 16:34:32 INFO Signed narinfos id=86 count=1 lb # [ 189.462146] niks3-server[1130]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 189.469690] niks3-server[1130]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 189.474535] niks3-server[1130]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 189.483236] niks3-server[1130]: 2026/09/25 16:34:32 INFO Received complete push request method=POST path=/api/pushes/86/complete worker1 # [ 189.479256] nix-grpc-daemon[1866]: time=2026-09-25T16:34:31.777Z level=INFO msg="Upload complete. (212ms)" lb # [ 189.494303] niks3-server[1130]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 189.487217] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35518 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=13 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 189.503305] nix-daemon[870]: reaped child process 2233, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.61 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 189.612840] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 41c23845c53e41cebbefa6a6f63eed31 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 189.750732] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35518 client # [ 189.751142] nix[1599]: don't know how to build these paths: client # [ 189.752054] nix[1599]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 189.757594] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35518 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 189.776487] nix-grpc-daemon[1795]: ts=2026-09-25T16:34:32Z level=debug event=want client=3 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 189.775990] nix[1599]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 197.081954] envoy[922]: conn peer=[2001:db8:1::1]:33236 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27206 tx=12350 ms=15445 client # [ 219.777293] nix[1599]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 219.786848] nix[1599]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 219.818982] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 219.822649] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 219.826951] systemd[1]: gpu.service: Consumed 152ms CPU time over 30.207s wall clock time, 37.6M memory peak, 5.6K incoming IP traffic, 5.3K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.41 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 46.52 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.90 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 221.398353] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:03Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 222.551533] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 222.557469] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 worker1 # [ 222.582566] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:04Z level=debug event=want client=4 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 222.580469] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker1 # [ 222.586831] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:04Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 222.592075] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 222.603172] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 222.611916] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 222.711055] nix-daemon[861]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 222.722991] nix-daemon[861]: reaped child process 1978, status = succeeded lb # [ 222.748338] niks3-server[1130]: 2026/09/25 16:35:05 INFO Received push request method=POST path=/api/pushes worker2 # [ 222.741228] nix-grpc-daemon[1728]: time=2026-09-25T16:35:05.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 222.743194] nix-grpc-daemon[1728]: time=2026-09-25T16:35:05.916Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 222.782803] niks3-server[1130]: 2026/09/25 16:35:05 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign worker2 # [ 222.778180] nix-grpc-daemon[1728]: time=2026-09-25T16:35:05.952Z level=INFO msg="Uploading 1 narinfos" lb # [ 222.794412] niks3-server[1130]: 2026/09/25 16:35:05 INFO Signed narinfos id=87 count=1 lb # [ 222.809837] niks3-server[1130]: 2026/09/25 16:35:05 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 222.818975] niks3-server[1130]: 2026/09/25 16:35:05 INFO Received complete push request method=POST path=/api/pushes/87/complete worker2 # [ 222.810229] nix-grpc-daemon[1728]: time=2026-09-25T16:35:05.984Z level=INFO msg="Upload complete. (184ms)" lb # [ 222.830162] niks3-server[1130]: 2026/09/25 16:35:05 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls worker2 # [ 222.815483] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 222.836214] niks3-server[1130]: 2026/09/25 16:35:06 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 222.822275] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 222.832214] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 222.844244] nix-daemon[861]: reaped child process 1973, status = succeeded worker2 # [ 222.848177] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 223.886592] nix-daemon[861]: reaped child process 1982, status = succeeded worker2 # [ 223.967634] nix-daemon[861]: accepted connection from pid 1998, user nix-grpc-daemon (trusted) worker2 # [ 223.981611] nix-daemon[861]: reaped child process 2001, status = succeeded lb # [ 224.002759] niks3-server[1130]: 2026/09/25 16:35:07 INFO Received push request method=POST path=/api/pushes worker2 # [ 223.997621] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.171Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 223.999474] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.173Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 224.044855] niks3-server[1130]: 2026/09/25 16:35:07 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign lb # [ 224.050625] niks3-server[1130]: 2026/09/25 16:35:07 INFO Signed narinfos id=88 count=1 worker2 # [ 224.037203] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.211Z level=INFO msg="Uploading 1 narinfos" lb # [ 224.054568] niks3-server[1130]: 2026/09/25 16:35:07 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 224.062728] niks3-server[1130]: 2026/09/25 16:35:07 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 224.068335] niks3-server[1130]: 2026/09/25 16:35:07 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 224.074057] niks3-server[1130]: 2026/09/25 16:35:07 INFO Received complete push request method=POST path=/api/pushes/88/complete worker2 # [ 224.065137] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.239Z level=INFO msg="Upload complete. (209ms)" lb # [ 224.083498] niks3-server[1130]: 2026/09/25 16:35:07 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 224.072236] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=14 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 224.081905] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:06Z level=debug event=want client=4 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 224.081707] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker1 # [ 224.086482] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:06Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 224.092494] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 224.098240] nix-daemon[861]: reaped child process 1980, status = succeeded worker2 # [ 224.103849] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.277Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 224.110660] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 224.118104] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 224.200308] nix-daemon[861]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker2 # [ 224.212408] nix-daemon[861]: reaped child process 2008, status = succeeded lb # [ 224.236282] niks3-server[1130]: 2026/09/25 16:35:07 INFO Received push request method=POST path=/api/pushes worker2 # [ 224.228674] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.402Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 224.230670] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.404Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 224.265923] niks3-server[1130]: 2026/09/25 16:35:07 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 224.272861] niks3-server[1130]: 2026/09/25 16:35:07 INFO Received sign narinfos request method=POST path=/api/pushes/89/sign lb # [ 224.277435] niks3-server[1130]: 2026/09/25 16:35:07 INFO Signed narinfos id=89 count=1 worker2 # [ 224.263444] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.437Z level=INFO msg="Uploading 1 narinfos" lb # [ 224.284091] niks3-server[1130]: 2026/09/25 16:35:07 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 224.290081] niks3-server[1130]: 2026/09/25 16:35:07 INFO Received complete push request method=POST path=/api/pushes/89/complete lb # [ 224.293832] niks3-server[1130]: 2026/09/25 16:35:07 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 224.280632] nix-grpc-daemon[1728]: time=2026-09-25T16:35:07.454Z level=INFO msg="Upload complete. (157ms)" worker2 # [ 224.283887] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 224.288662] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 224.298147] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 224.300538] nix-daemon[861]: reaped child process 2003, status = succeeded worker2 # [ 224.305704] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 225.746607] nix-daemon[861]: reaped child process 2012, status = succeeded worker2 # [ 225.831981] nix-daemon[861]: accepted connection from pid 2028, user nix-grpc-daemon (trusted) worker2 # [ 225.844259] nix-daemon[861]: reaped child process 2031, status = succeeded lb # [ 225.868840] niks3-server[1130]: 2026/09/25 16:35:09 INFO Received push request method=POST path=/api/pushes worker2 # [ 225.860694] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.034Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 225.862493] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.036Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 225.913171] niks3-server[1130]: 2026/09/25 16:35:09 INFO Received sign narinfos request method=POST path=/api/pushes/90/sign lb # [ 225.919774] niks3-server[1130]: 2026/09/25 16:35:09 INFO Signed narinfos id=90 count=1 worker2 # [ 225.906195] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.080Z level=INFO msg="Uploading 1 narinfos" lb # [ 225.928410] niks3-server[1130]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 225.934353] niks3-server[1130]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 225.943327] niks3-server[1130]: 2026/09/25 16:35:09 INFO Received complete push request method=POST path=/api/pushes/90/complete lb # [ 225.952399] niks3-server[1130]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst worker2 # [ 225.934429] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.108Z level=INFO msg="Upload complete. (220ms)" lb # [ 225.955623] niks3-server[1130]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 225.940894] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=15 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 225.952640] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:08Z level=debug event=want client=4 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 225.951321] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker1 # [ 225.957457] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:08Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 225.962199] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 225.970908] nix-daemon[861]: reaped child process 2010, status = succeeded worker2 # [ 225.972879] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.146Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 225.978493] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 225.984464] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 226.066949] nix-daemon[861]: accepted connection from pid 2035, user nix-grpc-daemon (trusted) worker2 # [ 226.079553] nix-daemon[861]: reaped child process 2038, status = succeeded lb # [ 226.103078] niks3-server[1130]: 2026/09/25 16:35:09 INFO Received push request method=POST path=/api/pushes worker2 # [ 226.095034] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.269Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 226.097046] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.270Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 226.135317] niks3-server[1130]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 226.142427] niks3-server[1130]: 2026/09/25 16:35:09 INFO Received sign narinfos request method=POST path=/api/pushes/91/sign lb # [ 226.147242] niks3-server[1130]: 2026/09/25 16:35:09 INFO Signed narinfos id=91 count=1 worker2 # [ 226.135216] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.309Z level=INFO msg="Uploading 1 narinfos" lb # [ 226.162661] niks3-server[1130]: 2026/09/25 16:35:09 INFO Received complete push request method=POST path=/api/pushes/91/complete lb # [ 226.168717] niks3-server[1130]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls worker2 # [ 226.157913] nix-grpc-daemon[1728]: time=2026-09-25T16:35:09.331Z level=INFO msg="Upload complete. (168ms)" lb # [ 226.176289] niks3-server[1130]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 226.162832] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 226.168724] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 worker2 # [ 226.179129] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker2 # [ 226.187186] nix-daemon[861]: reaped child process 2033, status = succeeded worker2 # [ 226.191990] nix-daemon[861]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain lb # [ 227.083976] envoy[922]: conn peer=[2001:db8:1::1]:57828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=929 tx=596 ms=30053 worker2 # [ 227.228459] nix-daemon[861]: reaped child process 2042, status = succeeded worker2 # [ 227.311175] nix-daemon[861]: accepted connection from pid 2058, user nix-grpc-daemon (trusted) worker2 # [ 227.323853] nix-daemon[861]: reaped child process 2061, status = succeeded lb # [ 227.347611] niks3-server[1130]: 2026/09/25 16:35:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 227.339723] nix-grpc-daemon[1728]: time=2026-09-25T16:35:10.513Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 227.341444] nix-grpc-daemon[1728]: time=2026-09-25T16:35:10.515Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 227.389604] niks3-server[1130]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 227.394637] niks3-server[1130]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 227.400484] niks3-server[1130]: 2026/09/25 16:35:10 INFO Received sign narinfos request method=POST path=/api/pushes/92/sign lb # [ 227.404680] niks3-server[1130]: 2026/09/25 16:35:10 INFO Signed narinfos id=92 count=1 worker2 # [ 227.391441] nix-grpc-daemon[1728]: time=2026-09-25T16:35:10.565Z level=INFO msg="Uploading 1 narinfos" lb # [ 227.411676] niks3-server[1130]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 227.423143] niks3-server[1130]: 2026/09/25 16:35:10 INFO Received complete push request method=POST path=/api/pushes/92/complete lb # [ 227.432862] niks3-server[1130]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 227.416258] nix-grpc-daemon[1728]: time=2026-09-25T16:35:10.590Z level=INFO msg="Upload complete. (216ms)" worker2 # [ 227.422610] nix-grpc-daemon[1636]: ts=2026-09-25T16:35:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50594 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=16 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 227.438678] nix-daemon[861]: reaped child process 2040, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.04 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 228.404337] nix-grpc-daemon[1795]: ts=2026-09-25T16:35:10Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.37 seconds) (finished: run the VM test script, in 229.71 seconds) test script finished in 229.88s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-25T16:35:12Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-25T16:35:13Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-25T16:35:13Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-25T16:35:13Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.00 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh