tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.Xrefh11TxL', fmt=raw size=1073741824 worker2: QEMU running (pid 52) worker1 # Disk image does not exist, creating the virtualisation disk image... worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Formatting '/build/vm-state-worker1/tmp.1ERVoeI7OA', fmt=raw size=1073741824 worker2 # Discarding device blocks: 0/262144 done worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Discarding device blocks: 0/262144 done worker2 # Filesystem UUID: 71f9c82e-e231-4bc1-bed1-273f5f2ac2a6 worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Superblock backups stored on blocks: worker1 # Filesystem UUID: 0da89c8e-3218-4e07-b6f2-6c5adc41e4d8 worker2 # 32768, 98304, 163840, 229376 client: QEMU running (pid 49) worker1 # Superblock backups stored on blocks: worker2 # client # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 50) worker1 # 32768, 98304, 163840, 229376 worker2 # Allocating group tables: 0/8 done worker1 # lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 51) worker1 # Allocating group tables: 0/8 done lb # Formatting '/build/vm-state-lb/tmp.LUN1SsED7L', fmt=raw size=1073741824 worker2 # Writing inode tables: 0/8 done client # Formatting '/build/vm-state-client/tmp.k5Mkxk6yf0', fmt=raw size=1073741824 worker1 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Discarding device blocks: 0/262144 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # worker2 # Virtualisation disk image created. client # Filesystem UUID: 5364948e-6f97-49bf-be67-41f7f7f6fc54 worker1 # Virtualisation disk image created. worker2 # Starting virtiofs daemons... client # Superblock backups stored on blocks: worker1 # Starting virtiofs daemons... worker2 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # 32768, 98304, 163840, 229376 worker1 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # worker1 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Allocating group tables: 0/8 done worker1 # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Writing inode tables: 0/8 done worker1 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Creating journal (8192 blocks): done worker1 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # worker1 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Virtualisation disk image created. worker1 # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Starting virtiofs daemons... worker1 # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests (finished: start all VMs, in 0.22 seconds) lb # mke2fs 1.47.4 (6-Mar-2025) client: waiting for unit network-addresses-eth1.service lb # Discarding device blocks: 0/262144 done client: waiting for the VM to finish booting lb # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: 9691f527-99d9-4fca-88fd-8047024c3083 lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 lb # client # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests lb # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T11:24:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T11:24:35Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T11:24:35Z INFO virtiofsd] Client connected, servicing requests worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # lb # worker1 # lb # worker1 # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker2 # Booting from ROM... client # Booting from ROM... lb # Booting from ROM... worker1 # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g4s62ig20603prhr6rpvm83lvwh8ggjh-nixos-system-lb-test/init regInfo=/nix/store/mw0sy7zlar36zs4cd786mchwg970135k-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test/init regInfo=/nix/store/pp49lp3mrkpf817wwl4f76r0y0512f6i-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] SMBIOS 2.8 present. worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7p3x1fr20awv6rqp4jyn18vhmavwjmq9-nixos-system-worker2-test/init regInfo=/nix/store/gn50nvbwg10sg3igwi322f48c4wpkc2v-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/a69286jdpp14g4cl1d6rckvg3a912f09-nixos-system-worker1-test/init regInfo=/nix/store/pxx1wbycjhhl6ikgpkzncw5i5x2n0awy-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] kvm-clock: using sched offset of 446020489 cycles worker2 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] kvm-clock: using sched offset of 447648601 cycles lb # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.002772] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.002783] Using GB pages for direct mapping client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.002870] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.002756] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002878] ACPI: Early table checksum verification disabled worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.002767] Using GB pages for direct mapping lb # [ 0.002881] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.002926] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.002886] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002934] ACPI: Early table checksum verification disabled worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.002937] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.002890] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] APIC: Static calls initialized client # [ 0.002941] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002898] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.002900] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.002946] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.002901] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.002953] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002955] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.002903] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002956] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002904] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] kvm-clock: using sched offset of 457726921 cycles worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000001] kvm-clock: using sched offset of 462400349 cycles client # [ 0.002958] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002906] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.002907] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002959] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002908] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002961] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.002909] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002962] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.002909] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002963] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.002723] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002910] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.002734] Using GB pages for direct mapping worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002964] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.002910] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.002822] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.002730] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.002964] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.002832] ACPI: Early table checksum verification disabled lb # [ 0.002911] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002742] Using GB pages for direct mapping lb # [ 0.003139] No NUMA configuration found client # [ 0.002965] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002845] RAMDISK: [mem 0x5e36f000-0x5ffcffff] worker1 # [ 0.002836] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.003140] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.002859] ACPI: Early table checksum verification disabled client # [ 0.002965] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.002840] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003142] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.002864] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.005312] Zone ranges: client # [ 0.002966] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.002844] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003186] No NUMA configuration found lb # [ 0.005312] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002868] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003187] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.002851] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005314] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.005315] Normal empty worker2 # [ 0.002872] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002853] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.003189] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005316] Device empty client # [ 0.005436] Zone ranges: lb # [ 0.005316] Movable zone start for each node worker1 # [ 0.002855] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005317] Early memory node ranges worker2 # [ 0.002880] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005437] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002882] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.005317] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.005439] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.002856] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005440] Normal empty lb # [ 0.005318] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.005441] Device empty worker2 # [ 0.002883] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002858] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005441] Movable zone start for each node lb # [ 0.005320] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.005442] Early memory node ranges worker2 # [ 0.002885] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002859] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005339] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.005442] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.005590] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.002861] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002886] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005443] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.031453] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.002862] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.031911] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.002888] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005444] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.002862] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.031922] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.005470] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.002889] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.002863] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.031950] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.005730] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002890] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.002863] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.031952] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.031412] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.002891] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.031873] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.002864] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.031954] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.031885] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.002891] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.031955] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.002864] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.003090] No NUMA configuration found client # [ 0.031909] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.002892] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.031956] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.003091] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.031912] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.002892] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.031957] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.003093] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.031913] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.005397] Zone ranges: lb # [ 0.031959] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.002892] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.031915] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.031960] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.005398] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.003142] No NUMA configuration found lb # [ 0.031964] TSC deadline timer available worker1 # [ 0.005399] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.031916] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.003142] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.031967] CPU topo: Max. logical packages: 1 worker1 # [ 0.005401] Normal empty worker1 # [ 0.005402] Device empty lb # [ 0.031968] CPU topo: Max. logical dies: 1 client # [ 0.031916] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.003145] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005402] Movable zone start for each node worker2 # [ 0.006391] Zone ranges: lb # [ 0.031968] CPU topo: Max. dies per package: 1 worker1 # [ 0.005403] Early memory node ranges client # [ 0.031919] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.031972] CPU topo: Max. threads per core: 1 worker2 # [ 0.006392] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.031920] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.005403] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.031972] CPU topo: Num. cores per package: 1 worker2 # [ 0.006394] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.031924] TSC deadline timer available lb # [ 0.031973] CPU topo: Num. threads per package: 1 worker1 # [ 0.005404] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.006395] Normal empty client # [ 0.031928] CPU topo: Max. logical packages: 1 worker2 # [ 0.006396] Device empty lb # [ 0.031973] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.005405] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.031928] CPU topo: Max. logical dies: 1 worker2 # [ 0.006397] Movable zone start for each node worker2 # [ 0.006398] Early memory node ranges client # [ 0.031929] CPU topo: Max. dies per package: 1 lb # [ 0.031994] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.005425] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.031932] CPU topo: Max. threads per core: 1 worker1 # [ 0.005696] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.006398] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.032025] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.031933] CPU topo: Num. cores per package: 1 worker1 # [ 0.034947] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.006399] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.031933] CPU topo: Num. threads per package: 1 lb # [ 0.032027] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.035413] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.006400] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.031933] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.032028] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.035425] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.032030] Booting paravirtualized kernel on KVM worker2 # [ 0.006423] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.031953] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.035449] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.006775] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.035452] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.031983] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.032033] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.040190] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.035453] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.031985] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.040716] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.036504] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.035454] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.031987] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.038582] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.040729] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.035456] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.031988] Booting paravirtualized kernel on KVM lb # [ 0.038625] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.040759] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.035456] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.040762] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.031991] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.035459] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.040763] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.035460] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.036478] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.035464] TSC deadline timer available worker2 # [ 0.040764] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.038569] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.035468] CPU topo: Max. logical packages: 1 worker2 # [ 0.040765] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.035469] CPU topo: Max. logical dies: 1 lb # [ 0.038627] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g4s62ig20603prhr6rpvm83lvwh8ggjh-nixos-system-lb-test/init regInfo=/nix/store/mw0sy7zlar36zs4cd786mchwg970135k-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.038608] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.035469] CPU topo: Max. dies per package: 1 worker2 # [ 0.040766] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.035472] CPU topo: Max. threads per core: 1 worker1 # [ 0.035473] CPU topo: Num. cores per package: 1 worker2 # [ 0.040768] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.038720] Unknown kernel command line parameters "regInfo=/nix/store/mw0sy7zlar36zs4cd786mchwg970135k-closure-info/registration", will be passed to user space. lb # [ 0.038733] random: crng init done worker1 # [ 0.035473] CPU topo: Num. threads per package: 1 worker2 # [ 0.040770] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.040773] TSC deadline timer available worker1 # [ 0.035473] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.038734] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.040778] CPU topo: Max. logical packages: 1 worker1 # [ 0.035494] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.038609] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test/init regInfo=/nix/store/pp49lp3mrkpf817wwl4f76r0y0512f6i-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.040778] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.040778] CPU topo: Max. logical dies: 1 worker2 # [ 0.040779] CPU topo: Max. dies per package: 1 worker1 # [ 0.035524] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.042094] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.040782] CPU topo: Max. threads per core: 1 lb # [ 0.042127] Fallback order for Node 0: 0 worker1 # [ 0.035526] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.038704] Unknown kernel command line parameters "regInfo=/nix/store/pp49lp3mrkpf817wwl4f76r0y0512f6i-closure-info/registration", will be passed to user space. worker2 # [ 0.040782] CPU topo: Num. cores per package: 1 client # [ 0.038717] random: crng init done lb # [ 0.042130] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.035527] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.040783] CPU topo: Num. threads per package: 1 lb # [ 0.042130] Policy zone: DMA32 worker1 # [ 0.035529] Booting paravirtualized kernel on KVM client # [ 0.038717] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.040783] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.044658] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.040775] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.047911] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.035532] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.040802] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.051249] allocated 3145728 bytes of page_ext client # [ 0.041973] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.040007] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.040832] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.060865] ftrace: allocating 48787 entries in 192 pages client # [ 0.042004] Fallback order for Node 0: 0 lb # [ 0.060867] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.042147] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.040833] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.042006] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.061668] Dynamic Preempt: lazy worker1 # [ 0.042188] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.042007] Policy zone: DMA32 worker2 # [ 0.040835] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.061789] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.040836] Booting paravirtualized kernel on KVM client # [ 0.044448] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.061789] rcu: RCU event tracing is enabled. client # [ 0.047667] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.061790] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.040840] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.050886] allocated 3145728 bytes of page_ext lb # [ 0.061791] Trampoline variant of Tasks RCU enabled. client # [ 0.060548] ftrace: allocating 48787 entries in 192 pages lb # [ 0.061792] Rude variant of Tasks RCU enabled. worker2 # [ 0.045320] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.042190] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/a69286jdpp14g4cl1d6rckvg3a912f09-nixos-system-worker1-test/init regInfo=/nix/store/pxx1wbycjhhl6ikgpkzncw5i5x2n0awy-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.060550] ftrace: allocated 192 pages with 2 groups lb # [ 0.061792] Tracing variant of Tasks RCU enabled. client # [ 0.061351] Dynamic Preempt: lazy worker2 # [ 0.047607] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.061793] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.061540] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.047652] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.042286] Unknown kernel command line parameters "regInfo=/nix/store/pxx1wbycjhhl6ikgpkzncw5i5x2n0awy-closure-info/registration", will be passed to user space. client # [ 0.061540] rcu: RCU event tracing is enabled. lb # [ 0.061793] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.042299] random: crng init done client # [ 0.061541] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.061844] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.042300] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.061543] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.044402] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.061543] Rude variant of Tasks RCU enabled. lb # [ 0.061846] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.061543] Tracing variant of Tasks RCU enabled. worker1 # [ 0.045654] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.047654] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7p3x1fr20awv6rqp4jyn18vhmavwjmq9-nixos-system-worker2-test/init regInfo=/nix/store/gn50nvbwg10sg3igwi322f48c4wpkc2v-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.045693] Fallback order for Node 0: 0 lb # [ 0.061847] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.061544] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.066388] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.045696] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.061545] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.045697] Policy zone: DMA32 lb # [ 0.066664] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.047749] Unknown kernel command line parameters "regInfo=/nix/store/gn50nvbwg10sg3igwi322f48c4wpkc2v-closure-info/registration", will be passed to user space. worker1 # [ 0.048174] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.061559] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.047761] random: crng init done worker1 # [ 0.051403] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.066671] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.047762] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.054711] allocated 3145728 bytes of page_ext client # [ 0.061561] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.064415] ftrace: allocating 48787 entries in 192 pages lb # [ 0.066774] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.049894] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.064416] ftrace: allocated 192 pages with 2 groups lb # [ 0.070327] Console: colour VGA+ 80x25 client # [ 0.061562] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.065249] Dynamic Preempt: lazy lb # [ 0.070330] printk: legacy console [tty0] enabled worker2 # [ 0.050946] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.066071] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.065376] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.099900] printk: legacy console [ttyS0] enabled worker2 # [ 0.050977] Fallback order for Node 0: 0 worker1 # [ 0.065377] rcu: RCU event tracing is enabled. client # [ 0.066327] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.196610] ACPI: Core revision 20250807 worker2 # [ 0.050980] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.065378] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.050981] Policy zone: DMA32 client # [ 0.066333] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.065379] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.053742] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.065379] Rude variant of Tasks RCU enabled. lb # [ 0.197492] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.065379] Tracing variant of Tasks RCU enabled. worker2 # [ 0.057024] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.066433] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.199056] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.060359] allocated 3145728 bytes of page_ext client # [ 0.069980] Console: colour VGA+ 80x25 worker1 # [ 0.065380] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.200107] x2apic enabled client # [ 0.069982] printk: legacy console [tty0] enabled worker2 # [ 0.070168] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.065381] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.100375] printk: legacy console [ttyS0] enabled worker2 # [ 0.070170] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.071014] Dynamic Preempt: lazy lb # [ 0.200861] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.065429] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.200774] ACPI: Core revision 20250807 worker2 # [ 0.071201] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.071202] rcu: RCU event tracing is enabled. worker1 # [ 0.065431] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.202849] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.071202] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.201756] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.065432] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.071204] Trampoline variant of Tasks RCU enabled. client # [ 0.203383] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.070012] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.071205] Rude variant of Tasks RCU enabled. client # [ 0.204411] x2apic enabled lb # [ 0.203869] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.070289] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.071205] Tracing variant of Tasks RCU enabled. worker2 # [ 0.071206] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.205194] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.070295] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.205576] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.071206] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.070402] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.206666] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.073951] Console: colour VGA+ 80x25 worker2 # [ 0.071216] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.207158] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.073954] printk: legacy console [tty0] enabled lb # [ 0.208709] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.103699] printk: legacy console [ttyS0] enabled worker2 # [ 0.071217] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.209574] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.199289] ACPI: Core revision 20250807 client # [ 0.208211] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.071218] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.075623] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.209951] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.200173] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.210577] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.075891] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.201723] APIC: Switch to symmetric I/O mode setup client # [ 0.212048] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.202653] x2apic enabled lb # [ 0.211574] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.075899] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.213104] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.212573] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.203402] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.076000] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.213949] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.213573] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.079926] Console: colour VGA+ 80x25 worker2 # [ 0.079928] printk: legacy console [tty0] enabled worker1 # [ 0.205167] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.214573] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.110700] printk: legacy console [ttyS0] enabled client # [ 0.214952] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.214151] ACPI: Core revision 20250807 worker1 # [ 0.206122] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.215949] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.215089] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.207776] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.216948] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.216696] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.208861] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.217948] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.215573] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.217738] x2apic enabled worker1 # [ 0.209902] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.217580] Spectre V2 : Enabling IBPB for BPF client # [ 0.218948] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.218507] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.210773] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.219112] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.219574] active return thunk: srso_alias_return_thunk worker2 # [ 0.220441] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.211776] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.220582] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.212773] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.219948] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.221501] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.221573] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.221957] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.213773] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.223231] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.222573] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.214772] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.223505] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.223573] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.225276] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.215773] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.224950] active return thunk: srso_alias_return_thunk lb # [ 0.224573] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.226358] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.225978] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.225573] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.227228] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.226949] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.226573] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.227948] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.216773] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.228232] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.227574] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.218781] Spectre V2 : Enabling IBPB for BPF client # [ 0.228948] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.229228] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.228573] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.229948] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.219774] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.230228] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.229573] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.220774] active return thunk: srso_alias_return_thunk client # [ 0.230949] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.231227] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.230573] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.221794] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.231948] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.231573] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.232228] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.222773] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.233949] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.232573] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.223772] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.234948] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.224773] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.235948] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.225772] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.236948] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.233227] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.226773] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.237948] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.235235] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.227772] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.238905] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.236817] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.229682] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.238228] active return thunk: srso_alias_return_thunk worker1 # [ 0.230500] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.239251] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.231506] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.232508] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.240228] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.233495] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.241227] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.242228] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.234496] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.243227] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.244227] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.245227] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.247228] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.248227] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.249227] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.250227] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.251228] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.252227] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.266180] Freeing SMP alternatives memory: 44K lb # [ 0.266576] pid_max: default: 32768 minimum: 301 lb # [ 0.267657] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.268680] landlock: Up and running. lb # [ 0.269291] Yama: becoming mindful. lb # [ 0.270188] LSM support for eBPF active client # [ 0.272783] Freeing SMP alternatives memory: 44K lb # [ 0.271134] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.273531] pid_max: default: 32768 minimum: 301 lb # [ 0.271615] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.274035] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.275048] landlock: Up and running. client # [ 0.275949] Yama: becoming mindful. client # [ 0.277072] LSM support for eBPF active lb # [ 0.274897] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.277826] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.276176] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.268774] Freeing SMP alternatives memory: 44K lb # [ 0.276582] ... version: 2 client # [ 0.278987] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.269553] pid_max: default: 32768 minimum: 301 lb # [ 0.277328] ... bit width: 48 worker1 # [ 0.269883] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.277576] ... generic counters: 6 worker1 # [ 0.270882] landlock: Up and running. lb # [ 0.278288] ... generic bitmap: 000000000000003f client # [ 0.281396] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.271773] Yama: becoming mindful. lb # [ 0.278576] ... fixed-purpose counters: 0 worker1 # [ 0.272984] LSM support for eBPF active lb # [ 0.279331] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.282529] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.282959] ... version: 2 worker1 # [ 0.273711] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.279576] ... value mask: 0000ffffffffffff client # [ 0.283687] ... bit width: 48 lb # [ 0.280494] ... max period: 00007fffffffffff worker1 # [ 0.274814] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.283951] ... generic counters: 6 lb # [ 0.281271] ... global_ctrl mask: 000000000000003f client # [ 0.284668] ... generic bitmap: 000000000000003f lb # [ 0.281680] signal: max sigframe size: 3376 client # [ 0.284951] ... fixed-purpose counters: 0 lb # [ 0.282514] rcu: Hierarchical SRCU implementation. worker1 # [ 0.277244] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.285679] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.283154] rcu: Max phase no-delay instances is 400. worker2 # [ 0.286752] Freeing SMP alternatives memory: 44K client # [ 0.285951] ... value mask: 0000ffffffffffff worker1 # [ 0.278343] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.287231] pid_max: default: 32768 minimum: 301 client # [ 0.286887] ... max period: 00007fffffffffff worker1 # [ 0.278778] ... version: 2 worker2 # [ 0.288332] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.287624] ... global_ctrl mask: 000000000000003f worker1 # [ 0.279506] ... bit width: 48 worker2 # [ 0.289333] landlock: Up and running. worker1 # [ 0.279775] ... generic counters: 6 client # [ 0.288064] signal: max sigframe size: 3376 worker2 # [ 0.290228] Yama: becoming mindful. client # [ 0.288847] rcu: Hierarchical SRCU implementation. worker1 # [ 0.280480] ... generic bitmap: 000000000000003f worker2 # [ 0.291383] LSM support for eBPF active worker1 # [ 0.280782] ... fixed-purpose counters: 0 client # [ 0.289517] rcu: Max phase no-delay instances is 400. lb # [ 0.288176] smp: Bringing up secondary CPUs ... worker1 # [ 0.281506] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.292210] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.288589] smp: Brought up 1 node, 1 CPU worker1 # [ 0.281775] ... value mask: 0000ffffffffffff lb # [ 0.289234] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.282683] ... max period: 00007fffffffffff worker2 # [ 0.293265] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.283426] ... global_ctrl mask: 000000000000003f worker1 # [ 0.283878] signal: max sigframe size: 3376 lb # [ 0.289784] Memory: 1454604K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) worker1 # [ 0.284689] rcu: Hierarchical SRCU implementation. worker2 # [ 0.295963] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.294524] smp: Bringing up secondary CPUs ... lb # [ 0.290824] devtmpfs: initialized worker1 # [ 0.285333] rcu: Max phase no-delay instances is 400. client # [ 0.294965] smp: Brought up 1 node, 1 CPU lb # [ 0.291670] x86/mm: Memory block size: 128MB worker2 # [ 0.296790] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.295670] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.297232] ... version: 2 worker2 # [ 0.298025] ... bit width: 48 lb # [ 0.293487] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.298230] ... generic counters: 6 client # [ 0.296168] Memory: 1454608K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) lb # [ 0.294488] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.299021] ... generic bitmap: 000000000000003f client # [ 0.297173] devtmpfs: initialized worker2 # [ 0.299991] ... fixed-purpose counters: 0 lb # [ 0.295673] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.290335] smp: Bringing up secondary CPUs ... client # [ 0.298089] x86/mm: Memory block size: 128MB worker1 # [ 0.290788] smp: Brought up 1 node, 1 CPU worker2 # [ 0.300230] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.296842] PM: RTC time: 11:24:35, date: 2026-09-22 worker2 # [ 0.301194] ... value mask: 0000ffffffffffff worker1 # [ 0.291481] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.301988] ... max period: 00007fffffffffff client # [ 0.299979] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.302230] ... global_ctrl mask: 000000000000003f worker1 # [ 0.291969] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) client # [ 0.300976] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.303350] signal: max sigframe size: 3376 worker1 # [ 0.293041] devtmpfs: initialized lb # [ 0.300553] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.302034] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.304182] rcu: Hierarchical SRCU implementation. worker1 # [ 0.293865] x86/mm: Memory block size: 128MB worker2 # [ 0.304843] rcu: Max phase no-delay instances is 400. client # [ 0.303168] PM: RTC time: 11:24:35, date: 2026-09-22 lb # [ 0.301804] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.302602] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.295605] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.296667] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.303860] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.306683] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.297858] pinctrl core: initialized pinctrl subsystem lb # [ 0.304587] audit: initializing netlink subsys (disabled) worker1 # [ 0.299020] PM: RTC time: 11:24:35, date: 2026-09-22 lb # [ 0.305719] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.309870] smp: Bringing up secondary CPUs ... client # [ 0.307445] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.310244] smp: Brought up 1 node, 1 CPU lb # [ 0.305721] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.307975] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.310960] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.306577] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.307558] thermal_sys: Registered thermal governor 'user_space' client # [ 0.309241] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.302514] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.309961] audit: initializing netlink subsys (disabled) worker2 # [ 0.311439] Memory: 1454584K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) lb # [ 0.308364] audit: type=2000 audit(1790076276.208:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.303367] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.311195] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.310579] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.312765] devtmpfs: initialized lb # [ 0.310593] cpuidle: using governor menu worker1 # [ 0.303799] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.311197] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.313472] x86/mm: Memory block size: 128MB client # [ 0.311953] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.312844] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.305043] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.305785] audit: initializing netlink subsys (disabled) worker2 # [ 0.315264] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.312954] audit: type=2000 audit(1790076276.210:1): state=initialized audit_enabled=0 res=1 lb # [ 0.313837] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.314952] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.306938] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.316261] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.314579] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.306940] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.314954] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.317320] pinctrl core: initialized pinctrl subsystem lb # [ 0.315587] PCI: Using configuration type 1 for base access client # [ 0.315978] cpuidle: using governor menu worker1 # [ 0.307776] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.318477] PM: RTC time: 11:24:35, date: 2026-09-22 worker1 # [ 0.308717] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.316698] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.318273] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.309526] audit: type=2000 audit(1790076276.220:1): state=initialized audit_enabled=0 res=1 client # [ 0.319200] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.310778] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.310791] cpuidle: using governor menu client # [ 0.319954] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.321977] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.320962] PCI: Using configuration type 1 for base access worker1 # [ 0.312959] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.322728] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.321819] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.322114] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.314001] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.323253] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.322577] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.314778] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.324500] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.315787] PCI: Using configuration type 1 for base access worker2 # [ 0.325240] audit: initializing netlink subsys (disabled) worker1 # [ 0.316908] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.326428] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.327209] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.326430] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.327577] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.327231] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.327952] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.328576] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.328233] audit: type=2000 audit(1790076276.224:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.330234] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.330235] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.331259] cpuidle: using governor menu worker1 # [ 0.323918] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.332953] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.324776] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.333538] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.333951] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.334484] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.335233] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.336242] PCI: Using configuration type 1 for base access lb # [ 0.338939] ACPI: Added _OSI(Module Device) worker1 # [ 0.329777] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.339577] ACPI: Added _OSI(Processor Device) worker2 # [ 0.337394] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.330776] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.340311] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.344381] ACPI: Added _OSI(Module Device) client # [ 0.344953] ACPI: Added _OSI(Processor Device) client # [ 0.345734] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.346407] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.346566] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.347231] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.341216] ACPI: Added _OSI(Module Device) worker1 # [ 0.341777] ACPI: Added _OSI(Processor Device) worker1 # [ 0.342501] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.352981] ACPI: Interpreter enabled lb # [ 0.353591] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.354266] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.352231] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.354488] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.353230] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.356624] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.349346] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.357576] PCI: Using E820 reservations for host bridge windows client # [ 0.358199] ACPI: Interpreter enabled client # [ 0.358865] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.359512] ACPI: Using IOAPIC for interrupt routing lb # [ 0.360668] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.359987] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.353180] ACPI: Interpreter enabled client # [ 0.360951] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.353792] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.354479] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.362576] ACPI: Added _OSI(Module Device) worker2 # [ 0.363232] ACPI: Added _OSI(Processor Device) client # [ 0.364058] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.364015] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.356846] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.357777] PCI: Using E820 reservations for host bridge windows lb # [ 0.368113] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.368582] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.360914] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.369655] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.370697] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.371747] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.371970] PCI host bridge to bus 0000:00 client # [ 0.372725] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.372580] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.373576] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.373782] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.374576] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.375209] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.375648] ACPI: Interpreter enabled worker1 # [ 0.367848] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.375576] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.376247] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.376074] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.377014] ACPI: Using IOAPIC for interrupt routing lb # [ 0.376581] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.368781] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.377323] PCI host bridge to bus 0000:00 lb # [ 0.377576] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.369852] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.377956] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.378613] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.370898] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.378952] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.379267] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.379578] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.372121] PCI host bridge to bus 0000:00 client # [ 0.379952] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.380230] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.372780] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.380952] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.381036] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.373775] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.381951] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.374775] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.383370] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.382951] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.375776] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.383952] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.376775] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.384953] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.377775] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.378775] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.386391] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.379750] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.383668] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.389268] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.384588] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.390235] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.381309] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.385506] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.391308] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.386546] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.392362] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.393601] PCI host bridge to bus 0000:00 lb # [ 0.388287] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.394235] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.389158] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.395231] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.390017] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.391620] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.396230] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.383877] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.390977] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.392469] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.397230] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.384787] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.393303] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.398230] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.385748] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.392309] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.393582] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.399230] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.386742] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.393744] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.400231] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.395157] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.401301] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.388524] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.395967] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.402701] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.397552] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.396868] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.398249] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.391825] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.397735] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.398599] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.392643] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.398834] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.393478] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.400231] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.393781] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.400481] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.395322] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.401977] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.402857] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.405312] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.403918] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.403758] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.406244] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.396817] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.405246] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.397621] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.407256] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.405598] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.405474] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.398469] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.408615] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.407145] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.399369] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.407982] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.409978] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.408899] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.409459] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.410258] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.409770] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.412263] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.410599] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.401828] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.411472] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.413209] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.403383] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.411582] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.414008] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.403796] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.415080] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.412960] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.413869] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.405359] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.413857] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.416874] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.414717] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.415589] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.406818] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.415957] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.416593] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.407683] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.418262] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.417545] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.408533] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.419203] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.418221] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.408781] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.420053] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.418827] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.419766] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.421771] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.410638] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.419619] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.420601] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.421493] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.412822] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.422187] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.413797] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.424261] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.422965] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.425146] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.424006] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.415338] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.423616] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.426049] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.424601] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.425567] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.416821] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.427763] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.426166] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.426826] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.417797] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.429239] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.427771] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.419344] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.430148] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.427590] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.429417] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.429305] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.431047] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.420822] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.432236] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.421791] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.431152] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.430159] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.431976] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.433825] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.423313] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.432445] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.433551] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.435145] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.424824] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.433252] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.436019] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.433598] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.434991] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.425786] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.437744] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.435958] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.427308] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.436972] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.435187] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.439244] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.428833] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.438550] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.440254] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.437353] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.429700] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.437585] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.439961] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.430533] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.441873] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.438558] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.440889] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.431335] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.441802] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.443068] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.440030] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.444010] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.441303] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.443485] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.433629] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.445841] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.444622] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.434452] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.441820] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.434798] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.445156] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.447231] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.443398] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.448252] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.446513] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.436361] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.444479] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.437490] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.447165] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.449849] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.446330] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.437976] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.448537] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.451246] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.439409] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.452179] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.453072] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.439971] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.441447] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.454803] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.456238] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.457181] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.458075] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.459832] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.446817] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.460925] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.449257] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.449357] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.451493] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.461454] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.450655] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.462802] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.452378] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.441994] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.451882] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.463461] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.453324] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.444405] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.464789] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.452848] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.454234] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.445055] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.454635] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.455826] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.446063] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.455464] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.456802] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.447155] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.456700] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.458241] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.448839] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.449681] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.459525] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.458428] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.450822] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.452467] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.462659] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.463484] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.463688] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.464061] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.465470] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.464680] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.465081] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.455908] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.467785] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.466059] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.465675] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.456884] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.466679] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.467051] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.468529] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.457881] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.467676] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.468059] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.458874] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.469562] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.468679] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.469059] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.459872] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.469675] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.470053] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.460872] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.470501] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.470614] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.470987] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.461893] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.471591] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.472097] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.462898] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.471964] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.472590] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.472910] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.463810] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.472968] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.473587] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.464730] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.473968] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.473572] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.474587] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.465472] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.474966] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.465790] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.475587] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.474858] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.475965] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.466728] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.476591] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.476966] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.467513] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.477580] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.477964] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.467791] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.468782] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.479704] iommu: Default domain type: Translated client # [ 0.480033] iommu: Default domain type: Translated worker2 # [ 0.478888] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.480544] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.480937] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.470858] iommu: Default domain type: Translated worker2 # [ 0.479347] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.481764] ACPI: bus type USB registered worker1 # [ 0.471661] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.482067] ACPI: bus type USB registered lb # [ 0.482584] usbcore: registered new interface driver usbfs worker2 # [ 0.480331] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.472805] ACPI: bus type USB registered client # [ 0.482862] usbcore: registered new interface driver usbfs lb # [ 0.483515] usbcore: registered new interface driver hub worker2 # [ 0.481336] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.483705] usbcore: registered new interface driver hub lb # [ 0.484218] usbcore: registered new device driver usb worker1 # [ 0.473801] usbcore: registered new interface driver usbfs worker2 # [ 0.482331] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.483961] usbcore: registered new device driver usb worker1 # [ 0.474696] usbcore: registered new interface driver hub lb # [ 0.485507] NetLabel: Initializing worker2 # [ 0.483329] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.475406] usbcore: registered new device driver usb client # [ 0.485759] NetLabel: Initializing lb # [ 0.486103] NetLabel: domain hash size = 128 worker2 # [ 0.484357] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.486446] NetLabel: domain hash size = 128 worker1 # [ 0.476634] NetLabel: Initializing lb # [ 0.486576] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.477230] NetLabel: domain hash size = 128 worker2 # [ 0.485335] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.486953] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.487620] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.477775] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.486271] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.488008] NetLabel: unlabeled traffic allowed by default lb # [ 0.488583] PCI: Using ACPI for IRQ routing worker1 # [ 0.478711] NetLabel: unlabeled traffic allowed by default client # [ 0.488964] PCI: Using ACPI for IRQ routing worker2 # [ 0.487243] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.479483] PCI: Using ACPI for IRQ routing worker2 # [ 0.488246] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.489251] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.490243] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.491243] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.492244] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.493246] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.495284] iommu: Default domain type: Translated worker2 # [ 0.496138] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.497330] ACPI: bus type USB registered worker2 # [ 0.498124] usbcore: registered new interface driver usbfs worker2 # [ 0.498979] usbcore: registered new interface driver hub worker2 # [ 0.499238] usbcore: registered new device driver usb worker2 # [ 0.501015] NetLabel: Initializing worker2 # [ 0.501237] NetLabel: domain hash size = 128 worker2 # [ 0.502053] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.503041] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.503989] PCI: Using ACPI for IRQ routing worker1 # [ 0.524617] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.524771] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.524771] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.538544] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.524783] vgaarb: loaded lb # [ 0.538572] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.525564] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.526362] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.538572] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.538580] vgaarb: loaded lb # [ 0.539363] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.542390] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.540197] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.542947] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.529884] clocksource: Switched to clocksource kvm-clock client # [ 0.542947] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.542955] vgaarb: loaded lb # [ 0.543656] clocksource: Switched to clocksource kvm-clock client # [ 0.543791] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.533614] VFS: Disk quotas dquot_6.6.0 client # [ 0.544605] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.534348] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.535764] pnp: PnP ACPI init lb # [ 0.547428] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.536634] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.548205] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.537646] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.549720] pnp: PnP ACPI init worker1 # [ 0.539203] pnp: PnP ACPI: found 5 devices lb # [ 0.550613] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.551048] clocksource: Switched to clocksource kvm-clock lb # [ 0.551636] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.553316] pnp: PnP ACPI: found 5 devices client # [ 0.554998] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.555964] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.555774] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.556226] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.557189] pnp: PnP ACPI init worker1 # [ 0.546845] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.556226] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.558036] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.556234] vgaarb: loaded worker1 # [ 0.548328] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.557017] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.549314] NET: Registered PF_INET protocol family client # [ 0.559021] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.557853] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.560603] pnp: PnP ACPI: found 5 devices lb # [ 0.560968] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.550519] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.562432] clocksource: Switched to clocksource acpi_pm lb # [ 0.563454] NET: Registered PF_INET protocol family lb # [ 0.564679] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.564322] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.566047] VFS: Disk quotas dquot_6.6.0 client # [ 0.568344] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.569930] clocksource: Switched to clocksource acpi_pm client # [ 0.570963] NET: Registered PF_INET protocol family worker2 # [ 0.568596] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.572224] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.570095] pnp: PnP ACPI init worker2 # [ 0.570942] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.571979] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.573693] pnp: PnP ACPI: found 5 devices worker1 # [ 0.567425] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.569067] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.570405] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.581205] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.571785] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.582845] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.573052] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.584222] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.574198] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.581366] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.585666] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.575467] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.582802] clocksource: Switched to clocksource acpi_pm lb # [ 0.586955] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.583793] NET: Registered PF_INET protocol family worker1 # [ 0.576564] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.588140] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.577786] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.584978] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.578720] NET: Registered PF_XDP protocol family lb # [ 0.589443] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.579551] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.589134] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.590579] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.580594] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.591856] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.590759] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.581635] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.592849] NET: Registered PF_XDP protocol family client # [ 0.592134] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.582748] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.593733] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.593538] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.583833] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.594778] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.594847] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.584885] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.595833] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.596990] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.596014] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.586646] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.598146] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.597356] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.599326] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.598551] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.589222] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.599920] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.601133] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.600954] NET: Registered PF_XDP protocol family worker1 # [ 0.591606] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.601870] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.603796] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.602930] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.593725] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.604000] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.605759] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.601280] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.595442] PCI: CLS 0 bytes, default 64 client # [ 0.605177] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.602913] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.606336] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.607725] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.596462] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.607497] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.604309] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.598240] Trying to unpack rootfs image as initramfs... lb # [ 0.609371] PCI: CLS 0 bytes, default 64 worker2 # [ 0.605745] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.609248] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.607062] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.610307] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.612162] Trying to unpack rootfs image as initramfs... worker2 # [ 0.608161] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.611854] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.609529] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.610689] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.614211] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.611965] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.613002] NET: Registered PF_XDP protocol family client # [ 0.616262] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.613888] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.618056] PCI: CLS 0 bytes, default 64 worker2 # [ 0.614906] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.615958] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.619097] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.617101] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.620979] Trying to unpack rootfs image as initramfs... worker2 # [ 0.618235] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.619388] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.621132] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.623391] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.625315] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.627213] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.628914] PCI: CLS 0 bytes, default 64 worker2 # [ 0.629834] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.631817] Trying to unpack rootfs image as initramfs... worker1 # [ 0.640836] Initialise system trusted keyrings worker1 # [ 0.644679] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.658029] Initialise system trusted keyrings lb # [ 0.659025] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.666044] Initialise system trusted keyrings client # [ 0.669690] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.667611] Key type asymmetric registered worker1 # [ 0.668386] Asymmetric key parser 'x509' registered worker2 # [ 0.676279] Initialise system trusted keyrings worker1 # [ 0.669323] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.682085] Key type asymmetric registered lb # [ 0.682835] Asymmetric key parser 'x509' registered worker2 # [ 0.679406] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.683754] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.674624] io scheduler mq-deadline registered worker1 # [ 0.675451] io scheduler kyber registered lb # [ 0.689091] io scheduler mq-deadline registered lb # [ 0.689954] io scheduler kyber registered client # [ 0.689005] Key type asymmetric registered worker1 # [ 0.679172] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.680464] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.694103] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.693654] Asymmetric key parser 'x509' registered worker1 # [ 0.684350] Linux agpgart interface v0.103 client # [ 0.694523] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.695478] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.685188] ACPI: bus type drm_connector registered client # [ 0.697748] io scheduler mq-deadline registered client # [ 0.698552] io scheduler kyber registered lb # [ 0.700731] Linux agpgart interface v0.103 worker1 # [ 0.689969] usbcore: registered new interface driver usbserial_generic lb # [ 0.701557] ACPI: bus type drm_connector registered worker1 # [ 0.691294] usbserial: USB Serial support registered for generic client # [ 0.702666] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.701450] Key type asymmetric registered client # [ 0.704052] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.694519] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.702223] Asymmetric key parser 'x509' registered lb # [ 0.706425] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.694519] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.703112] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.707560] usbserial: USB Serial support registered for generic worker1 # [ 0.696721] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.709458] Linux agpgart interface v0.103 lb # [ 0.709934] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.699671] drop_monitor: Initializing network drop monitor service client # [ 0.710313] ACPI: bus type drm_connector registered lb # [ 0.709934] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.700847] NET: Registered PF_INET6 protocol family worker2 # [ 0.708469] io scheduler mq-deadline registered lb # [ 0.712263] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.709359] io scheduler kyber registered worker1 # [ 0.704028] Segment Routing with IPv6 client # [ 0.715126] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.712968] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.717064] drop_monitor: Initializing network drop monitor service client # [ 0.716310] usbserial: USB Serial support registered for generic worker1 # [ 0.707533] In-situ OAM (IOAM) with IPv6 lb # [ 0.718267] NET: Registered PF_INET6 protocol family worker2 # [ 0.714309] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.708639] IPI shorthand broadcast: enabled lb # [ 0.721379] Segment Routing with IPv6 client # [ 0.719648] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.719648] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.719496] Linux agpgart interface v0.103 client # [ 0.722027] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.720299] ACPI: bus type drm_connector registered lb # [ 0.724960] In-situ OAM (IOAM) with IPv6 lb # [ 0.726116] IPI shorthand broadcast: enabled client # [ 0.725821] drop_monitor: Initializing network drop monitor service worker2 # [ 0.723648] usbcore: registered new interface driver usbserial_generic client # [ 0.727058] NET: Registered PF_INET6 protocol family worker1 # [ 0.716919] sched_clock: Marking stable (583013026, 133477492)->(793314253, -76823735) worker2 # [ 0.724802] usbserial: USB Serial support registered for generic client # [ 0.730100] Segment Routing with IPv6 worker2 # [ 0.727371] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.721786] registered taskstats version 1 worker2 # [ 0.727371] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.722757] Loading compiled-in X.509 certificates worker2 # [ 0.729727] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.733683] In-situ OAM (IOAM) with IPv6 lb # [ 0.734469] sched_clock: Marking stable (600014426, 133901085)->(810309439, -76393928) client # [ 0.734853] IPI shorthand broadcast: enabled worker2 # [ 0.733499] drop_monitor: Initializing network drop monitor service worker2 # [ 0.734867] NET: Registered PF_INET6 protocol family lb # [ 0.739097] registered taskstats version 1 lb # [ 0.740101] Loading compiled-in X.509 certificates worker2 # [ 0.738787] Segment Routing with IPv6 client # [ 0.743421] sched_clock: Marking stable (604014711, 138614932)->(819285653, -76656010) worker2 # [ 0.741387] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.743635] IPI shorthand broadcast: enabled client # [ 0.746850] registered taskstats version 1 client # [ 0.747895] Loading compiled-in X.509 certificates worker1 # [ 0.740508] Demotion targets for Node 0: null worker1 # [ 0.741439] Key type .fscrypt registered worker1 # [ 0.744496] Key type fscrypt-provisioning registered worker2 # [ 0.751941] sched_clock: Marking stable (609014768, 142328023)->(828845786, -77502995) worker1 # [ 0.745513] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.746409] ima: Allocated hash algorithm: sha1 lb # [ 0.758931] Demotion targets for Node 0: null worker1 # [ 0.748541] ima: No architecture policies found worker2 # [ 0.755510] registered taskstats version 1 lb # [ 0.759852] Key type .fscrypt registered worker2 # [ 0.756526] Loading compiled-in X.509 certificates lb # [ 0.761924] Key type fscrypt-provisioning registered worker1 # [ 0.751504] PM: Magic number: 10:213:429 lb # [ 0.762942] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.753251] RAS: Correctable Errors collector initialized. lb # [ 0.765933] ima: Allocated hash algorithm: sha1 lb # [ 0.766778] ima: No architecture policies found client # [ 0.766650] Demotion targets for Node 0: null lb # [ 0.768932] PM: Magic number: 10:213:429 client # [ 0.769685] Key type .fscrypt registered lb # [ 0.770576] RAS: Correctable Errors collector initialized. client # [ 0.770404] Key type fscrypt-provisioning registered client # [ 0.771429] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.762227] clk: Disabling unused clocks client # [ 0.773654] ima: Allocated hash algorithm: sha1 client # [ 0.774459] ima: No architecture policies found worker1 # [ 0.764526] PM: genpd: Disabling unused power domains client # [ 0.776644] PM: Magic number: 10:213:429 worker2 # [ 0.775004] Demotion targets for Node 0: null client # [ 0.778407] RAS: Correctable Errors collector initialized. lb # [ 0.779605] clk: Disabling unused clocks worker2 # [ 0.778389] Key type .fscrypt registered worker2 # [ 0.779091] Key type fscrypt-provisioning registered lb # [ 0.783931] PM: genpd: Disabling unused power domains worker2 # [ 0.780085] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.782361] ima: Allocated hash algorithm: sha1 worker2 # [ 0.783171] ima: No architecture policies found client # [ 0.789418] clk: Disabling unused clocks worker2 # [ 0.787365] PM: Magic number: 10:213:429 client # [ 0.791663] PM: genpd: Disabling unused power domains worker2 # [ 0.789003] RAS: Correctable Errors collector initialized. worker2 # [ 0.797052] clk: Disabling unused clocks worker2 # [ 0.801368] PM: genpd: Disabling unused power domains lb # [ 0.938778] Freeing initrd memory: 29064K worker1 # [ 0.929959] Freeing initrd memory: 29056K lb # [ 0.941952] Freeing unused decrypted memory: 2028K worker1 # [ 0.933319] Freeing unused decrypted memory: 2028K lb # [ 0.944585] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.945870] Write protecting the kernel read-only data: 32768k worker1 # [ 0.936218] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.947801] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.937355] Write protecting the kernel read-only data: 32768k lb # [ 0.949377] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.939315] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.940913] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.959604] Freeing initrd memory: 29056K client # [ 0.962777] Freeing unused decrypted memory: 2028K client # [ 0.965345] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.966493] Write protecting the kernel read-only data: 32768k worker2 # [ 0.963702] Freeing initrd memory: 29060K client # [ 0.968440] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.966958] Freeing unused decrypted memory: 2028K client # [ 0.969980] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.969658] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.970767] Write protecting the kernel read-only data: 32768k worker2 # [ 0.972666] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.974200] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 1.000406] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.001530] Run /init as init process worker1 # [ 0.992268] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.993471] Run /init as init process lb # [ 1.012000] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.005059] systemd[1]: Inserted module 'autofs4' client # [ 1.020932] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 1.022091] Run /init as init process worker2 # [ 1.025716] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.026876] Run /init as init process lb # [ 1.031803] fuse: init (API version 7.45) client # [ 1.032575] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.025581] fuse: init (API version 7.45) lb # [ 1.039256] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.041776] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.038045] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.033183] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.044856] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.035679] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.046822] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.038631] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.040646] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.052116] virtiofs virtio5: discovered new tag: nix-store client # [ 1.052404] fuse: init (API version 7.45) lb # [ 1.053703] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.045851] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.047466] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.060110] virtiofs virtio6: discovered new tag: shared client # [ 1.059824] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.058034] fuse: init (API version 7.45) lb # [ 1.061632] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.062302] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.065150] virtiofs virtio7: discovered new tag: xchg client # [ 1.065376] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.055658] virtiofs virtio6: discovered new tag: shared lb # [ 1.066629] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.067448] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.057426] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.065469] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.060842] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.068209] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.062574] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.072649] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.071238] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.074420] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.073306] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.080811] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.078577] virtiofs virtio5: discovered new tag: nix-store client # [ 1.082476] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.080260] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.085736] virtiofs virtio7: discovered new tag: xchg lb # [ 1.086630] systemd[1]: Successfully made /usr/ read-only. client # [ 1.087268] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.087672] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.089532] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.085424] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.094226] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.095839] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.109418] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.119412] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.423110] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.421032] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.434976] systemd[1]: Detected virtualization kvm. worker1 # [ 1.425788] systemd[1]: Detected virtualization kvm. worker1 # [ 1.426616] systemd[1]: Detected architecture x86-64. worker1 # [ 1.427467] systemd[1]: Running in initrd. lb # [ 1.437073] systemd[1]: Detected architecture x86-64. worker1 # [ 1.428615] systemd[1]: Initializing machine ID from random generator. lb # [ 1.439168] systemd[1]: Running in initrd. worker1 # [ 1.429861] systemd[1]: Hostname set to . lb # [ 1.441519] systemd[1]: Initializing machine ID from random generator. lb # [ 1.444362] systemd[1]: Hostname set to . client # [ 1.446001] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.458247] systemd[1]: Detected virtualization kvm. client # [ 1.460496] systemd[1]: Detected architecture x86-64. worker2 # [ 1.455139] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.460360] systemd[1]: Detected virtualization kvm. client # [ 1.462741] systemd[1]: Running in initrd. worker2 # [ 1.461246] systemd[1]: Detected architecture x86-64. worker2 # [ 1.462093] systemd[1]: Running in initrd. worker2 # [ 1.463244] systemd[1]: Initializing machine ID from random generator. client # [ 1.465224] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.464491] systemd[1]: Hostname set to . client # [ 1.468222] systemd[1]: Hostname set to . worker1 # [ 1.637087] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.651105] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.661007] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.688465] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.688568] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.692219] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.693396] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.694924] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.696052] systemd[1]: Reached target Path Units. lb # [ 1.696961] systemd[1]: Reached target Slice Units. lb # [ 1.697857] systemd[1]: Reached target Swaps. lb # [ 1.698714] systemd[1]: Reached target Timer Units. worker1 # [ 1.688662] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.699697] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.700939] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.702140] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.691843] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.703178] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.693019] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.704225] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.700302] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.705266] systemd[1]: Reached target Socket Units. worker1 # [ 1.694377] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.695450] systemd[1]: Reached target Path Units. worker1 # [ 1.696367] systemd[1]: Reached target Slice Units. lb # [ 1.706979] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.697241] systemd[1]: Reached target Swaps. worker2 # [ 1.704736] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.698043] systemd[1]: Reached target Timer Units. worker1 # [ 1.698970] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.705953] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.710712] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.700222] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.707363] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.701377] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.708441] systemd[1]: Reached target Path Units. worker2 # [ 1.709311] systemd[1]: Reached target Slice Units. worker1 # [ 1.702374] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.710144] systemd[1]: Reached target Swaps. worker1 # [ 1.703383] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.710949] systemd[1]: Reached target Timer Units. worker1 # [ 1.704341] systemd[1]: Reached target Socket Units. worker2 # [ 1.711915] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.713113] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.706184] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.714208] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.715170] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.716175] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.717170] systemd[1]: Reached target Socket Units. worker1 # [ 1.710559] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.719073] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.723416] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.729216] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.720382] systemd[1]: Starting Journal Service... client # [ 1.734043] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.735300] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.736837] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.738044] systemd[1]: Reached target Path Units. worker1 # [ 1.717176] systemd[1]: Starting Journal Service... client # [ 1.739038] systemd[1]: Reached target Slice Units. client # [ 1.740065] systemd[1]: Reached target Swaps. client # [ 1.740947] systemd[1]: Reached target Timer Units. lb # [ 1.742851] systemd[1]: Starting Load Kernel Modules... client # [ 1.742069] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.743407] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.744704] systemd[1]: Listening on Journal Sockets. client # [ 1.745761] systemd[1]: Listening on udev Control Socket. client # [ 1.746821] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.732871] systemd[1]: Starting Journal Service... client # [ 1.747869] systemd[1]: Reached target Socket Units. lb # [ 1.749027] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.749895] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.741673] systemd[1]: Starting Load Kernel Modules... client # [ 1.755720] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.756990] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.746598] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.759540] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.755684] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.763454] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.768120] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.769891] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.772628] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.776433] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.764708] systemd[1]: Starting Journal Service... worker1 # [ 1.766707] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.768342] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.783946] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.775088] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.783613] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.790332] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.787416] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.781909] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.792845] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.790155] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.798740] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.788930] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.802057] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.799749] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.806892] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.807319] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.804834] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.801571] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.817377] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.819120] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.808168] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.816421] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.822716] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.828311] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.819563] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.828541] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.836065] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.836449] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.842457] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.842116] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.840085] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.851109] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.855708] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.848703] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.862469] systemd[1]: Finished Load Kernel Modules. client # [ 1.861186] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.859062] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.870591] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.861571] systemd[1]: Finished Load Kernel Modules. client # [ 1.872896] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.870826] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.871093] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.884409] systemd[1]: Finished Load Kernel Modules. lb # [ 1.890987] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.759575] systemd-modules-load[67]: Inserted module 'dm_mod' worker2 # [ 1.891580] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.762253] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.763327] systemd-modules-load[67]: Inserted module 'virtio_gpu' lb # [ 1.898307] systemd[1]: Started Journal Service. client # [ 1.898346] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.891638] systemd[1]: Started Journal Service. worker1 # [ 1.756989] systemd-modules-load[67]: Inserted module 'dm_mod' worker1 # [ 1.760990] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.763559] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.764722] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.777109] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.778061] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.911015] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.779120] systemd[1]: Reached target Local File Systems. worker2 # [ 1.910967] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.781821] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.769977] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 1.774084] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.772411] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.916570] systemd[1]: Started Journal Service. lb # [ 1.787075] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.777073] systemd[1]: Reached target Local File Systems. worker2 # [ 1.775348] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.779918] systemd[1]: Starting Create System Files and Directories... client # [ 1.923712] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.786628] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.932714] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.787465] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.789610] systemd[1]: Reached target Local File Systems. worker2 # [ 1.791275] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.793674] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.798642] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.806318] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.946142] systemd[1]: Started Journal Service. client # client # [ 1.809339] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 1.815687] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.804153] systemd[1]: Finished Apply Kernel Variables. client # [ 1.812524] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.809047] systemd[1]: Finished Create System Files and Directories. client # [ 1.822045] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.827090] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.830092] systemd[1]: Reached target Local File Systems. lb # [ 1.836371] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker2 # [ 1.825295] systemd[1]: Finished Create System Files and Directories. client # [ 1.836109] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.836431] systemd-udevd[80]: Using default interface naming scheme 'v261'. client # [ 1.841702] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.845164] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.859325] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.852267] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 1.861084] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.869177] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.875754] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.896370] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.912228] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.913501] systemd[1]: Reached target System Initialization. lb # [ 1.915369] systemd[1]: Reached target Basic System. worker1 # [ 1.913706] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.920385] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.916794] systemd[1]: Reached target System Initialization. worker1 # [ 1.917645] systemd[1]: Reached target Basic System. worker2 # [ 1.931757] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.932701] systemd[1]: Reached target System Initialization. worker2 # [ 1.934157] systemd[1]: Reached target Basic System. client # [ 1.972175] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.974747] systemd[1]: Reached target System Initialization. client # [ 1.975631] systemd[1]: Reached target Basic System. lb # [ 2.236038] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.239693] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.244097] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.248871] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.249783] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.240680] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.252403] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.253130] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.242458] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.254238] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.245132] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.250136] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.261021] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.262443] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.263576] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.267100] usb usb1: Product: EHCI Host Controller lb # [ 2.267810] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.263666] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.269421] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.259744] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.271108] hub 1-0:1.0: USB hub found lb # [ 2.273923] hub 1-0:1.0: 6 ports detected worker2 # [ 2.272963] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.276930] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.273737] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.277843] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.275458] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.273357] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.274348] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.277002] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.284651] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.291049] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.291871] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.283607] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.284775] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.286745] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.288952] usb usb1: Product: EHCI Host Controller client # [ 2.299543] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.290153] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.297762] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.291772] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.298546] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.303241] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.300426] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.293590] hub 1-0:1.0: USB hub found lb # [ 2.304420] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.295328] hub 1-0:1.0: 6 ports detected worker1 # [ 2.299704] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.307544] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.300433] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.308510] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.313735] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.311377] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.314341] usb usb1: Product: EHCI Host Controller lb # [ 2.318755] usb usb2: Product: UHCI Host Controller worker2 # [ 2.315013] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.319532] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.318462] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.317846] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.318947] hub 1-0:1.0: USB hub found worker2 # [ 2.320252] hub 1-0:1.0: 6 ports detected worker1 # [ 2.313291] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.324762] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.325458] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.315875] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.325281] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.326013] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.331238] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.325253] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.339006] hub 2-0:1.0: USB hub found worker1 # [ 2.328506] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.340846] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.346511] hub 2-0:1.0: 2 ports detected worker2 # [ 2.348139] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.352648] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.353409] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.344266] usb usb2: Product: UHCI Host Controller worker1 # [ 2.345190] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.355358] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.354193] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.361660] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.218472] systemd[1]: Starting Virtual Console Setup... client # [ 2.363466] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.233066] systemd[1]: Starting Virtual Console Setup... client # [ 2.366096] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.368586] usb usb1: Product: EHCI Host Controller lb # [ 2.235537] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.369397] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.370644] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.360927] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.367965] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.237370] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.372244] hub 1-0:1.0: USB hub found worker1 # [ 2.363707] SCSI subsystem initialized client # [ 2.373930] hub 1-0:1.0: 6 ports detected lb # [ 2.242174] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.376160] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.376955] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.375017] SCSI subsystem initialized worker1 # [ 2.367692] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.234099] systemd[1]: Starting Virtual Console Setup... lb # [ 2.383950] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.384740] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.240880] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.382720] usb usb2: Product: UHCI Host Controller worker2 # [ 2.241926] (udev-worker)[87]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.390844] SCSI subsystem initialized client # [ 2.391742] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.392521] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.248756] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.248878] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.254511] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.389196] hub 2-0:1.0: USB hub found lb # [ 2.399988] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.391643] hub 2-0:1.0: 2 ports detected worker2 # [ 2.257703] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.260235] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.405860] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.264130] systemd[1]: Finished Virtual Console Setup. client # [ 2.408883] SCSI subsystem initialized worker2 # [ 2.407776] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.412265] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.414811] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.272526] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.282070] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.412512] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.277964] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.413323] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.290558] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.423224] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.293291] systemd[1]: Finished Virtual Console Setup. lb # [ 2.429329] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.289984] (udev-worker)[84]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.429859] hub 2-0:1.0: USB hub found worker2 # [ 2.431160] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.436126] usb usb2: Product: UHCI Host Controller lb # [ 2.437960] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.434964] hub 2-0:1.0: 2 ports detected lb # [ 2.439184] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.429065] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.301865] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.308187] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.309220] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.301072] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.311689] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.302248] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.437020] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.305310] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.311576] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.441746] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.449475] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.450214] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.455926] usb usb3: Product: UHCI Host Controller lb # [ 2.456602] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.445531] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.318314] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.314804] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.316068] systemd[1]: Reached target Initrd Root Device. lb # [ 2.462927] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.323457] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.452417] usb usb3: Product: UHCI Host Controller client # [ 2.462946] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.453263] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.454163] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.465360] hub 3-0:1.0: USB hub found worker2 # [ 2.319062] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.464719] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.463377] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.464237] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.458686] hub 3-0:1.0: USB hub found client # [ 2.468470] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.472940] hub 3-0:1.0: 2 ports detected worker1 # [ 2.462914] hub 3-0:1.0: 2 ports detected worker2 # [ 2.470005] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.475204] hub 2-0:1.0: USB hub found worker2 # [ 2.473363] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.478104] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.467587] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.475464] usb usb3: Product: UHCI Host Controller worker1 # [ 2.468355] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.476144] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.479282] hub 2-0:1.0: 2 ports detected lb # [ 2.479968] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.470537] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.471409] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.483022] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.480359] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.474776] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.486131] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.482938] hub 3-0:1.0: USB hub found worker1 # [ 2.478632] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.489028] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.486756] hub 3-0:1.0: 2 ports detected lb # [ 2.490744] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.494019] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.350457] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.361698] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.494709] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.492620] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.497956] usb usb4: Product: UHCI Host Controller worker2 # [ 2.494496] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.498757] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.355502] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.362470] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.363615] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.492555] usb usb4: Product: UHCI Host Controller worker2 # [ 2.499498] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.504006] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.493301] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.364635] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.504284] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.494320] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.358954] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.371791] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.495671] hub 4-0:1.0: USB hub found worker2 # [ 2.503385] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.506793] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.508414] hub 4-0:1.0: USB hub found worker1 # [ 2.498000] hub 4-0:1.0: 2 ports detected lb # [ 2.511046] hub 4-0:1.0: 2 ports detected client # [ 2.510831] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.366498] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.513709] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.510040] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.511246] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.516752] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.517413] usb usb4: Product: UHCI Host Controller worker2 # [ 2.518128] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.520379] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.523660] usb usb3: Product: UHCI Host Controller client # [ 2.524459] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.522550] hub 4-0:1.0: USB hub found client # [ 2.526050] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.523179] hub 4-0:1.0: 2 ports detected client # [ 2.529167] hub 3-0:1.0: USB hub found client # [ 2.530448] hub 3-0:1.0: 2 ports detected worker1 # [ 2.523002] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.535852] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.536586] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.540308] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.532386] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.533348] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.540257] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.534460] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.406404] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.549171] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.542543] scsi host0: ahci client # [ 2.414117] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.544314] scsi host1: ahci client # [ 2.554816] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.546148] scsi host2: ahci client # [ 2.556009] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.557462] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.547911] scsi host3: ahci lb # [ 2.558629] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.555033] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.549514] scsi host4: ahci lb # [ 2.560597] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.560690] usb usb4: Product: UHCI Host Controller worker1 # [ 2.551167] scsi host5: ahci client # [ 2.561471] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.559289] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.552241] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.563746] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.565024] scsi host0: ahci worker1 # [ 2.553985] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.555243] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.566963] scsi host1: ahci client # [ 2.566181] hub 4-0:1.0: USB hub found worker2 # [ 2.563362] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.556435] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.568754] scsi host2: ahci worker1 # [ 2.557716] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.568289] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.558885] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.566473] scsi host0: ahci lb # [ 2.570675] scsi host3: ahci client # [ 2.570042] hub 4-0:1.0: 2 ports detected worker2 # [ 2.568412] scsi host1: ahci lb # [ 2.572402] scsi host4: ahci worker2 # [ 2.570020] scsi host2: ahci lb # [ 2.574227] scsi host5: ahci lb # [ 2.574885] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.571953] scsi host3: ahci client # [ 2.575100] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.576059] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.573932] scsi host4: ahci lb # [ 2.577379] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.578620] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.575558] scsi host5: ahci lb # [ 2.579875] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.576105] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.581231] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.578381] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.582450] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.579616] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.580862] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.582061] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.583251] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.589769] scsi host0: ahci client # [ 2.591149] scsi host1: ahci client # [ 2.595331] scsi host2: ahci client # [ 2.600451] scsi host3: ahci client # [ 2.601972] scsi host4: ahci client # [ 2.607498] scsi host5: ahci client # [ 2.608132] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.613652] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.616926] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.619088] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.620317] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.621592] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.622947] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.644152] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.645394] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.648213] usb 1-1: Product: QEMU USB Tablet lb # [ 2.649892] usb 1-1: Manufacturer: QEMU lb # [ 2.651491] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.662761] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.663960] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.665296] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.666130] usb 1-1: Manufacturer: QEMU worker1 # [ 2.666757] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.678884] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.680771] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.693562] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.694736] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.696112] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.696805] usb 1-1: Manufacturer: QEMU worker2 # [ 2.697471] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.715417] hid: raw HID events driver (C) Jiri Kosina client # [ 2.743105] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.746351] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.749811] usb 1-1: Product: QEMU USB Tablet client # [ 2.751862] usb 1-1: Manufacturer: QEMU client # [ 2.753804] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.636904] systemd[1]: Mounting /sysroot... worker1 # [ 2.633187] systemd[1]: Mounting /sysroot... worker2 # [ 2.638356] systemd[1]: Mounting /sysroot... client # [ 2.792409] hid: raw HID events driver (C) Jiri Kosina client # [ 2.679192] systemd[1]: Mounting /sysroot... worker1 # [ 2.867168] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.868180] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.869242] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.870183] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.871092] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.871991] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.873024] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.873824] ata3.00: applying bridge limits worker1 # [ 2.874455] ata3.00: configured for UDMA/100 worker1 # [ 2.875549] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.898028] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.897451] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.900691] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.898824] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.904211] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.905402] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.900973] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.906477] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.907304] ata3.00: applying bridge limits worker2 # [ 2.902823] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.908099] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.908981] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.904774] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.909932] ata3.00: configured for UDMA/100 worker2 # [ 2.906460] ata3.00: applying bridge limits lb # [ 2.910999] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.907964] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.909783] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.911638] ata3.00: configured for UDMA/100 worker2 # [ 2.913528] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.932743] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.933959] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.935354] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.936416] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.937665] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.938813] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.939970] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.940995] ata3.00: applying bridge limits client # [ 2.941761] ata3.00: configured for UDMA/100 client # [ 2.942728] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.940692] usbcore: registered new interface driver usbhid worker1 # [ 2.944253] usbhid: USB HID core driver worker1 # [ 2.955706] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.957703] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.961607] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.973277] usbcore: registered new interface driver usbhid lb # [ 2.975943] usbhid: USB HID core driver worker2 # [ 2.972479] usbcore: registered new interface driver usbhid worker2 # [ 2.973298] usbhid: USB HID core driver worker1 # [ 2.978491] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.001534] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.003347] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.992681] EXT4-fs (vda): mounted filesystem 0da89c8e-3218-4e07-b6f2-6c5adc41e4d8 r/w with ordered data mode. Quota mode: none. client # [ 3.003970] usbcore: registered new interface driver usbhid worker2 # [ 3.001515] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.864807] systemd[1]: Mounted /sysroot. worker2 # [ 3.004548] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.010685] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.866674] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.007768] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 3.012628] usbhid: USB HID core driver worker1 # [ 2.871084] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.012863] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.021039] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.025220] EXT4-fs (vda): mounted filesystem 9691f527-99d9-4fca-88fd-8047024c3083 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.023460] EXT4-fs (vda): mounted filesystem 71f9c82e-e231-4bc1-bed1-273f5f2ac2a6 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.883620] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.030895] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.888060] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.899431] systemd[1]: Mounted /sysroot. worker2 # [ 2.888069] systemd[1]: Mounted /sysroot. worker1 # [ 2.890132] systemd[1]: Reloading... lb # [ 2.901133] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.890209] systemd[1]: Reached target Initrd Root File System. client # [ 3.037314] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.905380] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.893357] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.920882] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.911295] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.923706] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.926144] systemd[1]: Reloading... client # [ 3.059661] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.915069] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.916693] systemd[1]: Reloading... client # [ 3.066940] EXT4-fs (vda): mounted filesystem 5364948e-6f97-49bf-be67-41f7f7f6fc54 r/w with ordered data mode. Quota mode: none. client # [ 2.932390] systemd[1]: Mounted /sysroot. client # [ 2.934099] systemd[1]: Reached target Initrd Root File System. client # [ 3.073756] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.937065] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.951604] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.955072] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.956558] systemd[1]: Reloading... worker1 # [ 2.967405] systemd[1]: Reloading finished in 77 ms. worker1 # [ 2.975324] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.980171] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 2.982785] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.985073] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.986111] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.009455] systemd[1]: Reloading finished in 83 ms. worker2 # [ 2.998441] systemd[1]: Reloading finished in 83 ms. lb # [ 3.018645] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.008405] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... lb # [ 3.021170] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker2 # [ 3.010586] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker2 # [ 3.014862] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.027707] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.016233] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.029158] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.030200] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.018200] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.040139] systemd[1]: Reloading finished in 85 ms. client # [ 3.048101] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... client # [ 3.050224] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... client # [ 3.055344] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.056771] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.057755] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.636106] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.639067] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.642382] systemd[1]: Mounting /sysroot/run... lb # [ 3.646135] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.635977] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.639636] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.652147] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.644169] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.643777] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.644784] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.649141] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.653161] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.653264] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.663311] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.676989] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.681187] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.687390] systemd[1]: Mounted /sysroot/run. client # [ 3.681118] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.688342] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.678089] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.689328] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.693250] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.681943] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.689176] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.686517] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.687979] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.689236] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.691266] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.703382] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.698177] systemd[1]: Mounting /sysroot/run... lb # [ 3.704923] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.707181] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.695560] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.707198] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.707240] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.708889] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.711399] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.713600] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.719200] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.716727] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.729046] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.730679] systemd[1]: Reached target Initrd File Systems. lb # [ 3.731736] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.722807] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.723811] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.724797] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.735258] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.730243] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.736839] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.738219] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.740857] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.751635] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.740085] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.742377] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.744658] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.742844] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.759168] systemd[1]: Finished Find NixOS closure. lb # [ 3.760474] systemd[1]: Reached target Initrd Default Target. lb # [ 3.762647] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.757940] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.759040] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.762361] systemd[1]: Mounted /sysroot/run. client # [ 3.763315] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.767897] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.765844] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.776594] systemd[1]: Stopped target Initrd Default Target. client # [ 3.771138] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.764565] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 3.766860] systemd[1]: Reached target Initrd File Systems. lb # [ 3.778032] systemd[1]: Stopped target Basic System. lb # [ 3.778914] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.768612] systemd[1]: Starting Find NixOS closure... lb # [ 3.781059] systemd[1]: Stopped target Path Units. lb # [ 3.781753] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.769697] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.772138] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.782759] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.770971] systemd[1]: Reached target Initrd Default Target. lb # [ 3.783731] systemd[1]: Stopped target Slice Units. lb # [ 3.784425] systemd[1]: Stopped target Socket Units. lb # [ 3.785345] systemd[1]: Stopped target System Initialization. worker2 # [ 3.773090] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.786172] systemd[1]: Stopped target Swaps. lb # [ 3.786804] systemd[1]: Stopped target Timer Units. client # [ 3.781191] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.787650] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.782711] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.789139] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.789960] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.791050] systemd[1]: Stopped Find NixOS closure. lb # [ 3.792485] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.794187] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.795312] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.796358] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.797527] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.798525] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.786745] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.787818] systemd[1]: Stopped target Basic System. worker1 # [ 3.789459] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.788732] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.799977] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.802024] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.790117] systemd[1]: Stopped target Path Units. lb # [ 3.803129] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.790794] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.791852] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.805061] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.792993] systemd[1]: Stopped target Slice Units. lb # [ 3.805817] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.793925] systemd[1]: Stopped target Socket Units. lb # [ 3.806720] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.795139] systemd[1]: Stopped target System Initialization. worker1 # [ 3.797529] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.796219] systemd[1]: Stopped target Swaps. lb # [ 3.808474] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.797161] systemd[1]: Stopped target Timer Units. lb # [ 3.809275] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.799179] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.798163] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 3.800339] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.810665] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.799101] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.811699] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.800107] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.801508] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.802594] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.804190] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.805261] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.806268] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.808065] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.808797] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.821273] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.810644] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.813764] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.811699] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.812681] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.814852] systemd[1]: Stopped target Basic System. worker2 # [ 3.813899] systemd[1]: Stopped target Local File Systems. lb # [ 3.826177] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.816133] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.816892] systemd[1]: Stopped target Path Units. worker2 # [ 3.815104] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.817666] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.818855] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.818052] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.820282] systemd[1]: Stopped target Slice Units. worker2 # [ 3.819026] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.821211] systemd[1]: Stopped target Socket Units. lb # [ 3.831395] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.822100] systemd[1]: Stopped target System Initialization. worker2 # [ 3.820284] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.832834] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.823163] systemd[1]: Stopped target Swaps. worker1 # [ 3.823915] systemd[1]: Stopped target Timer Units. lb # [ 3.834356] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.823065] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.825243] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.836135] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.824095] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.826091] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.826888] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 3.838113] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.828096] systemd[1]: Stopped Find NixOS closure. lb # [ 3.839112] systemd[1]: Closed udev Control Socket. worker1 # [ 3.829465] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.840154] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.830331] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.841121] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.832328] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.843154] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.833331] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.844025] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.834548] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.845532] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.833622] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.846571] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.836087] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.847499] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.837138] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.838316] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.837193] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.839898] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.838334] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.840781] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.839269] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.843487] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.842080] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.844377] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.845317] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.844793] systemd[1]: Closed udev Control Socket. worker2 # [ 3.845747] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.847566] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.847060] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.849090] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.850093] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.848095] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.848924] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.850115] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.863896] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.852127] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.853044] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 3.866273] systemd[1]: Finished Cleanup udev Database. worker2 # [ 3.854437] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.867475] systemd[1]: Reached target Switch Root. worker2 # [ 3.855482] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.858177] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 3.869620] systemd[1]: Starting NixOS Activation... worker1 # [ 3.862144] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.863091] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.863953] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.870346] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.871396] systemd[1]: Closed udev Control Socket. worker2 # [ 3.869774] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.871421] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.874055] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.872760] systemd[1]: Reached target Switch Root. worker1 # [ 3.874825] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.875861] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.874645] systemd[1]: Starting NixOS Activation... worker1 # [ 3.876737] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.877790] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.878746] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.879740] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.881132] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.883121] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.897913] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.899575] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.900860] systemd[1]: Reached target Switch Root. worker1 # [ 3.902670] systemd[1]: Starting NixOS Activation... lb # [ 3.934763] initrd-nixos-activation-start[191]: booting system configuration /nix/store/g4s62ig20603prhr6rpvm83lvwh8ggjh-nixos-system-lb-test worker2 # [ 3.942706] initrd-nixos-activation-start[191]: booting system configuration /nix/store/7p3x1fr20awv6rqp4jyn18vhmavwjmq9-nixos-system-worker2-test lb # [ 3.959557] initrd-nixos-activation-start[191]: running activation script... worker2 # [ 3.968368] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 3.971377] initrd-nixos-activation-start[191]: booting system configuration /nix/store/a69286jdpp14g4cl1d6rckvg3a912f09-nixos-system-worker1-test worker1 # [ 3.996434] initrd-nixos-activation-start[191]: running activation script... lb # [ 4.129271] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 4.161710] initrd-nixos-activation-start[214]: setting up /etc... worker1 # [ 4.185701] initrd-nixos-activation-start[214]: setting up /etc... lb # [ 4.227207] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.228818] systemd[1]: Finished NixOS Activation. lb # [ 4.230808] systemd[1]: Starting Switch Root... lb # [ 4.245769] systemd[1]: Switching root. worker2 # [ 4.264724] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.267070] systemd[1]: Finished NixOS Activation. worker2 # [ 4.268443] systemd[1]: Starting Switch Root... worker2 # [ 4.282414] systemd[1]: Switching root. worker1 # [ 4.286474] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.288984] systemd[1]: Finished NixOS Activation. worker1 # [ 4.290154] systemd[1]: Starting Switch Root... worker1 # [ 4.303587] systemd[1]: Switching root. lb # [ 4.500908] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.555494] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 4.573026] NET: Registered PF_VSOCK protocol family worker1 # [ 4.563179] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.639603] NET: Registered PF_VSOCK protocol family worker1 # [ 4.649083] NET: Registered PF_VSOCK protocol family client # [ 4.679778] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.701417] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.703077] systemd[1]: Reached target Initrd File Systems. client # [ 4.704648] systemd[1]: Starting Find NixOS closure... client # [ 4.708374] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.727114] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.728802] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.736661] systemd[1]: Finished Find NixOS closure. client # [ 4.738193] systemd[1]: Reached target Initrd Default Target. client # [ 4.739541] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.752722] systemd[1]: Stopped target Initrd Default Target. client # [ 4.754128] systemd[1]: Stopped target Basic System. client # [ 4.754842] systemd[1]: Stopped target Initrd Root Device. client # [ 4.755765] systemd[1]: Stopped target Path Units. client # [ 4.756518] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.757792] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.759160] systemd[1]: Stopped target Slice Units. client # [ 4.760196] systemd[1]: Stopped target Socket Units. client # [ 4.762132] systemd[1]: Stopped target System Initialization. client # [ 4.763101] systemd[1]: Stopped target Swaps. client # [ 4.763746] systemd[1]: Stopped target Timer Units. client # [ 4.764500] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.765377] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.766242] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.767496] systemd[1]: Stopped Find NixOS closure. client # [ 4.768681] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.770143] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.771210] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.772215] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.773518] systemd[1]: Stopped Load Kernel Modules. client # [ 4.774579] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.776226] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.777538] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.778816] systemd[1]: Stopped Create System Files and Directories. client # [ 4.780415] systemd[1]: Stopped target Local File Systems. client # [ 4.781427] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.783143] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.784155] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.785586] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.786657] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.789134] systemd[1]: Stopped Virtual Console Setup. client # [ 4.796115] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.933260] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 4.937991] systemd[1]: Detected virtualization kvm. lb # [ 4.938846] systemd[1]: Detected architecture x86-64. client # [ 4.800138] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.939844] systemd[1]: Detected first boot. lb # [ 4.942362] systemd[1]: Initializing machine ID from random generator. client # [ 4.805759] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.808175] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 4.811115] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 4.812214] systemd[1]: Closed udev Control Socket. client # [ 4.813554] systemd[1]: Starting Cleanup udev Database... client # [ 4.815142] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.816275] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 4.817256] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.818418] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 4.820136] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 4.821153] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.822072] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.824805] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.841157] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.842421] systemd[1]: Finished Cleanup udev Database. client # [ 4.843578] systemd[1]: Reached target Switch Root. client # [ 4.845249] systemd[1]: Starting NixOS Activation... worker2 # [ 4.999838] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.009620] systemd[1]: Detected virtualization kvm. worker2 # [ 5.011434] systemd[1]: Detected architecture x86-64. worker2 # [ 5.013415] systemd[1]: Detected first boot. worker2 # [ 5.017208] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.010577] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.021264] systemd[1]: Detected virtualization kvm. worker1 # [ 5.023393] systemd[1]: Detected architecture x86-64. worker1 # [ 5.025841] systemd[1]: Detected first boot. worker1 # [ 5.030338] systemd[1]: Initializing machine ID from random generator. client # [ 4.918535] initrd-nixos-activation-start[190]: booting system configuration /nix/store/lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test client # [ 4.946696] initrd-nixos-activation-start[190]: running activation script... lb # [ 5.165136] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.160601] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.251225] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.259866] systemd[1]: Applying preset policy. lb # [ 5.276806] systemd[1]: Applying preset policy. client # [ 5.144436] initrd-nixos-activation-start[213]: setting up /etc... worker2 # [ 5.359658] systemd[1]: Applying preset policy. client # [ 5.249376] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.252036] systemd[1]: Finished NixOS Activation. client # [ 5.253187] systemd[1]: Starting Switch Root... client # [ 5.266090] systemd[1]: Switching root. lb # [ 5.447272] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.445850] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.522102] systemd[1]: Populated /etc with preset unit settings. client # [ 5.529505] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 5.621055] NET: Registered PF_VSOCK protocol family lb # [ 5.626262] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.627573] systemd[1]: Stopped initrd-switch-root.service. lb # [ 5.629675] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 5.631956] systemd[1]: Created slice Slice /system/getty. lb # [ 5.633245] systemd[1]: Created slice User and Session Slice. lb # [ 5.634219] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 5.635419] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 5.636500] systemd[1]: Expecting device /dev/hvc0... lb # [ 5.637210] systemd[1]: Expecting device /dev/ttyS0... lb # [ 5.637969] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 5.638768] systemd[1]: Stopped target initrd-fs.target. lb # [ 5.639525] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 5.640326] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.641195] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 5.642145] systemd[1]: Reached target Path Units. lb # [ 5.642856] systemd[1]: Reached target Remote File Systems. lb # [ 5.643615] systemd[1]: Reached target Slice Units. lb # [ 5.644314] systemd[1]: Reached target Swaps. lb # [ 5.645968] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.636161] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 5.648317] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.637626] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.639890] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.641954] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.643298] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.644265] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.645527] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.646627] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.647342] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.648136] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.648994] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.649729] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.650516] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 5.650074] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.651360] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.652294] systemd[1]: Reached target Path Units. lb # [ 5.663342] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.653029] systemd[1]: Reached target Remote File Systems. lb # [ 5.664280] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.653791] systemd[1]: Reached target Slice Units. worker1 # [ 5.654492] systemd[1]: Reached target Swaps. lb # [ 5.667114] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.656432] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 5.668224] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.658928] systemd[1]: Listening on Process Core Dump Socket. lb # [ 5.670516] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.660655] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 5.671981] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 5.673149] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.674418] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 5.678336] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 5.679386] systemd[1]: Listening on udev Control Socket. lb # [ 5.680258] systemd[1]: Listening on udev Varlink Socket. lb # [ 5.682314] systemd[1]: Mounting Huge Pages File System... lb # [ 5.684581] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.662544] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.675090] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.678008] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.679353] systemd[1]: Listening on Journal Audit Socket. lb # [ 5.690261] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.681853] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.683305] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.684485] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.697053] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.685786] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.689745] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.690817] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.691675] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.693931] systemd[1]: Mounting Huge Pages File System... lb # [ 5.705058] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.696545] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.707968] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.709299] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.703775] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.715690] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.711711] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.713774] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.715124] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.716039] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 5.720748] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.717210] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.710871] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.718354] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.719032] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.719774] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.720637] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.721403] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.722164] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.723014] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.723893] systemd[1]: Reached target Path Units. worker2 # [ 5.724586] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.725364] systemd[1]: Reached target Slice Units. worker2 # [ 5.726046] systemd[1]: Reached target Swaps. worker1 # [ 5.719069] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.730757] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.727937] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.730340] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.730724] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.732430] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 5.745065] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.732032] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.745494] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.746454] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.740597] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.749137] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.750481] systemd[1]: Listening on Journal Audit Socket. lb # [ 5.755674] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.753014] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.754495] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.755602] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.759348] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.749341] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.756901] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.760763] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.761779] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.762657] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.764865] systemd[1]: Mounting Huge Pages File System... lb # [ 5.770365] systemd[1]: Starting Journal Service... worker1 # [ 5.760271] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.767545] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.764712] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.774749] systemd[1]: Mounting Kernel Debug File System... lb # [ 5.780465] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.782594] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.776092] systemd[1]: Starting Journal Service... lb # [ 5.789758] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.780402] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.790840] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 5.797981] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.787946] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.799440] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.792972] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.803462] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.794754] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.802510] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.808616] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.803022] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.814402] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.807252] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 5.810638] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.817946] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.811794] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 5.813780] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 5.816147] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 5.818678] systemd[1]: Mounted FUSE Control File System. lb # [ 5.833138] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.829716] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.830708] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 5.836729] systemd-journald[284]: Collecting audit messages is enabled. worker1 # [ 5.826592] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.838130] systemd[1]: Mounted Huge Pages File System. worker1 # [ 5.831103] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 5.843324] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.841996] systemd[1]: Starting Journal Service... lb # [ 5.847117] systemd[1]: Mounted Kernel Debug File System. lb # [ 5.850202] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.854159] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.851840] systemd[1]: Starting Load Kernel Modules... lb # [ 5.858233] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.726500] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.858009] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 5.728403] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.867937] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.866016] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 5.872855] systemd[1]: Started Journal Service. worker2 # [ 5.868452] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.864011] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 5.866134] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.745786] systemd[1]: Mounted FUSE Control File System. lb # [ 5.881123] loop: module loaded worker1 # [ 5.871166] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.878874] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.751534] systemd-modules-load[285]: Inserted module 'loop' lb # [ 5.886342] EXT4-fs (vda): re-mounted 9691f527-99d9-4fca-88fd-8047024c3083. worker2 # [ 5.884177] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.886499] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.888041] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.890526] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.892109] systemd[1]: Mounted Kernel Trace File System. lb # [ 5.763899] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.894058] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.898854] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 5.771818] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 5.895007] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.902824] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 5.896554] EXT4-fs (vda): re-mounted 0da89c8e-3218-4e07-b6f2-6c5adc41e4d8. lb # [ 5.775392] systemd[1]: Starting Firewall... worker1 # [ 5.907299] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 5.909853] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 5.789062] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 5.911553] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.794908] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 5.918686] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 5.796136] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker1 # [ 5.920329] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.799702] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 5.924081] systemd-journald[284]: Collecting audit messages is enabled. worker2 # [ 5.931843] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.933214] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.803335] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.937483] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 5.933735] loop: module loaded lb # [ 5.811692] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 5.813178] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 5.941260] systemd[1]: Finished Load Kernel Modules. lb # [ 5.824282] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 5.947422] systemd[1]: Starting Firewall... lb # [ 5.825125] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.827282] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 5.952146] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.961928] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.972405] EXT4-fs (vda): re-mounted 71f9c82e-e231-4bc1-bed1-273f5f2ac2a6. worker2 # [ 5.979252] systemd-journald[284]: Collecting audit messages is enabled. worker2 # [ 5.984285] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.985588] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 5.980588] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.846716] systemd[1]: Queued start job for default target Multi-User System.[ 5.981178] systemd[1]: Started Journal Service. worker2 # [ 5.988424] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.991724] systemd[1]: Detected virtualization kvm. worker1 # client # [ 5.993686] systemd[1]: Detected architecture x86-64. client # [ 5.995762] systemd[1]: Detected first boot. worker2 # [ 5.996235] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.997599] loop: module loaded client # [ 5.999783] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.853026] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.998172] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.859550] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 6.004933] systemd[1]: Finished Load Kernel Modules. worker1 # [ 5.868138] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 6.009810] systemd[1]: Starting Firewall... worker1 # [ 5.871288] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.020164] systemd-journald[284]: Received client request to flush runtime journal. worker2 # [ 6.016804] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 5.877299] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 5.895275] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 5.896198] systemd[1]: Reached target First Boot Complete. worker2 # [ 6.040984] systemd[1]: Started Journal Service. worker2 # [ 5.900239] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.905119] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.908856] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 5.916121] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 5.933251] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker1 # [ 6.070907] systemd-journald[284]: Received client request to flush runtime journal. worker2 # [ 5.944896] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 5.947703] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 5.980464] systemd[1]: Mounted Kernel Configuration File System. lb # [ 5.981489] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 5.983136] systemd[1]: Reached target First Boot Complete. lb # [ 5.983978] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 5.972167] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 5.974748] systemd[1]: Reached target First Boot Complete. lb # [ 5.988124] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 5.985349] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 5.993125] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.004145] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.147818] systemd-journald[284]: Received client request to flush runtime journal. lb # [ 6.055306] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.061803] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.055457] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.056608] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 6.062368] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.064926] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.067131] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.069328] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.089609] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.110244] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 6.111450] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 6.114417] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.247665] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.113952] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.115365] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.116491] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.119771] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.127307] systemd-udevd[317]: Using default interface naming scheme 'v261'. lb # [ 6.156283] systemd-udevd[328]: Using default interface naming scheme 'v261'. worker2 # [ 6.187115] systemd-udevd[317]: Using default interface naming scheme 'v261'. lb # [ 6.204820] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.200142] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 6.365023] systemd[1]: Applying preset policy. worker2 # [ 6.256558] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.282417] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.311111] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.338380] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 6.371884] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.395765] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.528881] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.427980] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 6.438837] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.435536] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.451177] (udev-worker)[351]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.453486] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.454851] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.482928] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 6.499204] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.506916] systemd[1]: Mounting /run/wrappers... worker2 # [ 6.508146] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.516618] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.537870] systemd[1]: Mounted /run/wrappers. lb # [ 6.538623] systemd[1]: Reached target Local File Systems. worker1 # [ 6.527436] (udev-worker)[358]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.530158] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.543726] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.548092] systemd[1]: Starting register-nix-paths.service... lb # [ 6.551238] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.552070] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.559558] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.548510] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.551936] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.553752] systemd[1]: Reached target Local File Systems. worker1 # [ 6.555606] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.568307] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.560036] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.560342] (udev-worker)[356]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.706200] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.563348] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.707662] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.564436] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.710094] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.568305] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.712162] systemd[1]: Created slice Slice /system/getty. worker2 # [ 6.568133] systemd[1]: Mounting /run/wrappers... client # [ 6.713531] systemd[1]: Created slice User and Session Slice. client # [ 6.714502] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.572297] systemd[1]: Starting Create System Files and Directories... client # [ 6.715746] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.716876] systemd[1]: Expecting device /dev/hvc0... client # [ 6.717564] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.718344] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.719209] systemd[1]: Stopped target initrd-fs.target. client # [ 6.720072] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.720924] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.721829] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.722716] systemd[1]: Reached target Path Units. client # [ 6.723415] systemd[1]: Reached target Remote File Systems. client # [ 6.724240] systemd[1]: Reached target Slice Units. client # [ 6.724996] systemd[1]: Reached target Swaps. client # [ 6.726653] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.728959] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.730623] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 6.584561] (udev-worker)[353]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.590095] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.732382] systemd[1]: Listening on Factory Reset Management. client # [ 6.745211] systemd[1]: Listening on Hostname Service Socket. client # [ 6.748094] systemd[1]: Starting Journal Log Access Socket... client # [ 6.749376] systemd[1]: Listening on Journal Audit Socket. client # [ 6.752192] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.753352] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.754509] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.755867] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.759335] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.760402] systemd[1]: Listening on udev Control Socket. client # [ 6.761335] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 6.617857] systemd[1]: Mounted /run/wrappers. client # [ 6.763378] systemd[1]: Mounting Huge Pages File System... worker2 # [ 6.618883] systemd[1]: Reached target Local File Systems. client # [ 6.766846] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.621839] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 6.624262] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.627546] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.773691] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 6.628835] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.632143] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.634817] systemd[1]: Starting Create System Files and Directories... client # [ 6.781208] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.652469] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 6.655281] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.657065] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.791147] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.659576] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.662337] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.666425] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.801692] systemd[1]: Starting Load Kernel Module configfs... client # [ 6.802529] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.669844] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.675123] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.665139] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.669307] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.680697] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.820341] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.827199] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.838985] systemd[1]: Mounting FUSE Control File System... client # [ 6.842061] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.850279] systemd[1]: Starting Journal Service... lb # [ 6.725830] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.713852] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.861298] systemd[1]: Starting Load Kernel Modules... worker2 # [ 6.717900] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.734378] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.738625] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.873275] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 6.731492] systemd[1]: Finished Create System Files and Directories. worker1 # [ 6.734173] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.737222] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.885689] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.889704] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.904664] systemd-journald[283]: Collecting audit messages is enabled. client # [ 6.905964] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.916936] systemd[1]: Listening on Journal Log Access Socket. client # [ 6.920967] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.778312] systemd[1]: Finished Create System Files and Directories. client # [ 6.925319] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.783181] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.785936] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.794223] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.795530] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.935726] systemd[1]: Started Journal Service. client # [ 6.942169] loop: module loaded client # [ 6.808456] systemd[1]: Mounted Kernel Debug File System. client # [ 6.809348] systemd[1]: Mounted Kernel Trace File System. client # [ 6.811260] systemd-modules-load[284]: Inserted module 'loop' client # [ 6.817107] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.823084] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.817978] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.821105] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.817388] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.827185] systemd[1]: Finished Load Kernel Modules. client # [ 6.976685] EXT4-fs (vda): re-mounted 5364948e-6f97-49bf-be67-41f7f7f6fc54. client # [ 6.844305] systemd[1]: Mounted FUSE Control File System. client # [ 6.849154] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.850844] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.856818] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.855989] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.863137] systemd[1]: Starting Update is Completed... client # [ 6.858066] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.859206] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.863912] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.869256] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.862850] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.868222] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 6.873133] systemd[1]: Starting Update is Completed... client # [ 6.880129] systemd[1]: Starting Apply Kernel Variables... lb # [ 7.024048] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 6.895205] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.896805] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.897983] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 6.910922] systemd[1]: Finished Update is Completed. lb # [ 7.060642] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 6.917089] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.920965] systemd[1]: Starting Update is Completed... client # [ 7.074821] systemd-journald[283]: Received client request to flush runtime journal. worker1 # [ 6.948928] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.950936] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.953549] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.956183] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.959519] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.961689] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.963947] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.976882] systemd[1]: Finished Update is Completed. worker2 # [ 7.004180] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.006619] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.009137] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.011575] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.015639] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.017239] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.021247] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.031434] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.032825] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 7.027177] systemd[1]: Finished Update is Completed. client # [ 7.035345] systemd[1]: Reached target First Boot Complete. client # [ 7.036132] systemd[1]: Finished Apply Kernel Variables. client # [ 7.039337] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.088761] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.093680] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 7.121533] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 7.258886] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.130311] systemd[1]: Finished Firewall. worker1 # [ 7.265179] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.072927] ACPI: button: Power Button [PWRF] lb # [ 7.154739] mousedev: PS/2 mouse device common for all mice client # [ 7.139277] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.140253] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.142053] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.298421] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.156497] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 7.297722] ACPI: button: Power Button [PWRF] worker2 # [ 7.162564] systemd[1]: Finished Firewall. lb # [ 7.174851] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.198055] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 7.172506] systemd-udevd[315]: Using default interface naming scheme 'v261'. worker2 # [ 7.308646] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.205210] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.198129] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:24:42 UTC (1790076282) lb # [ 7.198204] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.230800] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.232215] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 7.267162] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.268308] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.288414] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 7.199150] systemd-journald[284]: Time jumped backwards, rotating. lb # [ 7.229043] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 7.229131] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 7.285963] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.294237] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.313630] systemd[1]: Finished Firewall. worker1 # [ 7.383528] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.412976] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.257164] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.277341] Console: switching to colour dummy device 80x25 lb # [ 7.460550] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.336078] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.342353] ACPI: button: Power Button [PWRF] worker2 # [ 7.449511] mousedev: PS/2 mouse device common for all mice lb # [ 7.460668] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.486538] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.486540] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 7.457704] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.464998] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.349942] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.422938] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 7.423009] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:24:42 UTC (1790076282) lb # [ 7.497770] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.498460] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.369259] systemd[1]: Finished register-nix-paths.service. lb # [ 7.370970] systemd[1]: Reached target System Initialization. client # [ 7.368131] (udev-worker)[327]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.373095] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.376162] systemd[1]: Started niks3 garbage collection timer. lb # [ 7.377060] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.378045] systemd[1]: Reached target Timer Units. lb # [ 7.379839] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.376340] (udev-worker)[322]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 7.465150] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.384816] systemd[1]: Listening on niks3 server socket. client # [ 7.378964] (udev-worker)[322]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.465235] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:24:43 UTC (1790076283) lb # [ 7.385622] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.470808] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.386522] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 7.387706] systemd[1]: Reached target Socket Units. lb # [ 7.388885] systemd[1]: Reached target Basic System. lb # [ 7.390643] systemd[1]: Started backdoor.service. worker1 # [ 7.423088] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.423727] systemd-journald[284]: Time jumped backwards, rotating. worker1 # [ 7.430400] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 7.398076] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.406326] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.416251] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.436717] Console: switching to colour dummy device 80x25 worker1 # [ 7.443817] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.444929] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 7.424886] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.474093] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.474210] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.480442] Console: switching to colour dummy device 80x25 worker2 # [ 7.537196] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.443129] systemd[1]: Starting resolvconf update... worker1 # [ 7.496366] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 7.579027] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.579034] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.457299] systemd[1]: Started rustfs.service. lb # [ 7.592854] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.456129] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.457321] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.459068] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.599955] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 7.589565] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.590235] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.461107] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.462798] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.464359] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.603837] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.603843] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 7.608502] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.478771] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 7.609214] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.606906] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.607616] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # connecting to host... worker2 # [ 7.627937] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.628698] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.654307] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.524356] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.663632] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 7.531425] nsncd[523]: Sep 22 11:24:42.964 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.541071] systemd[1]: Finished Post-Boot Actions. lb # [ 7.549314] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.559762] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.552755] systemd[1]: Finished register-nix-paths.service. worker1 # [ 7.553884] systemd[1]: Reached target System Initialization. lb # [ 7.567340] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 7.557062] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 7.558688] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 7.561187] systemd[1]: Reached target Timer Units. worker1 # [ 7.562270] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.563670] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 7.565142] systemd[1]: Listening on Nix worker-protocol over gRPC. client # [ 7.570837] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.567129] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 7.569145] systemd[1]: Reached target Socket Units. worker1 # [ 7.571116] systemd[1]: Reached target Basic System. worker1 # [ 7.573443] systemd[1]: Started backdoor.service. worker1 # [ 7.576156] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 7.577155] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.590113] systemd[1]: Starting User Login Management... worker1 # [ 7.580180] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.585604] systemd[1]: Started Reset console on configuration changes. worker1 # [ 7.596588] systemd[1]: Starting resolvconf update... worker1 # [ 7.599160] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 7.596412] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.599456] systemd[1]: Reached target System Initialization. worker2 # [ 7.600591] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.602163] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.604732] systemd[1]: Reached target Timer Units. worker2 # [ 7.606900] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.614223] systemd[1]: Mounted /run/wrappers. worker2 # [ 7.608144] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.615932] systemd[1]: Reached target Local File Systems. worker2 # [ 7.610295] systemd[1]: Listening on Nix worker-protocol over gRPC. client # [ 7.617538] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.612600] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.613801] systemd[1]: Reached target Socket Units. client # [ 7.621077] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.617534] systemd[1]: Reached target Basic System. worker2 # [ 7.618312] systemd[1]: Started backdoor.service. worker2 # [ 7.622375] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.623509] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.626110] systemd[1]: Starting Post-Boot Actions... lb # [ 7.639963] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.631621] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.637061] systemd[1]: Starting resolvconf update... worker2 # [ 7.642270] systemd[1]: Starting D-Bus System Message Bus... lb # [ 7.675317] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.677834] systemd[1]: Finished Post-Boot Actions. client # [ 7.685185] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.688610] systemd[1]: Starting Virtual Console Setup... client # [ 7.701259] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.709995] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.706776] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.714988] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 7.706951] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 7.714466] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.709526] nsncd[516]: Sep 22 11:24:42.915 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # connecting to host... worker1 # [ 7.714338] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.726778] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.716434] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.718128] systemd[1]: Starting User Login Management... client # [ 7.728318] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.735642] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.734865] systemd[1]: Finished Post-Boot Actions. client # [ 7.679995] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.753286] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.687577] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.761095] dbus-broker-launch[520]: Looking up NSS user entry for 'systemd-timesync'... client # [ 7.683639] ACPI: button: Power Button [PWRF] client # [ 7.687312] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.738085] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.762698] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # connecting to host... client # [ 7.774384] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.770075] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.768390] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.770160] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.772810] dbus-broker-launch[520]: NSS returned no entry for 'systemd-timesync' client # [ 7.779328] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.773800] dbus-broker-launch[520]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 7.775379] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.784142] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.778339] systemd[1]: Starting User Login Management... worker2 # [ 7.780538] nsncd[515]: Sep 22 11:24:43.955 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 7.793143] systemd[1]: Started D-Bus System Message Bus. lb # [ 7.944994] Console: switching to colour frame buffer device 160x50 worker1 # [ 7.831460] dbus-broker-launch[520]: Ready worker1 # [ 7.681018] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 7.849185] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.687828] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.996678] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 7.853246] systemd-logind[552]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 7.865031] systemd-logind[552]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 7.866749] dbus-broker-launch[550]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 7.873522] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 7.874908] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 7.877125] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 7.878534] dbus-broker-launch[550]: NSS returned no entry for 'systemd-timesync' lb # [ 7.881308] dbus-broker-launch[550]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.884108] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.878613] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.681259] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.884936] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 7.910003] Console: switching to colour frame buffer device 160x50 client # [ 7.762775] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T11:24:43 UTC (1790076283) client # [ 7.762848] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.886982] systemd-logind[552]: New seat seat0. client # [ 7.764311] systemd-journald[283]: Time jumped backwards, rotating. lb # [ 7.887841] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 7.883891] systemd[1]: Starting Update is Completed... lb # [ 7.891230] systemd[1]: Started User Login Management. lb # [ 7.892584] systemd[1]: nscd.service: Deactivated successfully. lb # [ 7.897228] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.889275] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.043412] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.800274] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.903830] systemd[1]: Started D-Bus System Message Bus. lb # [ 7.921279] systemd[1]: Starting linger-users.service... worker2 # [ 7.911757] dbus-broker-launch[519]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 7.926587] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.914903] dbus-broker-launch[519]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.050924] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.916899] dbus-broker-launch[519]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 7.884515] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 7.922553] systemd[1]: Stopping Host and Network Name Lookups... client # [ 7.927488] systemd[1]: Finished Update is Completed. worker2 # [ 7.921603] dbus-broker-launch[519]: Ready worker2 # [ 7.924283] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.925863] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.073914] ppdev: user-space parallel port driver worker2 # [ 7.929652] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.932257] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.934476] systemd[1]: Stopping User and Group Name Lookups... lb # [ 7.945833] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 7.933752] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 7.936294] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 7.935075] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 7.935894] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.939087] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 7.939903] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 7.939732] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.776389] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.776471] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.944219] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.945087] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.946504] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.944475] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 7.945497] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 7.948322] systemd-logind[540]: New seat seat0. worker2 # [ 7.948190] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 7.952239] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.952986] systemd-logind[540]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 7.952544] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.955134] systemd[1]: Started User Login Management. worker1 # [ 7.955856] systemd-logind[540]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 7.957051] systemd[1]: Starting linger-users.service... worker2 # [ 7.956653] systemd-logind[540]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 7.962368] systemd-logind[540]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 7.965327] systemd-logind[540]: New seat seat0. worker2 # [ 7.968669] systemd[1]: Started User Login Management. worker2 # [ 7.972205] systemd[1]: Starting linger-users.service... client # [ 7.780414] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 7.892350] Console: switching to colour dummy device 80x25 client # [ 8.101842] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 8.101949] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.992636] dbus-broker-launch[550]: Ready worker1 # [ 7.987983] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 7.988922] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.990596] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.994836] nsncd[590]: Sep 22 11:24:43.200 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.015648] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.019225] systemd[1]: Finished linger-users.service. worker1 # [ 8.009433] systemd[1]: Finished resolvconf update. worker1 # [ 8.011735] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.016388] systemd[1]: Starting DHCP Client... worker1 # [ 8.019068] systemd[1]: Starting Address configuration of eth1... worker1 # [ 8.023316] systemd[1]: Starting Extra networking commands.... worker1 # [ 8.027201] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.028102] systemd[1]: Finished linger-users.service. lb # [ 8.038491] nsncd[616]: Sep 22 11:24:43.472 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.041373] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.029244] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.042250] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.030223] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.043123] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.031695] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.181305] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.037423] nsncd[589]: Sep 22 11:24:44.209 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.181554] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 8.040934] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.041908] systemd[1]: Finished linger-users.service. worker2 # [ 8.189584] ppdev: user-space parallel port driver lb # [ 8.061282] systemd[1]: Finished resolvconf update. lb # [ 8.064064] systemd[1]: Reached target Preparation for Network. worker2 # [ 8.061480] systemd[1]: Finished resolvconf update. lb # [ 8.074372] systemd[1]: Starting DHCP Client... worker2 # [ 8.062666] systemd[1]: Reached target Preparation for Network. worker2 # [ 8.065131] systemd[1]: Starting DHCP Client... lb # [ 8.077701] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.067471] systemd[1]: Starting Address configuration of eth1... client # [ 8.214371] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 8.070066] systemd[1]: Starting Extra networking commands.... lb # [ 8.082938] systemd[1]: Starting Extra networking commands.... lb # [ 8.221409] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.222307] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 8.256239] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.127262] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.130152] systemd[1]: Stopped Virtual Console Setup. client # [ 8.264620] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.256831] ppdev: user-space parallel port driver lb # [ 8.281001] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.152972] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.151616] network-addresses-eth1-start[620]: adding address 192.168.1.3/24... done client # [ 8.169436] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.172379] network-addresses-eth1-start[620]: adding address 2001:db8:1::3/64... done client # [ 8.196212] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.198637] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.191824] network-addresses-eth1-start[619]: adding address 192.168.1.4/24... done worker1 # [ 8.195269] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.210342] network-addresses-eth1-start[619]: adding address 2001:db8:1::4/64... done worker2 # [ 8.236841] systemd[1]: Finished Address configuration of eth1. client # [ 8.382509] ppdev: user-space parallel port driver worker1 # [ 8.251639] systemd-vconsole-setup[600]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.255374] systemd[1]: Finished Virtual Console Setup. client # [ 8.384795] Console: switching to colour frame buffer device 160x50 client # [ 8.406943] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 8.271481] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.273553] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.266270] systemd-vconsole-setup[584]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.281274] network-addresses-eth1-start[646]: adding address 192.168.1.2/24... done worker2 # [ 8.270235] systemd-logind[540]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.278858] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.273692] systemd[1]: Finished Virtual Console Setup. client # [ 8.423476] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 8.423174] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.308256] network-addresses-eth1-start[646]: adding address 2001:db8:1::2/64... done worker1 # [ 8.299823] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.300705] systemd[1]: Reached target Network. worker1 # [ 8.302332] systemd[1]: Starting Permit User Sessions... client # [ 8.451718] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.309742] dhcpcd[631]: dhcpcd-10.3.2 starting worker1 # [ 8.314438] dhcpcd[690]: dev: loaded udev worker2 # [ 8.455609] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.321963] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.323543] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.318596] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.319645] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.320405] systemd[1]: Stopping Virtual Console Setup... client # [ 8.328245] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.323686] systemd-logind[540]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 8.323313] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.328147] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.329147] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.329853] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 8.465270] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 8.467495] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.336880] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.345334] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.348257] systemd[1]: Reached target Network. lb # [ 8.360585] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.351257] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.352663] dhcpcd[628]: dhcpcd-10.3.2 starting worker2 # [ 8.363178] dhcpcd[689]: dev: loaded udev worker1 # [ 8.369307] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.380197] systemd[1]: Started Getty on tty1. worker1 # [ 8.380897] systemd[1]: Reached target Login Prompts. worker2 # [ 8.522711] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.523148] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.520631] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 8.530985] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.540357] kvm_amd: TSC scaling supported lb # [ 8.540810] kvm_amd: Nested Virtualization enabled lb # [ 8.541774] kvm_amd: Nested Paging enabled lb # [ 8.542649] kvm_amd: LBR virtualization supported lb # [ 8.543397] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 8.544520] kvm_amd: Virtual GIF supported lb # [ 8.546750] kvm_amd: Virtual NMI enabled lb # [ 8.414753] dhcpcd[664]: dhcpcd-10.3.2 starting lb # [ 8.424425] dhcpcd[714]: dev: loaded udev worker2 # [ 8.412107] systemd[1]: Finished Permit User Sessions. client # [ 8.559231] kvm_amd: TSC scaling supported client # [ 8.561205] kvm_amd: Nested Virtualization enabled client # [ 8.562023] kvm_amd: Nested Paging enabled client # [ 8.562435] kvm_amd: LBR virtualization supported worker2 # [ 8.417087] systemd[1]: Started Getty on tty1. client # [ 8.563235] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.564154] kvm_amd: Virtual GIF supported worker2 # [ 8.419076] systemd[1]: Reached target Login Prompts. client # [ 8.564785] kvm_amd: Virtual NMI enabled lb # [ 8.588192] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.588635] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 8.460351] systemd[1]: Finished Extra networking commands.. lb # [ 8.467207] systemd[1]: Reached target Network. worker2 # [ 8.456376] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.471697] systemd[1]: Starting PostgreSQL Server... worker1 # [ 8.462350] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.478506] systemd[1]: Starting Permit User Sessions... client # [ 8.612794] EDAC MC: Ver: 3.0.0 worker1 # [ 8.609210] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.639156] EDAC MC: Ver: 3.0.0 lb # [ 8.516523] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.671923] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.666510] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.667230] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.670068] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 8.670904] cfg80211: failed to load regulatory.db lb # [ 8.563484] systemd[1]: Finished Permit User Sessions. worker2 # [ 8.694926] kvm_amd: TSC scaling supported worker2 # [ 8.695389] kvm_amd: Nested Virtualization enabled worker2 # [ 8.695848] kvm_amd: Nested Paging enabled worker2 # [ 8.696254] kvm_amd: LBR virtualization supported worker1 # [ 8.690242] kvm_amd: TSC scaling supported worker2 # [ 8.697118] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.690844] kvm_amd: Nested Virtualization enabled worker2 # [ 8.697821] kvm_amd: Virtual GIF supported worker1 # [ 8.691309] kvm_amd: Nested Paging enabled worker2 # [ 8.698268] kvm_amd: Virtual NMI enabled worker1 # [ 8.693413] kvm_amd: LBR virtualization supported worker1 # [ 8.694391] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.695316] kvm_amd: Virtual GIF supported worker1 # [ 8.696054] kvm_amd: Virtual NMI enabled lb # [ 8.574461] systemd[1]: Started Getty on tty1. lb # [ 8.575453] systemd[1]: Reached target Login Prompts. worker2 # [ 8.715842] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.716557] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.718409] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.719275] cfg80211: failed to load regulatory.db client # [ 8.590297] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.733981] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.601812] dhcpcd[690]: eth0: waiting for carrier worker2 # [ 8.744437] EDAC MC: Ver: 3.0.0 worker1 # [ 8.604366] dhcpcd[690]: eth0: carrier acquired worker1 # [ 8.612111] dhcpcd[690]: DUID 00:01:00:01:32:45:21:fb:52:54:00:12:34:56 worker1 # [ 8.613190] dhcpcd[690]: eth0: IAID 00:12:34:56 worker1 # [ 8.614641] dhcpcd[690]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 8.753767] EDAC MC: Ver: 3.0.0 worker2 # [ 8.761094] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.625706] systemd-vconsole-setup[419]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.620121] dhcpcd[689]: eth0: waiting for carrier worker2 # [ 8.621463] dhcpcd[689]: libudev: received NULL device lb # [ 8.768372] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 8.629084] systemd[1]: Finished Virtual Console Setup. worker2 # [ 8.622572] dhcpcd[689]: libudev: received NULL device client # [ 8.630659] systemd[1]: Reached target System Initialization. worker2 # [ 8.625413] dhcpcd[689]: eth0: carrier acquired client # [ 8.632158] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.633512] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.635138] systemd[1]: Reached target Timer Units. client # [ 8.635885] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 8.630332] dhcpcd[689]: DUID 00:01:00:01:32:45:21:fc:52:54:00:12:34:56 client # [ 8.637268] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 8.631579] dhcpcd[689]: eth0: IAID 00:12:34:56 client # [ 8.638744] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 8.632424] dhcpcd[689]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 8.639966] systemd[1]: Reached target Socket Units. client # [ 8.640796] systemd[1]: Reached target Basic System. client # [ 8.642170] systemd[1]: Started backdoor.service. client # [ 8.644880] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.641238] systemd-vconsole-setup[692]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.649126] systemd[1]: Starting nftables firewall... worker1 # [ 8.644477] systemd[1]: Finished Virtual Console Setup. client # [ 8.654354] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.666273] systemd[1]: Starting Post-Boot Actions... lb # [ 8.807677] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 8.808372] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 8.812474] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 8.813379] cfg80211: failed to load regulatory.db client # [ 8.673600] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.673142] systemd-vconsole-setup[683]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.676242] systemd[1]: Finished Virtual Console Setup. client # [ 8.689313] systemd[1]: Starting resolvconf update... client # [ 8.713155] systemd[1]: Starting D-Bus System Message Bus... client # [ 8.727974] nsncd[427]: Sep 22 11:24:44.603 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.733037] systemd[1]: Started Name Service Cache Daemon (nsncd). client # connecting to host... lb # [ 8.885326] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 8.752797] dhcpcd[714]: eth0: waiting for carrier lb # [ 8.753958] dhcpcd[714]: libudev: received NULL device lb # [ 8.755233] dhcpcd[714]: libudev: received NULL device lb # [ 8.756456] dhcpcd[714]: eth0: carrier acquired client # [ 8.757093] systemd[1]: Finished Post-Boot Actions. lb # [ 8.768812] dhcpcd[714]: DUID 00:01:00:01:32:45:21:fc:52:54:00:12:34:56 lb # [ 8.769922] dhcpcd[714]: eth0: IAID 00:12:34:56 lb # [ 8.770892] dhcpcd[714]: eth0: adding address fe80::5054:ff:fe12:3456 client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 8.776517] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.782336] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.780985] dhcpcd[714]: eth0: soliciting a DHCP lease lb # [ 8.793440] postgresql-pre-start[735]: The files belonging to this database system will be owned by user "postgres". lb # [ 8.794986] postgresql-pre-start[735]: This user must also own the server process. lb # [ 8.807101] postgresql-pre-start[735]: The database cluster will be initialized with locale "en_US.UTF-8". client: connected to guest root shell lb # [ 8.808225] postgresql-pre-start[735]: The default database encoding has accordingly been set to "UTF8". client: (connecting took 9.47 seconds) lb # [ 8.809312] postgresql-pre-start[735]: The default text search configuration will be set to "english". client: (finished: waiting for the VM to finish booting, in 9.47 seconds) lb # [ 8.810356] postgresql-pre-start[735]: Data page checksums are enabled. client # [ 8.796704] systemd[1]: Starting User Login Management... lb # [ 8.811184] postgresql-pre-start[735]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok client # [ 8.800800] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.812292] postgresql-pre-start[735]: creating subdirectories ... ok lb # [ 8.813897] postgresql-pre-start[735]: selecting dynamic shared memory implementation ... posix lb # [ 8.949302] NET: Registered PF_PACKET protocol family lb # [ 8.821353] dhcpcd[714]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 8.824398] dhcpcd[714]: eth0: probing address 10.0.2.15/24 client # [ 8.870598] dbus-broker-launch[435]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.883628] systemd-vconsole-setup[653]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.890593] systemd[1]: Finished Virtual Console Setup. client # [ 8.886546] dbus-broker-launch[435]: NSS returned no entry for 'systemd-timesync' client # [ 8.889125] dbus-broker-launch[435]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.911386] postgresql-pre-start[735]: selecting default "max_connections" ... 100 client # [ 8.921068] systemd[1]: Started D-Bus System Message Bus. client # [ 8.925281] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.926345] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.927583] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.929106] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.933578] systemd-logind[457]: New seat seat0. client # [ 8.934976] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.938155] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.939561] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.941474] systemd-logind[457]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.943922] systemd-logind[457]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.945226] systemd-logind[457]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.955052] systemd[1]: Started User Login Management. lb # [ 8.969609] postgresql-pre-start[735]: selecting default "shared_buffers" ... 128MB client # [ 8.972396] systemd[1]: Starting linger-users.service... client # [ 8.979946] dbus-broker-launch[435]: Ready client # [ 8.983936] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 9.046533] systemd[1]: linger-users.service: Deactivated successfully. client # [ 9.050698] systemd[1]: Finished linger-users.service. client # [ 9.061282] nsncd[515]: Sep 22 11:24:44.936 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.063768] systemd[1]: Finished resolvconf update. client # [ 9.065206] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.067273] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.068112] systemd[1]: Reached target User and Group Name Lookups. client # [ 9.071647] systemd[1]: Starting DHCP Client... client # [ 9.159567] dhcpcd[552]: dhcpcd-10.3.2 starting client # [ 9.164449] dhcpcd[558]: dev: loaded udev client # [ 9.311719] 8021q: 802.1Q VLAN Support v1.8 client # [ 9.217194] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 9.385304] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 9.397304] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.398029] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 9.400199] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.401112] cfg80211: failed to load regulatory.db client # [ 9.439455] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.302281] dhcpcd[558]: eth0: waiting for carrier client # [ 9.303248] dhcpcd[558]: eth0: carrier acquired client # [ 9.310537] dhcpcd[558]: DUID 00:01:00:01:32:45:21:fd:52:54:00:12:34:56 client # [ 9.311763] dhcpcd[558]: eth0: IAID 00:12:34:56 client # [ 9.312812] dhcpcd[558]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 9.319876] systemd[1]: Finished nftables firewall. client # [ 9.321556] systemd[1]: Reached target Preparation for Network. client # [ 9.324239] systemd[1]: Starting Address configuration of eth1... client # [ 9.326742] systemd[1]: Starting Extra networking commands.... client # [ 9.506216] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 9.377310] network-addresses-eth1-start[584]: adding address 192.168.1.1/24... done client # [ 9.388083] network-addresses-eth1-start[584]: adding address 2001:db8:1::1/64... done client # [ 9.399678] systemd[1]: Finished Address configuration of eth1. client # [ 9.421045] systemd[1]: Finished Extra networking commands.. client # [ 9.422750] systemd[1]: Reached target Network. client # [ 9.425337] systemd[1]: Starting Permit User Sessions... client # [ 9.439487] systemd[1]: Finished Permit User Sessions. client # [ 9.442468] systemd[1]: Started Getty on tty1. client # [ 9.443826] systemd[1]: Reached target Login Prompts. lb # [ 9.466429] postgresql-pre-start[735]: selecting default time zone ... UTC lb # [ 9.469202] postgresql-pre-start[735]: creating configuration files ... ok worker1 # [ 9.588581] dhcpcd[690]: eth0: soliciting a DHCP lease worker1 # [ 9.739025] NET: Registered PF_PACKET protocol family worker1 # [ 9.611847] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 9.616641] dhcpcd[690]: eth0: probing address 10.0.2.15/24 lb # [ 9.631833] postgresql-pre-start[735]: running bootstrap script ... ok worker2 # [ 9.703656] dhcpcd[689]: eth0: soliciting a DHCP lease worker2 # [ 9.863260] NET: Registered PF_PACKET protocol family worker2 # [ 9.728220] dhcpcd[689]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.731336] dhcpcd[689]: eth0: probing address 10.0.2.15/24 lb # [ 9.998585] postgresql-pre-start[735]: performing post-bootstrap initialization ... ok client: (finished: waiting for unit network-addresses-eth1.service, in 10.72 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 10.111162] dhcpcd[690]: eth0: soliciting an IPv6 router worker1 # [ 10.112455] dhcpcd[690]: eth0: Router Advertisement from fe80::2 worker1 # [ 10.113456] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.114292] dhcpcd[690]: eth0: adding route to fec0::/64 worker1 # [ 10.115091] dhcpcd[690]: eth0: adding default route via fe80::2 lb: (finished: waiting for unit network-addresses-eth1.service, in 0.03 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.156542] postgresql-pre-start[735]: syncing data to disk ... ok lb # [ 10.158109] postgresql-pre-start[735]: initdb: warning: enabling "trust" authentication for local connections lb # [ 10.159330] postgresql-pre-start[735]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 10.161293] postgresql-pre-start[735]: Success. You can now start the database server using: lb # [ 10.162387] postgresql-pre-start[735]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.02 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.01 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.230443] postgres[769]: [769] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 10.233061] postgres[769]: [769] LOG: listening on IPv6 address "::1", port 5432 lb # [ 10.234179] postgres[769]: [769] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 10.236659] postgres[769]: [769] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 10.247654] postgres[778]: [778] LOG: database system was shut down at 2026-09-22 11:24:45 GMT lb # [ 10.253858] postgres[769]: [769] LOG: database system is ready to accept connections lb # [ 10.258027] systemd[1]: Started PostgreSQL Server. worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service lb # [ 10.265068] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 10.411643] postgresql-setup-start[798]: CREATE DATABASE lb # [ 10.438266] postgresql-setup-start[803]: CREATE ROLE lb # [ 10.449681] postgresql-setup-start[805]: ALTER DATABASE lb # [ 10.454091] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 10.455682] systemd[1]: Reached target PostgreSQL. worker2 # [ 10.529266] dhcpcd[689]: eth0: soliciting an IPv6 router worker2 # [ 10.530795] dhcpcd[689]: eth0: Router Advertisement from fe80::2 worker2 # [ 10.531637] dhcpcd[689]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 10.544265] dhcpcd[714]: eth0: soliciting an IPv6 router worker2 # [ 10.532530] dhcpcd[689]: eth0: adding route to fec0::/64 lb # [ 10.545515] dhcpcd[714]: eth0: Router Advertisement from fe80::2 worker2 # [ 10.533341] dhcpcd[689]: eth0: adding default route via fe80::2 lb # [ 10.546386] dhcpcd[714]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 10.547326] dhcpcd[714]: eth0: adding route to fec0::/64 lb # [ 10.548090] dhcpcd[714]: eth0: adding default route via fe80::2 client # [ 10.774725] dhcpcd[558]: eth0: soliciting a DHCP lease client # [ 10.930363] NET: Registered PF_PACKET protocol family client # [ 10.796816] dhcpcd[558]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 10.800380] dhcpcd[558]: eth0: probing address 10.0.2.15/24 client # [ 11.344792] dhcpcd[558]: eth0: soliciting an IPv6 router client # [ 11.347523] dhcpcd[558]: eth0: Router Advertisement from fe80::2 client # [ 11.349870] dhcpcd[558]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 11.352154] dhcpcd[558]: eth0: adding route to fec0::/64 client # [ 11.353992] dhcpcd[558]: eth0: adding default route via fe80::2 lb # [ 13.923649] dhcpcd[714]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 13.927355] dhcpcd[714]: eth0: adding route to 10.0.2.0/24 lb # [ 13.930119] dhcpcd[714]: eth0: adding default route via 10.0.2.2 lb # [ 14.010169] systemd[1]: Started DHCP Client. lb # [ 14.012383] systemd[1]: Reached target Network is Online. lb # [ 14.015328] systemd[1]: Started Envoy reverse proxy. lb # [ 14.019793] systemd[1]: Started mock-oidc.service. lb # [ 14.066217] mock-oidc-server[897]: Mock OIDC Server running lb # [ 14.068162] mock-oidc-server[897]: OIDC Address: 192.168.1.2:8080 lb # [ 14.069169] mock-oidc-server[897]: Issue Address: 0.0.0.0:8081 lb # [ 14.070078] mock-oidc-server[897]: Issuer: http://192.168.1.2:8080/oidc lb # [ 14.071465] mock-oidc-server[897]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 14.073129] mock-oidc-server[897]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 14.074583] mock-oidc-server[897]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 14.257382] envoy[896]: [2026-09-22 11:24:49.692][896][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 14.260386] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 14.262080] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 14.263925] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 14.268358] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 14.271353] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 14.273393] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 14.275523] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 14.278064] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 14.281573] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 14.284363] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 14.286352] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 14.288323] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 14.290696] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 14.293631] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 14.297088] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 14.301332] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 14.303454] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 14.305800] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 14.307750] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 14.311088] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 14.313451] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 14.315423] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 14.318022] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 14.331319] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 14.334177] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 14.337268] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 14.340632] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 14.343367] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 14.346375] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default worker1 # [ 14.337864] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 14.348388] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed worker1 # [ 14.339464] dhcpcd[690]: eth0: adding route to 10.0.2.0/24 worker1 # [ 14.340537] dhcpcd[690]: eth0: adding default route via 10.0.2.2 lb # [ 14.350289] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 14.354213] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 14.356672] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 14.359727] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 14.370257] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 14.375604] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 14.379084] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 14.380756] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 14.385596] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 14.392631] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 14.398775] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 14.401475] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 14.403325] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 14.405153] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain worker1 # [ 14.401905] systemd[1]: Started DHCP Client. worker1 # [ 14.403588] systemd[1]: Reached target Multi-User System. worker1 # [ 14.404826] systemd[1]: Startup finished in 863ms (kernel) + 3.627s (initrd) + 9.912s (userspace) = 14.404s. lb # [ 14.407138] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 14.436621] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 14.440086] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 14.442658] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 14.445327] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 14.447324] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 14.454588] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 14.456552] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 14.462090] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 14.464295] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 14.466304] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 14.469364] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 14.472596] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 14.474590] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 14.476435] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 14.480084] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 14.481971] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 14.483902] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 14.489112] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 14.492449] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 14.498875] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 14.501485] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 14.504539] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 14.507326] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 14.510120] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 14.512090] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 14.516647] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 14.518675] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 14.522533] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 14.525078] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 14.528689] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 14.531183] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 14.533607] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 14.536484] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 14.540935] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 14.542868] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 14.545560] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 14.547672] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 14.550205] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 14.552611] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 14.556242] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 14.559095] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 14.561072] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 14.565594] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 14.567102] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 14.568882] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 14.576158] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 14.578280] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 14.579931] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 14.585755] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 14.587338] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 14.589244] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 14.590843] envoy[896]: [2026-09-22 11:24:49.695][896][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 14.592486] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 14.603293] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 14.605124] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 14.607390] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 14.609074] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 14.612525] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 14.614738] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 14.616345] envoy[896]: [2026-09-22 11:24:49.696][896][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 14.617728] envoy[896]: [2026-09-22 11:24:49.762][896][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 14.619060] envoy[896]: [2026-09-22 11:24:49.763][896][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 14.631549] envoy[896]: [2026-09-22 11:24:49.763][896][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 14.632928] envoy[896]: [2026-09-22 11:24:49.763][896][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 14.640173] envoy[896]: [2026-09-22 11:24:49.763][896][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 14.644618] envoy[896]: [2026-09-22 11:24:50.080][896][info][main] [source/server/server.cc:968] runtime: {} lb # [ 14.647945] envoy[896]: [2026-09-22 11:24:50.083][896][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 14.649785] envoy[896]: [2026-09-22 11:24:50.085][896][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 14.651968] envoy[896]: [2026-09-22 11:24:50.087][896][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 14.654140] envoy[896]: [2026-09-22 11:24:50.089][896][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 14.655601] envoy[896]: [2026-09-22 11:24:50.089][896][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 14.657051] envoy[896]: [2026-09-22 11:24:50.089][896][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 14.683052] envoy[896]: [2026-09-22 11:24:50.118][896][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 14.675056] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 14.690379] envoy[896]: [2026-09-22 11:24:50.125][896][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 14.692697] envoy[896]: [2026-09-22 11:24:50.128][896][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 14.695624] envoy[896]: [2026-09-22 11:24:50.128][896][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 14.740724] dhcpcd[689]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 14.743811] dhcpcd[689]: eth0: adding route to 10.0.2.0/24 worker2 # [ 14.745752] dhcpcd[689]: eth0: adding default route via 10.0.2.2 worker1 # [ 14.757282] nix-grpc-daemon[781]: ts=2026-09-22T11:24:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 14.768926] nix-grpc-daemon[781]: ts=2026-09-22T11:24:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 14.771272] nix-grpc-daemon[781]: ts=2026-09-22T11:24:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 14.779210] nix-grpc-daemon[781]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 14.780742] nix-grpc-daemon[781]: E0000 00:00:1790076289.989266 781 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 14.786121] nix-grpc-daemon[781]: E0000 00:00:1790076289.996308 781 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 14.789291] nix-grpc-daemon[781]: ts=2026-09-22T11:24:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 14.793130] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 14.799955] systemd[1]: Started DHCP Client. worker2 # [ 14.802382] systemd[1]: Reached target Multi-User System. worker2 # [ 14.803223] systemd[1]: Reached target Network is Online. worker2 # [ 14.805450] systemd[1]: Starting scheduler-token.service... worker1 # [ 14.807068] nix-grpc-daemon[781]: E0000 00:00:1790076290.017252 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 14.828297] envoy[896]: [2026-09-22 11:24:50.263][896][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 14.830082] envoy[896]: [2026-09-22 11:24:50.265][896][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 14.831672] envoy[896]: [2026-09-22 11:24:50.265][896][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 14.834486] envoy[896]: [2026-09-22 11:24:50.270][896][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 14.824865] nix-grpc-daemon[781]: E0000 00:00:1790076290.035183 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 14.829054] nix-grpc-daemon[781]: E0000 00:00:1790076290.037469 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 14.836428] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 14.838079] systemd[1]: Finished scheduler-token.service. worker1 # [ 14.839964] nix-grpc-daemon[781]: E0000 00:00:1790076290.050284 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 14.839341] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 32ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 14.843288] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 14.849832] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 14.851914] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 14.925185] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 14.935295] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 14.937407] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 14.950610] nix-grpc-daemon[782]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 14.952198] nix-grpc-daemon[782]: E0000 00:00:1790076291.127284 782 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 14.958583] nix-grpc-daemon[782]: E0000 00:00:1790076291.135589 782 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 14.963059] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 14.965592] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 14.968625] systemd[1]: Startup finished in 888ms (kernel) + 3.590s (initrd) + 10.484s (userspace) = 14.962s. worker2 # [ 14.989693] nix-grpc-daemon[782]: E0000 00:00:1790076291.165840 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.003542] nix-grpc-daemon[782]: E0000 00:00:1790076291.180497 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.009061] nix-grpc-daemon[782]: E0000 00:00:1790076291.182829 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.021381] nix-grpc-daemon[782]: E0000 00:00:1790076291.197919 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.031401] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.033184] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.053047] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.056297] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.234843] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 client # [ 15.247057] dhcpcd[558]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 15.247986] dhcpcd[558]: eth0: adding route to 10.0.2.0/24 worker2 # [ 15.239095] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 15.248760] dhcpcd[558]: eth0: adding default route via 10.0.2.2 worker1 # [ 15.256637] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.258499] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 15.305561] systemd[1]: Started DHCP Client. client # [ 15.307587] systemd[1]: Reached target Multi-User System. client # [ 15.308448] systemd[1]: Startup finished in 886ms (kernel) + 4.574s (initrd) + 9.847s (userspace) = 15.308s. worker2 # [ 15.439891] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.441844] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.459484] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.463441] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.642582] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.644481] nix-grpc-daemon[782]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.664304] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.668223] nix-grpc-daemon[781]: ts=2026-09-22T11:24:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.845993] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.849893] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.869820] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.873439] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.050736] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.052636] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.074341] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.078287] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.253232] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.254962] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.279093] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.283105] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.455740] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.457576] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.483903] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.487951] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.658401] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.660226] nix-grpc-daemon[782]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.688655] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.692659] nix-grpc-daemon[781]: ts=2026-09-22T11:24:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.861033] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.862860] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.894893] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.898348] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.063924] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.065834] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.095610] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.099551] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.266656] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.268683] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.300489] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.304425] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.469337] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.471169] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.505235] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.509203] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.671975] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.673790] nix-grpc-daemon[782]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.710120] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.714219] nix-grpc-daemon[781]: ts=2026-09-22T11:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.875226] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.879260] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.916410] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.919485] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.081360] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.085068] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.117177] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.121684] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.286344] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.290125] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.321969] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.325922] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.491081] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.494881] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.526753] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.530691] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.695869] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.699754] nix-grpc-daemon[782]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.731600] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.735478] nix-grpc-daemon[781]: ts=2026-09-22T11:24:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.901089] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.904835] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.937877] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.941146] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.107361] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.110537] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.138878] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.142412] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.308160] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.310157] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.343238] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.347201] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.510816] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.512544] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.548097] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.551985] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.713245] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.714955] nix-grpc-daemon[782]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.752986] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.757141] nix-grpc-daemon[781]: ts=2026-09-22T11:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 19.919996] rustfs-bucket-start[960]: mb s3://farm lb # [ 19.930928] systemd[1]: Finished rustfs-bucket.service. worker2 # [ 19.916410] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.920260] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 19.937519] systemd[1]: Starting niks3 server... worker1 # [ 19.958935] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.962194] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.081293] postgres[978]: [978] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 20.082505] postgres[978]: [978] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 20.103485] niks3-server[969]: 2026/09/22 11:24:55 OK 20241026095416_initial_model.sql (12.18ms) lb # [ 20.107083] niks3-server[969]: 2026/09/22 11:24:55 OK 20251210153512_drop_unused_gin_index.sql (3.76ms) lb # [ 20.111830] niks3-server[969]: 2026/09/22 11:24:55 OK 20251218171726_add_pins.sql (4.84ms) lb # [ 20.116316] niks3-server[969]: 2026/09/22 11:24:55 OK 20260628120000_add_object_size_and_stats.sql (3.23ms) lb # [ 20.120786] niks3-server[969]: 2026/09/22 11:24:55 OK 20260905000000_add_claims.sql (4.52ms) lb # [ 20.124752] niks3-server[969]: 2026/09/22 11:24:55 OK 20260920000000_drop_claims.sql (2.72ms) lb # [ 20.125980] niks3-server[969]: 2026/09/22 11:24:55 goose: successfully migrated database to version: 20260920000000 lb # [ 20.130273] niks3-server[969]: 2026/09/22 11:24:55 OK 1_commit_pending_closure.sql (2.92ms) lb # [ 20.133882] niks3-server[969]: 2026/09/22 11:24:55 OK 2_object_stats_trigger.sql (1.8ms) lb # [ 20.135087] niks3-server[969]: 2026/09/22 11:24:55 goose: up to current file version: 2 worker2 # [ 20.122497] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 lb # [ 20.138884] niks3-server[969]: 2026/09/22 11:24:55 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key worker2 # [ 20.125650] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.159841] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 lb # [ 20.172847] niks3-server[969]: 2026/09/22 11:24:55 INFO Read proxy enabled — serving cache objects from S3 lb # [ 20.175459] niks3-server[969]: 2026/09/22 11:24:55 INFO Using socket-activated listener address=0.0.0.0:5751 worker1 # [ 20.163865] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.178362] niks3-server[969]: 2026/09/22 11:24:55 INFO systemd watchdog enabled interval=15s lb # [ 20.180493] niks3-server[969]: 2026/09/22 11:24:55 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 20.181710] systemd[1]: Started niks3 server. lb # [ 20.183118] systemd[1]: Reached target Multi-User System. lb # [ 20.185235] systemd[1]: Startup finished in 871ms (kernel) + 3.544s (initrd) + 15.769s (userspace) = 20.184s. worker2 # [ 20.323418] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.327213] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.364887] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.368933] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.528446] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.532265] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.569860] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.573859] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.733181] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.737117] nix-grpc-daemon[782]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.774841] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.778914] nix-grpc-daemon[781]: ts=2026-09-22T11:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.938163] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.941954] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.981261] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.984486] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 10.83 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.02 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 21.142333] envoy[896]: conn peer=[::1]:50626 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker2 # [ 21.144502] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.147672] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.183178] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.187304] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.244412] systemd[1]: Starting scheduler-token.service... worker2 # [ 21.278146] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 21.279854] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.281064] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 36ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.03 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 21.344685] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.346414] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.387705] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.391646] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.547285] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.549348] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.592722] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.596665] nix-grpc-daemon[781]: ts=2026-09-22T11:24:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.750104] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.751868] nix-grpc-daemon[782]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.797509] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.801411] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.952497] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.954321] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.003714] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.006798] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.155468] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.157192] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.204169] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.208123] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 22.359319] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.362422] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.409230] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.413093] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.560149] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.562138] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.613954] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.617906] nix-grpc-daemon[781]: ts=2026-09-22T11:24:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.762702] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.764427] nix-grpc-daemon[782]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.818750] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.822667] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.965139] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.966917] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.024571] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.028144] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.168164] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.169813] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.228923] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.232867] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 23.370729] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.372513] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 23.433869] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.437722] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.573231] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.574959] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.638523] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.642434] nix-grpc-daemon[781]: ts=2026-09-22T11:24:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.775622] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.777400] nix-grpc-daemon[782]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.842896] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.846802] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.977971] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.979660] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.049460] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.052562] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.180954] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.182967] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.250389] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.254326] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.383791] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.385688] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 24.455126] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.459157] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.586226] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.588068] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.660120] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.663988] nix-grpc-daemon[781]: ts=2026-09-22T11:24:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.788948] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.791112] nix-grpc-daemon[782]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.864417] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.866232] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.991812] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.995063] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.067282] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.069036] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.196546] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.199616] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.269617] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.273561] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.400229] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.401958] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 25.474466] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.478400] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.602766] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.604588] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.679413] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.683391] nix-grpc-daemon[781]: ts=2026-09-22T11:25:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.805246] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.807068] nix-grpc-daemon[782]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.883833] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.887841] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.007341] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.009067] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.089574] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.093146] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.210130] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.211833] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.293969] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.297961] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.412737] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.414792] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 26.498676] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.500520] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 26.615472] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.617305] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.701029] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.702889] nix-grpc-daemon[781]: ts=2026-09-22T11:25:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.818123] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.819916] nix-grpc-daemon[782]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.903539] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.905302] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.020910] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.024700] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.106440] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.108081] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.227123] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.230331] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.308827] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.310593] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.427926] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.429691] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.511569] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 27.515537] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 27.630476] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.632271] nix-grpc-daemon[782]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.717511] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.720881] nix-grpc-daemon[781]: ts=2026-09-22T11:25:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.833421] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.837489] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.918550] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.922705] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.037961] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.039933] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.125271] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.129496] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.240945] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.242679] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.325918] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.329879] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.443296] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.445195] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.530859] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.534938] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 28.645979] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.648043] nix-grpc-daemon[782]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.735457] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.737363] nix-grpc-daemon[781]: ts=2026-09-22T11:25:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.848808] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.850599] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.937890] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.939661] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.051810] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.055692] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.140815] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.143335] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.256479] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.258065] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.344615] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.348560] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.458695] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.460482] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.549457] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.553460] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 29.661208] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.663066] nix-grpc-daemon[782]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.753928] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.755855] nix-grpc-daemon[781]: ts=2026-09-22T11:25:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.863752] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.865626] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.956452] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.958310] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.066680] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.070508] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.159658] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.161361] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.179238] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_take_over lb # [ 30.191938] niks3-server[969]: 2026/09/22 11:25:05 INFO lead: acquired remote=192.168.1.4:57198 worker2 # [ 30.271593] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.273545] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.362564] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.366453] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.474154] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.475861] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.567465] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.571408] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 30.676641] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.678332] nix-grpc-daemon[782]: ts=2026-09-22T11:25:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.772343] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.776271] nix-grpc-daemon[781]: ts=2026-09-22T11:25:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.879762] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.883670] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.976635] nix-grpc-daemon[781]: ts=2026-09-22T11:25:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.978434] nix-grpc-daemon[781]: ts=2026-09-22T11:25:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.084735] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.098140] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 31.101630] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52924 worker2 # [ 31.105535] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 31.179436] nix-grpc-daemon[781]: ts=2026-09-22T11:25:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.179130] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:52924 worker2 # [ 31.180755] nix-grpc-daemon[782]: ts=2026-09-22T11:25:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.65 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 32.132440] nix-grpc-daemon[782]: ts=2026-09-22T11:25:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 32.137323] systemd[1]: Started Nix Daemon. worker2 # [ 32.219977] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 32.235255] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 1/5) worker2 # [ 32.319353] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 2/5) worker2 # [ 32.420595] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 122 ms (attempt 3/5) worker2 # [ 32.546258] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 728 ms (attempt 4/5) worker2 # [ 33.278890] nix-grpc-daemon[782]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 33.287811] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 33.319538] nix-grpc-daemon[781]: ts=2026-09-22T11:25:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 33.329541] systemd[1]: Started Nix Daemon. worker1 # [ 33.441495] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 33.468476] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5) worker1 # [ 33.476874] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 2/5) worker1 # [ 33.576485] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 3/5) worker1 # [ 33.614146] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 4/5) worker1 # [ 33.783683] nix-grpc-daemon[781]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 33.787120] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 33.800136] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=debug event=path_info_miss path=lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test error="error: path '/nix/store/lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 33.814609] nix-grpc-daemon[782]: ts=2026-09-22T11:25:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 33.826155] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=debug event=path_info_miss path=lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test error="error: path '/nix/store/lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.03 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 34.019945] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 34.024467] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46232 worker1 # [ 34.036975] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46232 worker1 # [ 34.045505] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=debug event=path_info_miss path=lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test error="error: path '/nix/store/lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 34.054515] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:46232 worker1 # [ 34.063607] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=debug event=path_info_miss path=lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test error="error: path '/nix/store/lhx66ikp98yri7sp1yzjik9bkkmk12nb-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker1 # [ 34.202804] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 34.328743] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.39 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 34.466208] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52932 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 34.478936] nix-grpc-daemon[781]: ts=2026-09-22T11:25:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 34.502339] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 34.504158] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 34.552357] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 34.561722] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying 1 paths to 'lb:50051'... worker2 # [ 34.569509] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker2 # [ 34.584246] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 34.615532] nix-grpc-daemon[782]: ts=2026-09-22T11:25:10Z level=info event=niks3_push_started pid=883 lb # [ 34.687903] envoy[896]: conn peer=[2001:db8:1::1]:49268 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=406 ms=1715 lb # [ 34.692163] envoy[896]: conn peer=[2001:db8:1::1]:45606 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=59 lb # [ 34.696096] envoy[896]: conn peer=[2001:db8:1::1]:45610 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=5 lb # [ 34.700469] envoy[896]: conn peer=[2001:db8:1::1]:45612 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=10 worker2 # [ 34.773236] nix-grpc-daemon[883]: time=2026-09-22T11:25:10.949Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 34.868176] nix-daemon[868]: accepted connection from pid 896, user nix-grpc-daemon (trusted) worker2 # [ 34.886397] nix-daemon[868]: reaped child process 899, status = succeeded worker2 # [ 34.971911] nix-daemon[868]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker2 # [ 34.989630] nix-daemon[868]: reaped child process 904, status = succeeded lb # [ 35.003915] niks3-server[969]: 2026/09/22 11:25:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 35.006289] nix-grpc-daemon[883]: time=2026-09-22T11:25:11.183Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 35.008773] nix-grpc-daemon[883]: time=2026-09-22T11:25:11.184Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 35.059074] niks3-server[969]: 2026/09/22 11:25:10 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 35.065830] niks3-server[969]: 2026/09/22 11:25:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 35.078414] niks3-server[969]: 2026/09/22 11:25:10 INFO Signed narinfos id=1 count=1 worker2 # [ 35.070142] nix-grpc-daemon[883]: time=2026-09-22T11:25:11.246Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.084032] niks3-server[969]: 2026/09/22 11:25:10 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 35.089558] niks3-server[969]: 2026/09/22 11:25:10 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 35.100550] niks3-server[969]: 2026/09/22 11:25:10 INFO Completed upload id=1 worker2 # [ 35.088732] nix-grpc-daemon[883]: time=2026-09-22T11:25:11.265Z level=INFO msg="Upload complete. (311ms)" worker2 # [ 35.093892] nix-grpc-daemon[782]: ts=2026-09-22T11:25:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 35.102377] nix-grpc-daemon[782]: ts=2026-09-22T11:25:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 35.111474] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 35.124890] nix-daemon[868]: reaped child process 881, status = succeeded worker2 # [ 35.127929] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 36.146186] nix-daemon[868]: reaped child process 908, status = succeeded worker2 # [ 36.229201] nix-daemon[868]: accepted connection from pid 924, user nix-grpc-daemon (trusted) worker2 # [ 36.246383] nix-daemon[868]: reaped child process 927, status = succeeded lb # [ 36.264791] niks3-server[969]: 2026/09/22 11:25:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 36.265321] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.442Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 36.266802] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.443Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 36.327436] niks3-server[969]: 2026/09/22 11:25:11 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 36.330670] niks3-server[969]: 2026/09/22 11:25:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 36.338582] niks3-server[969]: 2026/09/22 11:25:11 INFO Signed narinfos id=2 count=1 lb # [ 36.339822] niks3-server[969]: 2026/09/22 11:25:11 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst worker2 # [ 36.327679] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.503Z level=INFO msg="Uploading 1 narinfos" lb # [ 36.346190] niks3-server[969]: 2026/09/22 11:25:11 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 36.348206] niks3-server[969]: 2026/09/22 11:25:11 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 36.354411] niks3-server[969]: 2026/09/22 11:25:11 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 36.356778] niks3-server[969]: 2026/09/22 11:25:11 INFO Completed upload id=2 worker2 # [ 36.344856] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.521Z level=INFO msg="Upload complete. (209ms)" worker2 # [ 36.358650] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker2 # [ 36.366275] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 36.369325] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 36.378328] nix-daemon[868]: reaped child process 906, status = succeeded worker2 # [ 36.408889] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 36.421898] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 36.434511] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.611Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 36.442527] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker2 # [ 36.461166] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 36.568092] nix-daemon[868]: accepted connection from pid 933, user nix-grpc-daemon (trusted) worker2 # [ 36.583086] nix-daemon[868]: reaped child process 936, status = succeeded worker2 # [ 36.672656] nix-daemon[868]: accepted connection from pid 938, user nix-grpc-daemon (trusted) worker2 # [ 36.686803] nix-daemon[868]: reaped child process 941, status = succeeded lb # [ 36.706400] niks3-server[969]: 2026/09/22 11:25:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 36.702316] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.879Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 36.703906] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.880Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 36.734519] niks3-server[969]: 2026/09/22 11:25:12 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 36.746581] niks3-server[969]: 2026/09/22 11:25:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 36.750969] niks3-server[969]: 2026/09/22 11:25:12 INFO Signed narinfos id=3 count=1 worker2 # [ 36.741703] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.918Z level=INFO msg="Uploading 1 narinfos" lb # [ 36.760156] niks3-server[969]: 2026/09/22 11:25:12 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 36.772402] niks3-server[969]: 2026/09/22 11:25:12 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 36.782893] niks3-server[969]: 2026/09/22 11:25:12 INFO Completed upload id=3 worker2 # [ 36.773120] nix-grpc-daemon[883]: time=2026-09-22T11:25:12.949Z level=INFO msg="Upload complete. (298ms)" lb # [ 36.786109] niks3-server[969]: 2026/09/22 11:25:12 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker2 # [ 36.777365] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 36.783716] nix-grpc-daemon[782]: ts=2026-09-22T11:25:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 36.797064] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 36.800165] nix-daemon[868]: reaped child process 931, status = succeeded worker2 # [ 36.805623] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 37.844379] nix-daemon[868]: reaped child process 945, status = succeeded worker2 # [ 37.926663] nix-daemon[868]: accepted connection from pid 962, user nix-grpc-daemon (trusted) worker2 # [ 37.942990] nix-daemon[868]: reaped child process 965, status = succeeded lb # [ 37.960948] niks3-server[969]: 2026/09/22 11:25:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 37.958931] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.135Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 37.961202] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.137Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 37.995811] niks3-server[969]: 2026/09/22 11:25:13 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 38.010916] niks3-server[969]: 2026/09/22 11:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 38.017572] niks3-server[969]: 2026/09/22 11:25:13 INFO Signed narinfos id=4 count=1 worker2 # [ 38.008481] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.185Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.024460] niks3-server[969]: 2026/09/22 11:25:13 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 38.032902] niks3-server[969]: 2026/09/22 11:25:13 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 38.041155] niks3-server[969]: 2026/09/22 11:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 38.045141] niks3-server[969]: 2026/09/22 11:25:13 INFO Completed upload id=4 worker2 # [ 38.034558] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.211Z level=INFO msg="Upload complete. (219ms)" lb # [ 38.048666] niks3-server[969]: 2026/09/22 11:25:13 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker2 # [ 38.042635] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 38.053523] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 38.058230] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 38.068047] nix-daemon[868]: reaped child process 943, status = succeeded worker2 # [ 38.098255] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 38.113236] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 38.127268] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.304Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker2 # [ 38.134605] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 38.147333] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 38.247060] nix-daemon[868]: accepted connection from pid 971, user nix-grpc-daemon (trusted) worker2 # [ 38.260477] nix-daemon[868]: reaped child process 974, status = succeeded worker2 # [ 38.346375] nix-daemon[868]: accepted connection from pid 976, user nix-grpc-daemon (trusted) worker2 # [ 38.360169] nix-daemon[868]: reaped child process 979, status = succeeded lb # [ 38.380431] niks3-server[969]: 2026/09/22 11:25:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 38.376627] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.553Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 38.378126] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.553Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 38.406733] niks3-server[969]: 2026/09/22 11:25:13 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 38.416662] niks3-server[969]: 2026/09/22 11:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 38.422664] niks3-server[969]: 2026/09/22 11:25:13 INFO Signed narinfos id=5 count=1 worker2 # [ 38.413590] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.590Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.435412] niks3-server[969]: 2026/09/22 11:25:13 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 38.442976] niks3-server[969]: 2026/09/22 11:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 38.450050] niks3-server[969]: 2026/09/22 11:25:13 INFO Completed upload id=5 worker2 # [ 38.437587] nix-grpc-daemon[883]: time=2026-09-22T11:25:14.614Z level=INFO msg="Upload complete. (277ms)" lb # [ 38.452518] niks3-server[969]: 2026/09/22 11:25:13 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker2 # [ 38.440877] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 38.446289] nix-grpc-daemon[782]: ts=2026-09-22T11:25:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 38.455686] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 38.462129] nix-daemon[868]: reaped child process 969, status = succeeded worker2 # [ 38.465448] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 39.110165] nix-daemon[868]: reaped child process 983, status = succeeded worker2 # [ 39.189760] nix-daemon[868]: accepted connection from pid 999, user nix-grpc-daemon (trusted) worker2 # [ 39.203709] nix-daemon[868]: reaped child process 1002, status = succeeded lb # [ 39.222404] niks3-server[969]: 2026/09/22 11:25:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.219113] nix-grpc-daemon[883]: time=2026-09-22T11:25:15.395Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 39.220629] nix-grpc-daemon[883]: time=2026-09-22T11:25:15.397Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 39.259859] niks3-server[969]: 2026/09/22 11:25:14 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 39.276994] niks3-server[969]: 2026/09/22 11:25:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 39.279883] niks3-server[969]: 2026/09/22 11:25:14 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 39.283857] niks3-server[969]: 2026/09/22 11:25:14 INFO Signed narinfos id=6 count=1 worker2 # [ 39.274323] nix-grpc-daemon[883]: time=2026-09-22T11:25:15.450Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.289937] niks3-server[969]: 2026/09/22 11:25:14 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 39.297885] niks3-server[969]: 2026/09/22 11:25:14 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 39.301688] niks3-server[969]: 2026/09/22 11:25:14 INFO Completed upload id=6 worker2 # [ 39.290867] nix-grpc-daemon[883]: time=2026-09-22T11:25:15.467Z level=INFO msg="Upload complete. (218ms)" lb # [ 39.304465] niks3-server[969]: 2026/09/22 11:25:14 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker2 # [ 39.299304] nix-grpc-daemon[782]: ts=2026-09-22T11:25:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker2 # [ 39.313113] nix-daemon[868]: reaped child process 981, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 4.98 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 5.32 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.13 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 40.105463] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52932 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 40.120876] nix-grpc-daemon[781]: ts=2026-09-22T11:25:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 40.141402] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.20 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.77 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 40.654388] nix-grpc-daemon[781]: ts=2026-09-22T11:25:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46232 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 40.662031] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 40.667688] nix-grpc-daemon[883]: time=2026-09-22T11:25:16.844Z level=INFO msg="All 2 paths already cached" worker2 # [ 40.678269] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 40.683284] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 40.688960] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 40.702695] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 40.713877] nix-grpc-daemon[883]: time=2026-09-22T11:25:16.890Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 40.720707] nix-grpc-daemon[782]: ts=2026-09-22T11:25:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker2 # [ 40.735655] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 40.829547] nix-daemon[868]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker2 # [ 40.847607] nix-daemon[868]: reaped child process 1035, status = succeeded worker2 # [ 40.937600] nix-daemon[868]: accepted connection from pid 1037, user nix-grpc-daemon (trusted) worker2 # [ 40.951154] nix-daemon[868]: reaped child process 1040, status = succeeded lb # [ 40.972379] niks3-server[969]: 2026/09/22 11:25:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 40.967948] nix-grpc-daemon[883]: time=2026-09-22T11:25:17.144Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 40.969463] nix-grpc-daemon[883]: time=2026-09-22T11:25:17.146Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 41.000967] niks3-server[969]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 41.017297] niks3-server[969]: 2026/09/22 11:25:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 41.025151] niks3-server[969]: 2026/09/22 11:25:16 INFO Signed narinfos id=7 count=1 worker2 # [ 41.016531] nix-grpc-daemon[883]: time=2026-09-22T11:25:17.193Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.032106] niks3-server[969]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 41.044863] niks3-server[969]: 2026/09/22 11:25:16 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 41.052613] niks3-server[969]: 2026/09/22 11:25:16 INFO Completed upload id=7 worker2 # [ 41.040521] nix-grpc-daemon[883]: time=2026-09-22T11:25:17.217Z level=INFO msg="Upload complete. (295ms)" worker2 # [ 41.042532] nix-grpc-daemon[782]: ts=2026-09-22T11:25:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 41.055688] niks3-server[969]: 2026/09/22 11:25:16 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker2 # [ 41.045710] nix-grpc-daemon[782]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 41.056099] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 41.061875] nix-daemon[868]: reaped child process 1030, status = succeeded worker2 # [ 41.067494] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 42.085670] nix-daemon[868]: reaped child process 1044, status = succeeded worker2 # [ 42.159636] nix-daemon[868]: accepted connection from pid 1060, user nix-grpc-daemon (trusted) worker2 # [ 42.174916] nix-daemon[868]: reaped child process 1063, status = succeeded lb # [ 42.192444] niks3-server[969]: 2026/09/22 11:25:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.188044] nix-grpc-daemon[883]: time=2026-09-22T11:25:18.364Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 42.189570] nix-grpc-daemon[883]: time=2026-09-22T11:25:18.366Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 42.234623] niks3-server[969]: 2026/09/22 11:25:17 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 42.241277] niks3-server[969]: 2026/09/22 11:25:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker2 # [ 42.237792] nix-grpc-daemon[883]: time=2026-09-22T11:25:18.414Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.251242] niks3-server[969]: 2026/09/22 11:25:17 INFO Signed narinfos id=8 count=1 lb # [ 42.259823] niks3-server[969]: 2026/09/22 11:25:17 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 42.274930] niks3-server[969]: 2026/09/22 11:25:17 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 42.277888] niks3-server[969]: 2026/09/22 11:25:17 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 42.280504] niks3-server[969]: 2026/09/22 11:25:17 INFO Completed upload id=8 worker2 # [ 42.268319] nix-grpc-daemon[883]: time=2026-09-22T11:25:18.445Z level=INFO msg="Upload complete. (190ms)" worker2 # [ 42.271722] nix-grpc-daemon[782]: ts=2026-09-22T11:25:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker2 # [ 42.279048] nix-daemon[868]: reaped child process 1042, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.79 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.12 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.07 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 42.550563] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: be51f7325ab14e17bdd9bd533f514cd3 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.05 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 42.681347] nix[887]: don't know how to build these paths: client # [ 42.682227] nix[887]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 42.675819] nix-grpc-daemon[781]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 42.679829] nix-grpc-daemon[782]: ts=2026-09-22T11:25:18Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 42.681915] nix-grpc-daemon[782]: ts=2026-09-22T11:25:18Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 42.687626] nix-grpc-daemon[781]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 42.699105] nix-grpc-daemon[781]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 client # [ 42.713075] nix[887]: copying 1 paths to 'lb:50051'... client # [ 42.713867] nix[887]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 42.709307] nix-grpc-daemon[781]: ts=2026-09-22T11:25:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 42.720261] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 42.740196] nix-grpc-daemon[781]: ts=2026-09-22T11:25:17Z level=info event=niks3_push_started pid=875 worker1 # [ 42.867465] nix-grpc-daemon[875]: time=2026-09-22T11:25:18.077Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 42.956087] nix-daemon[847]: accepted connection from pid 888, user nix-grpc-daemon (trusted) worker1 # [ 42.970764] nix-daemon[847]: reaped child process 891, status = succeeded worker1 # [ 43.044753] nix-daemon[847]: accepted connection from pid 893, user nix-grpc-daemon (trusted) worker1 # [ 43.060290] nix-daemon[847]: reaped child process 896, status = succeeded lb # [ 43.069842] niks3-server[969]: 2026/09/22 11:25:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.070647] nix-grpc-daemon[875]: time=2026-09-22T11:25:18.280Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 43.072700] nix-grpc-daemon[875]: time=2026-09-22T11:25:18.280Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 43.104633] niks3-server[969]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 43.111488] niks3-server[969]: 2026/09/22 11:25:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 43.118957] niks3-server[969]: 2026/09/22 11:25:18 INFO Signed narinfos id=9 count=1 worker1 # [ 43.111975] nix-grpc-daemon[875]: time=2026-09-22T11:25:18.322Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.128294] niks3-server[969]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 43.138393] niks3-server[969]: 2026/09/22 11:25:18 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 43.148873] niks3-server[969]: 2026/09/22 11:25:18 INFO Completed upload id=9 worker1 # [ 43.138704] nix-grpc-daemon[875]: time=2026-09-22T11:25:18.349Z level=INFO msg="Upload complete. (267ms)" lb # [ 43.150401] niks3-server[969]: 2026/09/22 11:25:18 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 43.140989] nix-grpc-daemon[781]: ts=2026-09-22T11:25:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 43.145721] nix-grpc-daemon[781]: ts=2026-09-22T11:25:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 43.156064] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 43.160794] nix-daemon[847]: reaped child process 873, status = succeeded client # [ 43.169153] nix[887]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker1 # [ 43.164851] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # [ 43.596880] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 251b88ce768143bd9a05518b9cfe4d78 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.04 seconds) client # [ 43.727339] nix[903]: don't know how to build these paths: worker2 # [ 43.718521] nix-grpc-daemon[782]: ts=2026-09-22T11:25:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52932 client # [ 43.728173] nix[903]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 43.729983] nix-grpc-daemon[782]: ts=2026-09-22T11:25:19Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 43.735836] nix-grpc-daemon[781]: ts=2026-09-22T11:25:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 client # [ 43.745505] nix[903]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... lb # [ 44.688581] envoy[896]: conn peer=[2001:db8:1::1]:45616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9464 tx=4044 ms=4846 lb # [ 44.692567] envoy[896]: conn peer=[2001:db8:1::1]:45618 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=47 lb # [ 44.696140] envoy[896]: conn peer=[2001:db8:1::1]:45634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4152 tx=1788 ms=1634 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.03 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 46.995595] nix-daemon[847]: reaped child process 900, status = succeeded worker1 # [ 47.073851] nix-daemon[847]: accepted connection from pid 930, user nix-grpc-daemon (trusted) worker1 # [ 47.088160] nix-daemon[847]: reaped child process 933, status = succeeded lb # [ 47.102912] niks3-server[969]: 2026/09/22 11:25:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 47.101055] nix-grpc-daemon[875]: time=2026-09-22T11:25:22.311Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 47.104058] nix-grpc-daemon[875]: time=2026-09-22T11:25:22.312Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 47.149300] niks3-server[969]: 2026/09/22 11:25:22 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 47.155438] niks3-server[969]: 2026/09/22 11:25:22 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 47.166956] niks3-server[969]: 2026/09/22 11:25:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 47.171064] niks3-server[969]: 2026/09/22 11:25:22 INFO Signed narinfos id=10 count=1 worker1 # [ 47.162160] nix-grpc-daemon[875]: time=2026-09-22T11:25:22.371Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.180727] niks3-server[969]: 2026/09/22 11:25:22 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 47.185168] niks3-server[969]: 2026/09/22 11:25:22 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 47.189793] niks3-server[969]: 2026/09/22 11:25:22 INFO Completed upload id=10 lb # [ 47.191129] niks3-server[969]: 2026/09/22 11:25:22 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker1 # [ 47.179771] nix-grpc-daemon[875]: time=2026-09-22T11:25:22.390Z level=INFO msg="Upload complete. (202ms)" worker1 # [ 47.186536] nix-grpc-daemon[781]: ts=2026-09-22T11:25:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 47.193493] nix-grpc-daemon[781]: ts=2026-09-22T11:25:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 47.206159] nix-daemon[847]: reaped child process 898, status = succeeded client # [ 47.245488] systemd[1]: dedup1.service: Deactivated successfully. client # [ 47.248258] systemd[1]: dedup1.service: Consumed 110ms CPU time over 4.694s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.5K outgoing IP traffic. client # [ 47.253648] systemd[1]: dedup2.service: Deactivated successfully. client # [ 47.256628] systemd[1]: dedup2.service: Consumed 135ms CPU time over 3.659s wall clock time, 39.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.70 seconds) subtest: --timeout and --max-silent-time reach the builder worker1 # [ 48.349963] nix-grpc-daemon[781]: ts=2026-09-22T11:25:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 48.357935] nix-grpc-daemon[782]: ts=2026-09-22T11:25:24Z level=debug event=want client=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 48.363827] nix-grpc-daemon[782]: ts=2026-09-22T11:25:24Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.370904] nix-grpc-daemon[782]: ts=2026-09-22T11:25:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 48.378665] nix-grpc-daemon[782]: ts=2026-09-22T11:25:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 48.389425] nix-grpc-daemon[782]: ts=2026-09-22T11:25:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 48.400843] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 48.506084] nix-daemon[868]: accepted connection from pid 1099, user nix-grpc-daemon (trusted) worker2 # [ 48.521921] nix-daemon[868]: reaped child process 1102, status = succeeded worker2 # [ 48.611602] nix-daemon[868]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker2 # [ 48.625652] nix-daemon[868]: reaped child process 1107, status = succeeded lb # [ 48.645818] niks3-server[969]: 2026/09/22 11:25:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.639744] nix-grpc-daemon[883]: time=2026-09-22T11:25:24.816Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 48.641309] nix-grpc-daemon[883]: time=2026-09-22T11:25:24.818Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 48.676175] niks3-server[969]: 2026/09/22 11:25:24 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 48.683893] niks3-server[969]: 2026/09/22 11:25:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker2 # [ 48.678695] nix-grpc-daemon[883]: time=2026-09-22T11:25:24.855Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.690654] niks3-server[969]: 2026/09/22 11:25:24 INFO Signed narinfos id=11 count=1 lb # [ 48.701109] niks3-server[969]: 2026/09/22 11:25:24 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 48.709763] niks3-server[969]: 2026/09/22 11:25:24 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker2 # [ 48.705098] nix-grpc-daemon[883]: time=2026-09-22T11:25:24.882Z level=INFO msg="Upload complete. (293ms)" lb # [ 48.717445] niks3-server[969]: 2026/09/22 11:25:24 INFO Completed upload id=11 lb # [ 48.720854] niks3-server[969]: 2026/09/22 11:25:24 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 48.708383] nix-grpc-daemon[782]: ts=2026-09-22T11:25:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 48.713478] nix-grpc-daemon[782]: ts=2026-09-22T11:25:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 48.722474] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 48.731072] nix-daemon[868]: reaped child process 1097, status = succeeded worker2 # [ 48.736777] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) lb # [ 54.689613] envoy[896]: conn peer=[2001:db8:1::1]:45644 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3011 tx=1448 ms=4526 lb # [ 54.693373] envoy[896]: conn peer=[2001:db8:1::1]:34332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=3504 worker2 # [ 54.949485] nix-grpc-daemon[782]: ts=2026-09-22T11:25:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=6 outputs=0 worker2 # [ 54.963237] nix-daemon[868]: reaped child process 1109, status = succeeded worker2 # [ 54.964540] nix-daemon[868]: reaped child process 1111, status = succeeded worker2 # [ 55.109229] nix-grpc-daemon[782]: ts=2026-09-22T11:25:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 55.118673] nix-grpc-daemon[782]: ts=2026-09-22T11:25:31Z level=debug event=want client=7 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker1 # [ 55.123880] nix-grpc-daemon[781]: ts=2026-09-22T11:25:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 55.122929] nix-grpc-daemon[782]: ts=2026-09-22T11:25:31Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 55.134217] nix-grpc-daemon[781]: ts=2026-09-22T11:25:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 55.142784] nix-grpc-daemon[781]: ts=2026-09-22T11:25:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 55.153733] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 55.254457] nix-daemon[847]: accepted connection from pid 946, user nix-grpc-daemon (trusted) worker1 # [ 55.268137] nix-daemon[847]: reaped child process 949, status = succeeded worker1 # [ 55.353655] nix-daemon[847]: accepted connection from pid 951, user nix-grpc-daemon (trusted) worker1 # [ 55.365810] nix-daemon[847]: reaped child process 954, status = succeeded lb # [ 55.381140] niks3-server[969]: 2026/09/22 11:25:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.376614] nix-grpc-daemon[875]: time=2026-09-22T11:25:30.586Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 55.378590] nix-grpc-daemon[875]: time=2026-09-22T11:25:30.588Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 55.397059] niks3-server[969]: 2026/09/22 11:25:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 55.399260] niks3-server[969]: 2026/09/22 11:25:30 INFO Signed narinfos id=12 count=1 worker1 # [ 55.390886] nix-grpc-daemon[875]: time=2026-09-22T11:25:30.601Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.406219] niks3-server[969]: 2026/09/22 11:25:30 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 55.418143] niks3-server[969]: 2026/09/22 11:25:30 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 55.426728] niks3-server[969]: 2026/09/22 11:25:30 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 55.432057] niks3-server[969]: 2026/09/22 11:25:30 INFO Completed upload id=12 worker1 # [ 55.421833] nix-grpc-daemon[875]: time=2026-09-22T11:25:30.632Z level=INFO msg="Upload complete. (256ms)" worker1 # [ 55.423858] nix-grpc-daemon[781]: ts=2026-09-22T11:25:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 55.435307] niks3-server[969]: 2026/09/22 11:25:30 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 55.427490] nix-grpc-daemon[781]: ts=2026-09-22T11:25:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 55.434134] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 55.436380] nix-daemon[847]: reaped child process 944, status = succeeded worker1 # [ 55.441372] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 61.255191] nix-grpc-daemon[781]: ts=2026-09-22T11:25:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=7 outputs=0 worker1 # [ 61.279887] nix-daemon[847]: reaped child process 956, status = succeeded worker1 # [ 61.282258] nix-daemon[847]: reaped child process 958, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.16 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 61.423916] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 127f24b33dd148dd9bdab7ae4d7bd6ca client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 61.565546] nix[976]: don't know how to build these paths: client # [ 61.567094] nix[976]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 61.559895] nix-grpc-daemon[781]: ts=2026-09-22T11:25:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 61.569920] nix-grpc-daemon[782]: ts=2026-09-22T11:25:37Z level=debug event=want client=8 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 61.575821] nix-grpc-daemon[782]: ts=2026-09-22T11:25:37Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 61.580293] nix-grpc-daemon[782]: ts=2026-09-22T11:25:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 61.592078] nix-grpc-daemon[782]: ts=2026-09-22T11:25:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 client # [ 61.608612] nix[976]: copying 1 paths to 'lb:50051'... client # [ 61.609552] nix[976]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 61.603297] nix-grpc-daemon[782]: ts=2026-09-22T11:25:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 61.611949] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 61.717274] nix-daemon[868]: accepted connection from pid 1138, user nix-grpc-daemon (trusted) worker2 # [ 61.731783] nix-daemon[868]: reaped child process 1141, status = succeeded worker2 # [ 61.817081] nix-daemon[868]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker2 # [ 61.831247] nix-daemon[868]: reaped child process 1146, status = succeeded lb # [ 61.850559] niks3-server[969]: 2026/09/22 11:25:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.842863] nix-grpc-daemon[883]: time=2026-09-22T11:25:38.019Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 61.844446] nix-grpc-daemon[883]: time=2026-09-22T11:25:38.021Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 61.868902] niks3-server[969]: 2026/09/22 11:25:37 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 61.870569] niks3-server[969]: 2026/09/22 11:25:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 61.873232] niks3-server[969]: 2026/09/22 11:25:37 INFO Signed narinfos id=13 count=1 worker2 # [ 61.860918] nix-grpc-daemon[883]: time=2026-09-22T11:25:38.037Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.877043] niks3-server[969]: 2026/09/22 11:25:37 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 61.881171] niks3-server[969]: 2026/09/22 11:25:37 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 61.886356] niks3-server[969]: 2026/09/22 11:25:37 INFO Completed upload id=13 worker2 # [ 61.874114] nix-grpc-daemon[883]: time=2026-09-22T11:25:38.051Z level=INFO msg="Upload complete. (248ms)" lb # [ 61.887593] niks3-server[969]: 2026/09/22 11:25:37 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 61.876368] nix-grpc-daemon[782]: ts=2026-09-22T11:25:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 61.879076] nix-grpc-daemon[782]: ts=2026-09-22T11:25:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 61.887279] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 61.891100] nix-daemon[868]: reaped child process 1136, status = succeeded client # [ 61.900571] nix[976]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker2 # [ 61.894754] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # [ 62.490866] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: dc3c66b8480f4de584ce778f7ab4f4ed client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) worker1 # [ 62.625766] nix-grpc-daemon[781]: ts=2026-09-22T11:25:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46232 client # [ 62.636623] nix[992]: don't know how to build these paths: client # [ 62.637643] nix[992]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 62.635739] nix-grpc-daemon[782]: ts=2026-09-22T11:25:38Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 62.638538] nix-grpc-daemon[782]: ts=2026-09-22T11:25:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 client # [ 62.645720] nix[992]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 lb # [ 64.689667] envoy[896]: conn peer=[2001:db8:1::1]:34342 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2983 tx=977 ms=6619 lb # [ 64.693533] envoy[896]: conn peer=[2001:db8:1::1]:58894 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=933 ms=6158 client # [ 65.707679] systemd[1]: share1.service: Sent signal SIGINT to main process 976 (nix) on client request. client # [ 65.715814] nix[976]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.05 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 65.724148] nix[976]: error: interrupted by the user client # [ 65.762473] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 65.764067] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 65.765954] systemd[1]: share1.service: Consumed 110ms CPU time over 4.341s wall clock time, 41.4M memory peak, 6K incoming IP traffic, 8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 67.138539] nix-daemon[868]: reaped child process 1150, status = succeeded worker2 # [ 67.219939] nix-daemon[868]: accepted connection from pid 1186, user nix-grpc-daemon (trusted) worker2 # [ 67.233195] nix-daemon[868]: reaped child process 1189, status = succeeded lb # [ 67.252222] niks3-server[969]: 2026/09/22 11:25:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 67.249292] nix-grpc-daemon[883]: time=2026-09-22T11:25:43.426Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 67.253052] nix-grpc-daemon[883]: time=2026-09-22T11:25:43.427Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 67.292954] niks3-server[969]: 2026/09/22 11:25:42 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 67.301613] niks3-server[969]: 2026/09/22 11:25:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 67.307510] niks3-server[969]: 2026/09/22 11:25:42 INFO Signed narinfos id=14 count=1 worker2 # [ 67.298380] nix-grpc-daemon[883]: time=2026-09-22T11:25:43.475Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.314816] niks3-server[969]: 2026/09/22 11:25:42 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 67.316808] niks3-server[969]: 2026/09/22 11:25:42 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 67.323060] niks3-server[969]: 2026/09/22 11:25:42 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 67.327212] niks3-server[969]: 2026/09/22 11:25:42 INFO Completed upload id=14 lb # [ 67.329169] niks3-server[969]: 2026/09/22 11:25:42 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 67.315062] nix-grpc-daemon[883]: time=2026-09-22T11:25:43.492Z level=INFO msg="Upload complete. (208ms)" worker2 # [ 67.322320] nix-grpc-daemon[782]: ts=2026-09-22T11:25:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=8 outputs=1 worker2 # [ 67.326782] nix-grpc-daemon[782]: ts=2026-09-22T11:25:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=8 outputs=1 worker2 # [ 67.338071] nix-daemon[868]: reaped child process 1148, status = succeeded client # [ 67.398910] systemd[1]: share2.service: Deactivated successfully. client # [ 67.402565] systemd[1]: share2.service: Consumed 115ms CPU time over 4.911s wall clock time, 35.5M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.71 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 68.173858] systemd[1]: Started Nix Daemon. client # [ 68.251257] nix-daemon[1044]: accepted connection from pid 1041, user root (trusted) worker2 # [ 68.346913] nix-grpc-daemon[782]: ts=2026-09-22T11:25:44Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:52932 worker1 # [ 68.353489] nix-grpc-daemon[781]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 68.358724] nix-grpc-daemon[782]: ts=2026-09-22T11:25:44Z level=debug event=want client=10 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 68.360886] nix-grpc-daemon[782]: ts=2026-09-22T11:25:44Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 68.367735] nix-grpc-daemon[781]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 68.379892] nix-grpc-daemon[781]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 68.391116] nix-grpc-daemon[781]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 68.401652] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 68.502648] nix-daemon[847]: accepted connection from pid 997, user nix-grpc-daemon (trusted) worker1 # [ 68.515416] nix-daemon[847]: reaped child process 1000, status = succeeded worker1 # [ 68.599922] nix-daemon[847]: accepted connection from pid 1002, user nix-grpc-daemon (trusted) worker1 # [ 68.613185] nix-daemon[847]: reaped child process 1005, status = succeeded lb # [ 68.632589] niks3-server[969]: 2026/09/22 11:25:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.629112] nix-grpc-daemon[875]: time=2026-09-22T11:25:43.839Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 68.631069] nix-grpc-daemon[875]: time=2026-09-22T11:25:43.841Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 68.660945] niks3-server[969]: 2026/09/22 11:25:44 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 68.675292] niks3-server[969]: 2026/09/22 11:25:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 68.681775] niks3-server[969]: 2026/09/22 11:25:44 INFO Signed narinfos id=15 count=1 worker1 # [ 68.675868] nix-grpc-daemon[875]: time=2026-09-22T11:25:43.886Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.696577] niks3-server[969]: 2026/09/22 11:25:44 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 68.702091] niks3-server[969]: 2026/09/22 11:25:44 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 68.708202] niks3-server[969]: 2026/09/22 11:25:44 INFO Completed upload id=15 worker1 # [ 68.697990] nix-grpc-daemon[875]: time=2026-09-22T11:25:43.908Z level=INFO msg="Upload complete. (285ms)" lb # [ 68.711089] niks3-server[969]: 2026/09/22 11:25:44 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 68.702122] nix-grpc-daemon[781]: ts=2026-09-22T11:25:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 68.707271] nix-grpc-daemon[781]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 68.716152] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 68.725124] nix-daemon[847]: reaped child process 995, status = succeeded worker1 # [ 68.729264] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 69.577427] nix-daemon[847]: reaped child process 1009, status = succeeded worker1 # [ 69.637091] nix-daemon[847]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker1 # [ 69.649052] nix-daemon[847]: reaped child process 1028, status = succeeded lb # [ 69.664978] niks3-server[969]: 2026/09/22 11:25:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.658751] nix-grpc-daemon[875]: time=2026-09-22T11:25:44.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 69.660350] nix-grpc-daemon[875]: time=2026-09-22T11:25:44.870Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 69.682583] niks3-server[969]: 2026/09/22 11:25:45 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 69.686280] niks3-server[969]: 2026/09/22 11:25:45 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 69.689715] niks3-server[969]: 2026/09/22 11:25:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 69.691429] niks3-server[969]: 2026/09/22 11:25:45 INFO Signed narinfos id=16 count=1 worker1 # [ 69.681378] nix-grpc-daemon[875]: time=2026-09-22T11:25:44.891Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.697907] niks3-server[969]: 2026/09/22 11:25:45 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 69.699298] niks3-server[969]: 2026/09/22 11:25:45 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 69.702481] niks3-server[969]: 2026/09/22 11:25:45 INFO Completed upload id=16 worker1 # [ 69.692250] nix-grpc-daemon[875]: time=2026-09-22T11:25:44.902Z level=INFO msg="Upload complete. (156ms)" lb # [ 69.704928] niks3-server[969]: 2026/09/22 11:25:45 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 69.694561] nix-grpc-daemon[781]: ts=2026-09-22T11:25:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=9 outputs=1 worker1 # [ 69.701051] nix-daemon[847]: reaped child process 1007, status = succeeded worker1 # [ 69.740415] nix-grpc-daemon[781]: ts=2026-09-22T11:25:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 69.752104] nix-grpc-daemon[781]: ts=2026-09-22T11:25:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 69.756439] nix-grpc-daemon[781]: ts=2026-09-22T11:25:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 69.956604] nix-grpc-daemon[781]: ts=2026-09-22T11:25:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 69.959221] nix-grpc-daemon[782]: ts=2026-09-22T11:25:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 69.976263] nix-grpc-daemon[782]: ts=2026-09-22T11:25:46Z level=debug event=want client=11 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 69.981149] nix-grpc-daemon[782]: ts=2026-09-22T11:25:46Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 69.984706] nix-grpc-daemon[781]: ts=2026-09-22T11:25:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 69.994549] nix-grpc-daemon[781]: ts=2026-09-22T11:25:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 70.004405] nix-grpc-daemon[875]: time=2026-09-22T11:25:45.214Z level=INFO msg="All 1 paths already cached" worker1 # [ 70.010202] nix-grpc-daemon[781]: ts=2026-09-22T11:25:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 70.020163] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 70.117258] nix-daemon[847]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 70.130541] nix-daemon[847]: reaped child process 1035, status = succeeded worker1 # [ 70.208911] nix-daemon[847]: accepted connection from pid 1037, user nix-grpc-daemon (trusted) worker1 # [ 70.222531] nix-daemon[847]: reaped child process 1040, status = succeeded lb # [ 70.237395] niks3-server[969]: 2026/09/22 11:25:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.230948] nix-grpc-daemon[875]: time=2026-09-22T11:25:45.441Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 70.232797] nix-grpc-daemon[875]: time=2026-09-22T11:25:45.442Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 70.251809] niks3-server[969]: 2026/09/22 11:25:45 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 70.254487] niks3-server[969]: 2026/09/22 11:25:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 70.256590] niks3-server[969]: 2026/09/22 11:25:45 INFO Signed narinfos id=17 count=1 worker1 # [ 70.246637] nix-grpc-daemon[875]: time=2026-09-22T11:25:45.456Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.261481] niks3-server[969]: 2026/09/22 11:25:45 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 70.264576] niks3-server[969]: 2026/09/22 11:25:45 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 70.269322] niks3-server[969]: 2026/09/22 11:25:45 INFO Completed upload id=17 worker1 # [ 70.258792] nix-grpc-daemon[875]: time=2026-09-22T11:25:45.469Z level=INFO msg="Upload complete. (226ms)" worker1 # [ 70.260781] nix-grpc-daemon[781]: ts=2026-09-22T11:25:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 70.271670] niks3-server[969]: 2026/09/22 11:25:45 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 70.263773] nix-grpc-daemon[781]: ts=2026-09-22T11:25:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 70.270628] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 70.272861] nix-daemon[847]: reaped child process 1030, status = succeeded worker1 # [ 70.277909] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 71.493242] nix-daemon[847]: reaped child process 1044, status = succeeded worker1 # [ 71.565095] nix-daemon[847]: accepted connection from pid 1060, user nix-grpc-daemon (trusted) worker1 # [ 71.577402] nix-daemon[847]: reaped child process 1063, status = succeeded lb # [ 71.594576] niks3-server[969]: 2026/09/22 11:25:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 71.592731] nix-grpc-daemon[875]: time=2026-09-22T11:25:46.802Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 71.595070] nix-grpc-daemon[875]: time=2026-09-22T11:25:46.804Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 71.630083] niks3-server[969]: 2026/09/22 11:25:47 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 71.643613] niks3-server[969]: 2026/09/22 11:25:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 71.647781] niks3-server[969]: 2026/09/22 11:25:47 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 71.651794] niks3-server[969]: 2026/09/22 11:25:47 INFO Signed narinfos id=18 count=1 worker1 # [ 71.641756] nix-grpc-daemon[875]: time=2026-09-22T11:25:46.851Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.655708] niks3-server[969]: 2026/09/22 11:25:47 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 71.660240] niks3-server[969]: 2026/09/22 11:25:47 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 71.664202] niks3-server[969]: 2026/09/22 11:25:47 INFO Completed upload id=18 worker1 # [ 71.654132] nix-grpc-daemon[875]: time=2026-09-22T11:25:46.864Z level=INFO msg="Upload complete. (168ms)" lb # [ 71.666393] niks3-server[969]: 2026/09/22 11:25:47 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 71.658921] nix-grpc-daemon[781]: ts=2026-09-22T11:25:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=10 outputs=1 worker1 # [ 71.665278] nix-grpc-daemon[781]: ts=2026-09-22T11:25:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 71.673849] nix-daemon[847]: reaped child process 1042, status = succeeded worker2 # [ 71.674928] nix-grpc-daemon[782]: ts=2026-09-22T11:25:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 71.684720] nix-grpc-daemon[782]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 71.696165] nix-grpc-daemon[782]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 71.707978] nix-grpc-daemon[782]: ts=2026-09-22T11:25:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 71.913171] nix-grpc-daemon[782]: ts=2026-09-22T11:25:48Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:52932 worker1 # [ 71.917135] nix-grpc-daemon[781]: ts=2026-09-22T11:25:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 71.925055] nix-grpc-daemon[875]: time=2026-09-22T11:25:47.135Z level=INFO msg="All 2 paths already cached" worker2 # [ 71.936280] nix-grpc-daemon[782]: ts=2026-09-22T11:25:48Z level=debug event=want client=12 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 71.939728] nix-grpc-daemon[781]: ts=2026-09-22T11:25:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 71.940552] nix-grpc-daemon[782]: ts=2026-09-22T11:25:48Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 71.949407] nix-grpc-daemon[781]: ts=2026-09-22T11:25:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 71.958909] nix-grpc-daemon[875]: time=2026-09-22T11:25:47.169Z level=INFO msg="All 2 paths already cached" worker1 # [ 71.964815] nix-grpc-daemon[781]: ts=2026-09-22T11:25:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 71.972824] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 72.070367] nix-daemon[847]: accepted connection from pid 1067, user nix-grpc-daemon (trusted) worker1 # [ 72.084515] nix-daemon[847]: reaped child process 1070, status = succeeded worker1 # [ 72.161261] nix-daemon[847]: accepted connection from pid 1072, user nix-grpc-daemon (trusted) worker1 # [ 72.174884] nix-daemon[847]: reaped child process 1075, status = succeeded lb # [ 72.191792] niks3-server[969]: 2026/09/22 11:25:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 72.189640] nix-grpc-daemon[875]: time=2026-09-22T11:25:47.399Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 72.191082] nix-grpc-daemon[875]: time=2026-09-22T11:25:47.399Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 72.221975] niks3-server[969]: 2026/09/22 11:25:47 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 72.229825] niks3-server[969]: 2026/09/22 11:25:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign worker1 # [ 72.225880] nix-grpc-daemon[875]: time=2026-09-22T11:25:47.436Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.236434] niks3-server[969]: 2026/09/22 11:25:47 INFO Signed narinfos id=19 count=1 lb # [ 72.242937] niks3-server[969]: 2026/09/22 11:25:47 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 72.256321] niks3-server[969]: 2026/09/22 11:25:47 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker1 # [ 72.252667] nix-grpc-daemon[875]: time=2026-09-22T11:25:47.463Z level=INFO msg="Upload complete. (265ms)" lb # [ 72.263106] niks3-server[969]: 2026/09/22 11:25:47 INFO Completed upload id=19 worker1 # [ 72.255579] nix-grpc-daemon[781]: ts=2026-09-22T11:25:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 72.267605] niks3-server[969]: 2026/09/22 11:25:47 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 72.262407] nix-grpc-daemon[781]: ts=2026-09-22T11:25:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 72.272740] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 72.275931] nix-daemon[847]: reaped child process 1065, status = succeeded worker1 # [ 72.281158] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 72.896286] nix-daemon[847]: reaped child process 1079, status = succeeded worker1 # [ 72.974407] nix-daemon[847]: accepted connection from pid 1095, user nix-grpc-daemon (trusted) worker1 # [ 72.985670] nix-daemon[847]: reaped child process 1098, status = succeeded lb # [ 73.005456] niks3-server[969]: 2026/09/22 11:25:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.003732] nix-grpc-daemon[875]: time=2026-09-22T11:25:48.213Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 73.005264] nix-grpc-daemon[875]: time=2026-09-22T11:25:48.215Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 73.047862] niks3-server[969]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 73.055330] niks3-server[969]: 2026/09/22 11:25:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 73.063149] niks3-server[969]: 2026/09/22 11:25:48 INFO Signed narinfos id=20 count=1 worker1 # [ 73.056321] nix-grpc-daemon[875]: time=2026-09-22T11:25:48.266Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.069415] niks3-server[969]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 73.074187] niks3-server[969]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 73.085143] niks3-server[969]: 2026/09/22 11:25:48 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 73.087774] niks3-server[969]: 2026/09/22 11:25:48 INFO Completed upload id=20 worker1 # [ 73.077703] nix-grpc-daemon[875]: time=2026-09-22T11:25:48.288Z level=INFO msg="Upload complete. (190ms)" lb # [ 73.090290] niks3-server[969]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 73.082809] nix-grpc-daemon[781]: ts=2026-09-22T11:25:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=11 outputs=1 worker1 # [ 73.090302] nix-grpc-daemon[781]: ts=2026-09-22T11:25:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 73.100514] nix-daemon[847]: reaped child process 1077, status = succeeded worker2 # [ 73.100759] nix-grpc-daemon[782]: ts=2026-09-22T11:25:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 73.109841] nix-grpc-daemon[782]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 73.121611] nix-grpc-daemon[782]: ts=2026-09-22T11:25:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_out=232 client # [ 73.199222] nix-daemon[1044]: reaped child process 1046, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.12 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.17 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.22 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 73.847732] nix-daemon[1044]: accepted connection from pid 1126, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker1 # [ 73.956493] nix-grpc-daemon[781]: ts=2026-09-22T11:25:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46232 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 73.961700] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying 1 paths... client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 73.972637] nix-grpc-daemon[781]: ts=2026-09-22T11:25:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 73.983414] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 74.088495] nix-daemon[847]: accepted connection from pid 1107, user nix-grpc-daemon (trusted) worker1 # [ 74.102413] nix-daemon[847]: reaped child process 1110, status = succeeded lb # [ 74.119658] niks3-server[969]: 2026/09/22 11:25:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.117200] nix-grpc-daemon[875]: time=2026-09-22T11:25:49.327Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 74.119093] nix-grpc-daemon[875]: time=2026-09-22T11:25:49.329Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 74.143364] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 74.156672] niks3-server[969]: 2026/09/22 11:25:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 74.161650] niks3-server[969]: 2026/09/22 11:25:49 INFO Signed narinfos id=21 count=1 worker1 # [ 74.154441] nix-grpc-daemon[875]: time=2026-09-22T11:25:49.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.172289] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 74.183932] niks3-server[969]: 2026/09/22 11:25:49 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker1 # [ 74.179967] nix-grpc-daemon[875]: time=2026-09-22T11:25:49.390Z level=INFO msg="Upload complete. (186ms)" lb # [ 74.190485] niks3-server[969]: 2026/09/22 11:25:49 INFO Completed upload id=21 lb # [ 74.193148] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker1 # [ 74.183986] nix-grpc-daemon[781]: ts=2026-09-22T11:25:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 74.193447] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=debug event=want client=13 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker1 # [ 74.196701] nix-daemon[847]: reaped child process 1105, status = succeeded worker2 # [ 74.196324] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 74.198183] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 74.203835] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying 2 paths to 'lb:50051'... worker2 # [ 74.212309] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 74.221748] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 74.315321] nix-daemon[868]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker2 # [ 74.332473] nix-daemon[868]: reaped child process 1210, status = succeeded worker2 # [ 74.417608] nix-daemon[868]: accepted connection from pid 1212, user nix-grpc-daemon (trusted) worker2 # [ 74.435457] nix-daemon[868]: reaped child process 1215, status = succeeded lb # [ 74.452257] niks3-server[969]: 2026/09/22 11:25:49 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 74.458969] niks3-server[969]: 2026/09/22 11:25:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.451032] nix-grpc-daemon[883]: time=2026-09-22T11:25:50.627Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 74.453066] nix-grpc-daemon[883]: time=2026-09-22T11:25:50.629Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker2 # [ 74.454650] nix-grpc-daemon[883]: time=2026-09-22T11:25:50.629Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 74.484146] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 74.487162] niks3-server[969]: 2026/09/22 11:25:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 74.489177] niks3-server[969]: 2026/09/22 11:25:49 INFO Signed narinfos id=22 count=1 lb # [ 74.490174] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 74.494072] niks3-server[969]: 2026/09/22 11:25:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 74.496205] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 74.499101] niks3-server[969]: 2026/09/22 11:25:49 INFO Signed narinfos id=23 count=2 worker2 # [ 74.488826] nix-grpc-daemon[883]: time=2026-09-22T11:25:50.665Z level=INFO msg="Uploading 3 narinfos" lb # [ 74.501094] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 74.512943] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 74.517071] niks3-server[969]: 2026/09/22 11:25:49 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 74.520982] niks3-server[969]: 2026/09/22 11:25:49 INFO Completed upload id=22 lb # [ 74.523222] niks3-server[969]: 2026/09/22 11:25:49 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 74.525324] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 74.527676] niks3-server[969]: 2026/09/22 11:25:49 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 74.530322] niks3-server[969]: 2026/09/22 11:25:49 INFO Completed upload id=23 worker2 # [ 74.518178] nix-grpc-daemon[883]: time=2026-09-22T11:25:50.695Z level=INFO msg="Upload complete. (289ms)" worker2 # [ 74.520522] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 74.524177] nix-grpc-daemon[782]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 74.529490] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 74.534380] nix-daemon[868]: reaped child process 1205, status = succeeded worker2 # [ 74.541258] nix-grpc-daemon[782]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 74.548045] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 74.689196] envoy[896]: conn peer=[2001:db8:1::1]:58902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=797 ms=4169 lb # [ 74.690762] envoy[896]: conn peer=[2001:db8:1::1]:58918 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1085 ms=4749 lb # [ 74.692172] envoy[896]: conn peer=[2001:db8:1::1]:56344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=54 lb # [ 74.693521] envoy[896]: conn peer=[2001:db8:1::1]:56328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3379 tx=1718 ms=1459 lb # [ 74.694960] envoy[896]: conn peer=[2001:db8:1::1]:56356 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3820 tx=1895 ms=1802 lb # [ 74.696337] envoy[896]: conn peer=[2001:db8:1::1]:56364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=84 lb # [ 74.697662] envoy[896]: conn peer=[2001:db8:1::1]:56376 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4296 tx=2145 ms=1217 lb # [ 74.699046] envoy[896]: conn peer=[2001:db8:1::1]:50228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=33 client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 75.164780] nix-daemon[868]: reaped child process 1220, status = succeeded worker2 # [ 75.240654] nix-daemon[868]: accepted connection from pid 1236, user nix-grpc-daemon (trusted) worker2 # [ 75.255513] nix-daemon[868]: reaped child process 1239, status = succeeded lb # [ 75.273523] niks3-server[969]: 2026/09/22 11:25:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 75.269172] nix-grpc-daemon[883]: time=2026-09-22T11:25:51.446Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 75.306138] niks3-server[969]: 2026/09/22 11:25:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 75.313504] niks3-server[969]: 2026/09/22 11:25:50 INFO Signed narinfos id=24 count=1 worker2 # [ 75.305280] nix-grpc-daemon[883]: time=2026-09-22T11:25:51.482Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.319363] niks3-server[969]: 2026/09/22 11:25:50 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 75.325324] niks3-server[969]: 2026/09/22 11:25:50 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 75.337115] niks3-server[969]: 2026/09/22 11:25:50 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete worker2 # [ 75.331339] nix-grpc-daemon[883]: time=2026-09-22T11:25:51.508Z level=INFO msg="Upload complete. (177ms)" lb # [ 75.343667] niks3-server[969]: 2026/09/22 11:25:50 INFO Completed upload id=24 lb # [ 75.348839] niks3-server[969]: 2026/09/22 11:25:50 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 75.335469] nix-grpc-daemon[782]: ts=2026-09-22T11:25:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=12 outputs=1 worker2 # [ 75.348127] nix-daemon[868]: reaped child process 1217, status = succeeded client # copying 1 paths... worker2 # [ 75.380995] nix-grpc-daemon[782]: ts=2026-09-22T11:25:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52932 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 75.403133] nix-grpc-daemon[782]: ts=2026-09-22T11:25:51Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 75.407370] nix-grpc-daemon[782]: ts=2026-09-22T11:25:51Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_out=120 client # [ 75.522389] nix-daemon[1044]: reaped child process 1129, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 1.80 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 75.624241] nix-daemon[1044]: accepted connection from pid 1148, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 75.731898] nix-grpc-daemon[781]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46232 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 75.732934] nix-grpc-daemon[782]: ts=2026-09-22T11:25:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 75.742880] nix-grpc-daemon[883]: time=2026-09-22T11:25:51.919Z level=INFO msg="All 1 paths already cached" worker2 # [ 75.756416] nix-grpc-daemon[782]: ts=2026-09-22T11:25:51Z level=debug event=want client=14 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 75.764982] nix-grpc-daemon[781]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker2 # [ 75.761213] nix-grpc-daemon[782]: ts=2026-09-22T11:25:51Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.772671] nix-grpc-daemon[781]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 75.786343] nix-grpc-daemon[781]: ts=2026-09-22T11:25:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 75.790372] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 75.823067] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) worker1 # [ 75.876266] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5) worker1 # [ 75.927804] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 3/5) worker1 # [ 76.011609] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 494 ms (attempt 4/5) worker1 # [ 76.508760] nix-grpc-daemon[781]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 76.512137] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 76.517696] nix-grpc-daemon[781]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 76.619810] nix-daemon[847]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker1 # [ 76.633794] nix-daemon[847]: reaped child process 1122, status = succeeded worker1 # [ 76.718948] nix-daemon[847]: accepted connection from pid 1124, user nix-grpc-daemon (trusted) worker1 # [ 76.734467] nix-daemon[847]: reaped child process 1127, status = succeeded lb # [ 76.752140] niks3-server[969]: 2026/09/22 11:25:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.749986] nix-grpc-daemon[875]: time=2026-09-22T11:25:51.959Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 76.751390] nix-grpc-daemon[875]: time=2026-09-22T11:25:51.959Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 76.781652] niks3-server[969]: 2026/09/22 11:25:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 76.788963] niks3-server[969]: 2026/09/22 11:25:52 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 76.795123] niks3-server[969]: 2026/09/22 11:25:52 INFO Signed narinfos id=25 count=1 worker1 # [ 76.788377] nix-grpc-daemon[875]: time=2026-09-22T11:25:51.998Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.802346] niks3-server[969]: 2026/09/22 11:25:52 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 76.814419] niks3-server[969]: 2026/09/22 11:25:52 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete worker1 # [ 76.812893] nix-grpc-daemon[875]: time=2026-09-22T11:25:52.023Z level=INFO msg="Upload complete. (277ms)" lb # [ 76.823312] niks3-server[969]: 2026/09/22 11:25:52 INFO Completed upload id=25 worker1 # [ 76.815552] nix-grpc-daemon[781]: ts=2026-09-22T11:25:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 76.829419] niks3-server[969]: 2026/09/22 11:25:52 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 76.821342] nix-grpc-daemon[781]: ts=2026-09-22T11:25:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 76.831521] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 76.840929] nix-daemon[847]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 76.842945] nix-daemon[847]: reaped child process 1112, status = succeeded client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 78.262174] nix-daemon[847]: reaped child process 1131, status = succeeded worker1 # [ 78.329482] nix-daemon[847]: accepted connection from pid 1147, user nix-grpc-daemon (trusted) worker1 # [ 78.342839] nix-daemon[847]: reaped child process 1150, status = succeeded lb # [ 78.357427] niks3-server[969]: 2026/09/22 11:25:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.354853] nix-grpc-daemon[875]: time=2026-09-22T11:25:53.565Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 78.388685] niks3-server[969]: 2026/09/22 11:25:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign worker1 # [ 78.385808] nix-grpc-daemon[875]: time=2026-09-22T11:25:53.596Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.396630] niks3-server[969]: 2026/09/22 11:25:53 INFO Signed narinfos id=26 count=1 lb # [ 78.404572] niks3-server[969]: 2026/09/22 11:25:53 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 78.411989] niks3-server[969]: 2026/09/22 11:25:53 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 78.423890] niks3-server[969]: 2026/09/22 11:25:53 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 78.427845] niks3-server[969]: 2026/09/22 11:25:53 INFO Completed upload id=26 worker1 # [ 78.418815] nix-grpc-daemon[875]: time=2026-09-22T11:25:53.629Z level=INFO msg="Upload complete. (169ms)" lb # [ 78.429764] niks3-server[969]: 2026/09/22 11:25:53 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker1 # [ 78.421405] nix-grpc-daemon[781]: ts=2026-09-22T11:25:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=13 outputs=1 worker1 # [ 78.428391] nix-daemon[847]: reaped child process 1129, status = succeeded client # copying 1 paths... worker1 # [ 78.466074] nix-grpc-daemon[781]: ts=2026-09-22T11:25:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46232 client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 78.477828] nix-grpc-daemon[781]: ts=2026-09-22T11:25:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 78.479883] nix-grpc-daemon[781]: ts=2026-09-22T11:25:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_out=120 client # [ 78.577215] nix-daemon[1044]: reaped child process 1151, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.05 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 78.664205] nix-daemon[1044]: accepted connection from pid 1170, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 78.770560] nix-grpc-daemon[781]: ts=2026-09-22T11:25:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:46232 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 78.776409] nix-grpc-daemon[781]: ts=2026-09-22T11:25:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 78.781792] nix-grpc-daemon[875]: time=2026-09-22T11:25:53.990Z level=INFO msg="All 1 paths already cached" worker2 # [ 78.792306] nix-grpc-daemon[782]: ts=2026-09-22T11:25:54Z level=debug event=want client=15 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 78.798996] nix-grpc-daemon[782]: ts=2026-09-22T11:25:54Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 78.804585] nix-grpc-daemon[782]: ts=2026-09-22T11:25:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 78.811500] nix-grpc-daemon[782]: ts=2026-09-22T11:25:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 78.825152] nix-grpc-daemon[883]: time=2026-09-22T11:25:55.001Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 78.831678] nix-grpc-daemon[782]: ts=2026-09-22T11:25:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 78.842265] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 78.945756] nix-daemon[868]: accepted connection from pid 1247, user nix-grpc-daemon (trusted) worker2 # [ 78.961902] nix-daemon[868]: reaped child process 1250, status = succeeded worker2 # [ 79.047806] nix-daemon[868]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 79.061825] nix-daemon[868]: reaped child process 1255, status = succeeded lb # [ 79.081541] niks3-server[969]: 2026/09/22 11:25:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 79.077872] nix-grpc-daemon[883]: time=2026-09-22T11:25:55.254Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 79.079444] nix-grpc-daemon[883]: time=2026-09-22T11:25:55.256Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 79.108855] niks3-server[969]: 2026/09/22 11:25:54 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 79.122622] niks3-server[969]: 2026/09/22 11:25:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 79.126879] niks3-server[969]: 2026/09/22 11:25:54 INFO Signed narinfos id=27 count=1 worker2 # [ 79.117211] nix-grpc-daemon[883]: time=2026-09-22T11:25:55.294Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.132103] niks3-server[969]: 2026/09/22 11:25:54 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 79.142192] niks3-server[969]: 2026/09/22 11:25:54 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 79.146067] niks3-server[969]: 2026/09/22 11:25:54 INFO Completed upload id=27 lb # [ 79.147413] niks3-server[969]: 2026/09/22 11:25:54 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 79.135135] nix-grpc-daemon[883]: time=2026-09-22T11:25:55.312Z level=INFO msg="Upload complete. (281ms)" worker2 # [ 79.138665] nix-grpc-daemon[782]: ts=2026-09-22T11:25:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 paths=1 nar_bytes_in=560 worker2 # [ 79.143406] nix-grpc-daemon[782]: ts=2026-09-22T11:25:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 worker2 # [ 79.151565] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 79.158094] nix-daemon[868]: reaped child process 1245, status = succeeded worker2 # [ 79.161470] nix-daemon[868]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 79.993573] nix-daemon[868]: reaped child process 1259, status = succeeded worker2 # [ 80.070659] nix-daemon[868]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 80.081977] nix-daemon[868]: reaped child process 1278, status = succeeded lb # [ 80.103132] niks3-server[969]: 2026/09/22 11:25:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 80.095772] nix-grpc-daemon[883]: time=2026-09-22T11:25:56.272Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 80.117807] niks3-server[969]: 2026/09/22 11:25:55 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 80.121884] niks3-server[969]: 2026/09/22 11:25:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 80.123962] niks3-server[969]: 2026/09/22 11:25:55 INFO Signed narinfos id=28 count=1 worker2 # [ 80.111729] nix-grpc-daemon[883]: time=2026-09-22T11:25:56.288Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.128988] niks3-server[969]: 2026/09/22 11:25:55 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 80.132625] niks3-server[969]: 2026/09/22 11:25:55 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 80.135262] niks3-server[969]: 2026/09/22 11:25:55 INFO Completed upload id=28 worker2 # [ 80.123124] nix-grpc-daemon[883]: time=2026-09-22T11:25:56.300Z level=INFO msg="Upload complete. (154ms)" lb # [ 80.139452] niks3-server[969]: 2026/09/22 11:25:55 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 80.125553] nix-grpc-daemon[782]: ts=2026-09-22T11:25:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52932 duration_s=0 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=14 outputs=1 client # copying 1 paths... worker2 # [ 80.133035] nix-daemon[868]: reaped child process 1257, status = succeeded worker1 # [ 80.134551] nix-grpc-daemon[781]: ts=2026-09-22T11:25:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 80.143238] nix-grpc-daemon[781]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 80.162952] nix-grpc-daemon[781]: ts=2026-09-22T11:25:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 80.167942] nix-grpc-daemon[781]: ts=2026-09-22T11:25:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46232 duration_s=0 paths=1 nar_bytes_out=120 client # [ 80.280699] nix-daemon[1044]: reaped child process 1173, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.71 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.02 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.22 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds) worker2 # [ 80.969956] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 80.990712] nix-grpc-daemon[782]: ts=2026-09-22T11:25:57Z level=info event=signal_exit lb # [ 81.193449] niks3-server[969]: 2026/09/22 11:25:56 INFO lead: released remote=192.168.1.4:57198 worker1 # [ 82.182292] nix-grpc-daemon[781]: ts=2026-09-22T11:25:57Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 82.182565] nix-grpc-daemon[782]: ts=2026-09-22T11:25:58Z level=info event=scheduler_restarting worker2 # [ 82.183866] nix-grpc-daemon[782]: ts=2026-09-22T11:25:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52924 worker2 # [ 82.185728] nix-grpc-daemon[782]: ts=2026-09-22T11:25:58Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 82.187866] nix-grpc-daemon[782]: ts=2026-09-22T11:25:58Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 82.189220] nix-grpc-daemon[782]: ts=2026-09-22T11:25:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52924 worker2 # [ 82.190773] nix-grpc-daemon[782]: ts=2026-09-22T11:25:58Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 82.206967] nix-daemon[868]: reaped child process 870, status = succeeded worker1 # [ 82.382531] nix-grpc-daemon[781]: ts=2026-09-22T11:25:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.384461] nix-grpc-daemon[781]: ts=2026-09-22T11:25:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.389320] nix-grpc-daemon[782]: ts=2026-09-22T11:25:58Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 82.585234] nix-grpc-daemon[781]: ts=2026-09-22T11:25:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.587245] nix-grpc-daemon[781]: ts=2026-09-22T11:25:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.787944] nix-grpc-daemon[781]: ts=2026-09-22T11:25:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.790158] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.991062] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.995089] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.097532] nix-grpc-daemon[782]: E0000 00:00:1790076359.274190 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 83.102799] nix-grpc-daemon[782]: E0000 00:00:1790076359.274428 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 83.196287] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.198130] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.398813] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.400680] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.601329] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.603257] nix-grpc-daemon[781]: ts=2026-09-22T11:25:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.804474] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.809252] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.009379] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.011297] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.212894] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.214423] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.262926] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 84.264633] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 84.266072] systemd[1]: nix-grpc-daemon.service: Consumed 2.583s CPU time over 1min 9.420s wall clock time, 70.2M memory peak, 99.4K incoming IP traffic, 268.8K outgoing IP traffic. worker2 # [ 84.271355] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 84.273142] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 84.274340] systemd[1]: nix-grpc-daemon.socket: Consumed 321us CPU time over 1min 16.675s wall clock time, 256K memory peak, 97.5K incoming IP traffic, 75.8K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 84.414125] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.419916] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46232 worker1 # [ 84.424558] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.428272] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:46232 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.14 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.01 seconds) worker2 # [ 84.481831] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 84.509577] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 84.619817] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.621787] nix-grpc-daemon[781]: ts=2026-09-22T11:25:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 84.689804] envoy[896]: conn peer=[2001:db8:1::1]:50236 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4196 tx=1782 ms=1504 lb # [ 84.691606] envoy[896]: conn peer=[2001:db8:1::1]:50248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=59 lb # [ 84.693372] envoy[896]: conn peer=[2001:db8:1::1]:50252 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3752 tx=1899 ms=2798 lb # [ 84.694864] envoy[896]: conn peer=[2001:db8:1::1]:50256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=51 lb # [ 84.696247] envoy[896]: conn peer=[2001:db8:1::1]:50272 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=54 lb # [ 84.697892] envoy[896]: conn peer=[2001:db8:1::1]:50258 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=1990 ms=1452 lb # [ 84.699348] envoy[896]: conn peer=[2001:db8:1::4]:42436 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=67892 tx=3508 ms=67357 lb # [ 84.700983] envoy[896]: conn peer=[2001:db8:1::1]:48834 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=22 worker1 # [ 84.822559] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.824607] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.829767] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=signal_exit worker1 # [ 85.025163] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.027199] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 85.189117] niks3-server[969]: 2026/09/22 11:26:00 INFO lead: acquired remote=192.168.1.3:36152 worker1 # [ 85.181440] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_take_over lb # [ 85.194104] niks3-server[969]: 2026/09/22 11:26:00 INFO lead: released remote=192.168.1.3:36152 worker1 # [ 85.228398] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.230046] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.260090] systemd[1]: Starting scheduler-token.service... worker2 # [ 85.293350] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 85.295089] systemd[1]: Finished scheduler-token.service. worker2 # [ 85.296781] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 34ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 85.302169] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 85.393157] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 85.395483] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 85.399202] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 85.404057] nix-grpc-daemon[1302]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 85.406176] nix-grpc-daemon[1302]: E0000 00:00:1790076361.580688 1302 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 85.409779] nix-grpc-daemon[1302]: E0000 00:00:1790076361.586460 1302 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 85.416686] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 85.420993] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 85.437571] niks3-server[969]: 2026/09/22 11:26:00 INFO lead: acquired remote=192.168.1.4:55874 worker2 # [ 85.427252] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=scheduler_take_over worker1 # [ 85.430746] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.432818] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.430166] nix-grpc-daemon[1302]: E0000 00:00:1790076361.606605 1342 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 85.446077] nix-grpc-daemon[1302]: E0000 00:00:1790076361.622937 1342 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 85.452079] nix-grpc-daemon[1302]: E0000 00:00:1790076361.625681 1342 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 85.463234] nix-grpc-daemon[1302]: E0000 00:00:1790076361.640156 1342 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 85.472549] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.633416] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.635534] nix-grpc-daemon[781]: ts=2026-09-22T11:26:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.674083] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.676773] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.836500] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.839112] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.877893] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.879946] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.039832] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.045672] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39910 worker1 # [ 86.047314] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 86.081097] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.084722] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:39910 worker1 # [ 86.086470] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 86.181937] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=scheduler_restarting worker2 # [ 86.181262] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:02Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 86.185549] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39910 worker1 # [ 86.187489] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 86.189832] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 86.191198] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39910 worker1 # [ 86.192839] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 86.205818] nix-daemon[847]: reaped child process 849, status = succeeded worker2 # [ 86.382645] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.386806] nix-grpc-daemon[781]: E0000 00:00:1790076361.596507 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 86.398613] nix-grpc-daemon[781]: ts=2026-09-22T11:26:01Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 86.928039] nix-grpc-daemon[781]: E0000 00:00:1790076362.138210 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker1 # [ 86.930290] nix-grpc-daemon[781]: E0000 00:00:1790076362.138344 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 88.230688] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 88.233296] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 88.234544] systemd[1]: nix-grpc-daemon.service: Consumed 2.040s CPU time over 1min 13.558s wall clock time, 59.8M memory peak, 77K incoming IP traffic, 146K outgoing IP traffic. worker2 # [ 88.238592] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:04Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 88.240968] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 88.240117] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:04Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:39148 worker1 # [ 88.243327] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 88.242032] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:04Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 88.244973] systemd[1]: nix-grpc-daemon.socket: Consumed 327us CPU time over 1min 20.687s wall clock time, 256K memory peak, 85.9K incoming IP traffic, 71.4K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 88.401087] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 88.407288] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 88.415410] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5) worker2 # [ 88.486336] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 2/5) worker2 # [ 88.555557] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 3/5) worker2 # [ 88.669951] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 89 ms (attempt 4/5) worker2 # [ 88.760603] nix-grpc-daemon[1302]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 88.761945] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 88.774107] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 88.781090] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 88.794226] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:04Z level=info event=niks3_push_started pid=1362 worker2 # [ 88.897168] nix-grpc-daemon[1362]: time=2026-09-22T11:26:05.073Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 89.002283] nix-daemon[868]: accepted connection from pid 1375, user nix-grpc-daemon (trusted) worker2 # [ 89.017875] nix-daemon[868]: reaped child process 1378, status = succeeded lb # [ 89.036699] niks3-server[969]: 2026/09/22 11:26:04 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 89.041215] niks3-server[969]: 2026/09/22 11:26:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.032596] nix-grpc-daemon[1362]: time=2026-09-22T11:26:05.209Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 89.034138] nix-grpc-daemon[1362]: time=2026-09-22T11:26:05.211Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 89.036090] nix-grpc-daemon[1362]: time=2026-09-22T11:26:05.213Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 89.071823] niks3-server[969]: 2026/09/22 11:26:04 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 89.087890] niks3-server[969]: 2026/09/22 11:26:04 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 89.090613] niks3-server[969]: 2026/09/22 11:26:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 89.092560] niks3-server[969]: 2026/09/22 11:26:04 INFO Signed narinfos id=29 count=1 lb # [ 89.094782] niks3-server[969]: 2026/09/22 11:26:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 89.097051] niks3-server[969]: 2026/09/22 11:26:04 INFO Signed narinfos id=30 count=2 worker2 # [ 89.085846] nix-grpc-daemon[1362]: time=2026-09-22T11:26:05.261Z level=INFO msg="Uploading 3 narinfos" lb # [ 89.098432] niks3-server[969]: 2026/09/22 11:26:04 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 89.103264] niks3-server[969]: 2026/09/22 11:26:04 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 89.116147] niks3-server[969]: 2026/09/22 11:26:04 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 89.124814] niks3-server[969]: 2026/09/22 11:26:04 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 89.129499] niks3-server[969]: 2026/09/22 11:26:04 INFO Completed upload id=29 lb # [ 89.131825] niks3-server[969]: 2026/09/22 11:26:04 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 89.134255] niks3-server[969]: 2026/09/22 11:26:04 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo worker2 # [ 89.125231] nix-grpc-daemon[1362]: time=2026-09-22T11:26:05.302Z level=INFO msg="Upload complete. (223ms)" lb # [ 89.138358] niks3-server[969]: 2026/09/22 11:26:04 INFO Completed upload id=30 worker2 # [ 89.129098] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 duration_s=0 paths=2 nar_bytes_in=312 lb # [ 89.143710] niks3-server[969]: 2026/09/22 11:26:04 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo worker2 # [ 89.137104] nix-daemon[868]: reaped child process 1360, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 0.87 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.01 seconds) worker1 # [ 89.184901] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 89.188195] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 89.275847] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:04Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 89.277940] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 89.281737] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 89.286065] nix-grpc-daemon[1174]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 89.287413] nix-grpc-daemon[1174]: E0000 00:00:1790076364.496080 1174 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 89.293561] nix-grpc-daemon[1174]: E0000 00:00:1790076364.501548 1174 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 89.297116] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 89.300867] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 89.308152] nix-grpc-daemon[1174]: E0000 00:00:1790076364.518052 1214 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 89.323076] nix-grpc-daemon[1174]: E0000 00:00:1790076364.532078 1214 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 89.325438] nix-grpc-daemon[1174]: E0000 00:00:1790076364.532367 1214 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 89.337318] nix-grpc-daemon[1174]: E0000 00:00:1790076364.547692 1214 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 89.346515] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.346799] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39148 worker2 # [ 89.350210] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.03 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.08 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 89.426086] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:04Z level=info event=scheduler_lock_lost status=200 lb # [ 89.436915] niks3-server[969]: 2026/09/22 11:26:04 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 89.439475] systemd[1]: Stopping niks3 server... worker2 # [ 89.432103] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:05Z level=info event=scheduler_lock_lost status=200 lb # [ 89.444935] niks3-server[969]: 2026/09/22 11:26:04 INFO lead: released remote=192.168.1.4:55874 lb # [ 89.459618] systemd[1]: niks3.service: Deactivated successfully. lb # [ 89.461140] systemd[1]: Stopped niks3 server. lb # [ 89.461944] systemd[1]: niks3.service: Consumed 556ms CPU time over 1min 9.523s wall clock time, 27.4M memory peak, 78.2K incoming IP traffic, 113.1K outgoing IP traffic. lb # [ 89.470480] systemd[1]: Starting niks3 server... lb # [ 89.535392] niks3-server[1111]: 2026/09/22 11:26:04 goose: no migrations to run. current version: 20260920000000 lb # [ 89.541354] niks3-server[1111]: 2026/09/22 11:26:04 OK 1_commit_pending_closure.sql (4.32ms) lb # [ 89.544825] niks3-server[1111]: 2026/09/22 11:26:04 OK 2_object_stats_trigger.sql (3.09ms) lb # [ 89.545902] niks3-server[1111]: 2026/09/22 11:26:04 goose: up to current file version: 2 lb # [ 89.547472] niks3-server[1111]: 2026/09/22 11:26:04 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 89.558891] niks3-server[1111]: 2026/09/22 11:26:04 INFO Read proxy enabled — serving cache objects from S3 lb # [ 89.560633] niks3-server[1111]: 2026/09/22 11:26:04 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 89.562351] niks3-server[1111]: 2026/09/22 11:26:04 INFO systemd watchdog enabled interval=15s lb # [ 89.563727] systemd[1]: Started niks3 server. lb # [ 89.565585] niks3-server[1111]: 2026/09/22 11:26:05 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 89.837137] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 89.851431] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 89.862835] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 89.878997] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 89.881111] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 89.923398] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 89.935136] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39160 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 89.945536] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 89.957166] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 90.058552] nix-daemon[868]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 90.078604] nix-daemon[868]: reaped child process 1398, status = succeeded worker2 # [ 90.150587] nix-daemon[868]: accepted connection from pid 1400, user nix-grpc-daemon (trusted) worker2 # [ 90.166809] nix-daemon[868]: reaped child process 1403, status = succeeded lb # [ 90.182434] niks3-server[1111]: 2026/09/22 11:26:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.181778] nix-grpc-daemon[1362]: time=2026-09-22T11:26:06.358Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 90.183501] nix-grpc-daemon[1362]: time=2026-09-22T11:26:06.358Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 90.215319] niks3-server[1111]: 2026/09/22 11:26:05 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 90.224699] niks3-server[1111]: 2026/09/22 11:26:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 90.238182] niks3-server[1111]: 2026/09/22 11:26:05 INFO Signed narinfos id=31 count=1 worker2 # [ 90.228136] nix-grpc-daemon[1362]: time=2026-09-22T11:26:06.404Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.246315] niks3-server[1111]: 2026/09/22 11:26:05 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 90.253935] niks3-server[1111]: 2026/09/22 11:26:05 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 90.261331] niks3-server[1111]: 2026/09/22 11:26:05 INFO Completed upload id=31 worker2 # [ 90.249205] nix-grpc-daemon[1362]: time=2026-09-22T11:26:06.426Z level=INFO msg="Upload complete. (279ms)" worker2 # [ 90.251234] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 90.254208] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 90.262761] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 90.264138] nix-daemon[868]: reaped child process 1393, status = succeeded client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker2 # [ 90.269939] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) lb # [ 90.448283] niks3-server[1111]: 2026/09/22 11:26:05 INFO lead: acquired remote=192.168.1.4:55978 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 91.093953] nix-daemon[868]: reaped child process 1407, status = succeeded worker2 # [ 91.178391] nix-daemon[868]: accepted connection from pid 1425, user nix-grpc-daemon (trusted) worker2 # [ 91.193377] nix-daemon[868]: reaped child process 1428, status = succeeded lb # [ 91.214541] niks3-server[1111]: 2026/09/22 11:26:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.231065] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.407Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 91.233054] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.409Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 91.289895] niks3-server[1111]: 2026/09/22 11:26:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 91.293489] niks3-server[1111]: 2026/09/22 11:26:06 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 91.302240] niks3-server[1111]: 2026/09/22 11:26:06 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 91.313065] niks3-server[1111]: 2026/09/22 11:26:06 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 91.316114] niks3-server[1111]: 2026/09/22 11:26:06 INFO Signed narinfos id=32 count=1 worker2 # [ 91.304232] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.480Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.322901] niks3-server[1111]: 2026/09/22 11:26:06 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 91.329097] niks3-server[1111]: 2026/09/22 11:26:06 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo lb # [ 91.335929] niks3-server[1111]: 2026/09/22 11:26:06 INFO Completed upload id=32 worker2 # [ 91.323960] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.500Z level=INFO msg="Upload complete. (245ms)" worker2 # [ 91.330783] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 91.346177] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 91.350286] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 91.360476] nix-daemon[868]: reaped child process 1405, status = succeeded worker2 # [ 91.389390] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 91.400418] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 91.410838] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.587Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 91.417127] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 91.427072] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 91.521139] nix-daemon[868]: accepted connection from pid 1434, user nix-grpc-daemon (trusted) worker2 # [ 91.534894] nix-daemon[868]: reaped child process 1437, status = succeeded worker2 # [ 91.616273] nix-daemon[868]: accepted connection from pid 1439, user nix-grpc-daemon (trusted) worker2 # [ 91.630788] nix-daemon[868]: reaped child process 1442, status = succeeded lb # [ 91.648512] niks3-server[1111]: 2026/09/22 11:26:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.647958] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.824Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 91.649540] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.826Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 91.694126] niks3-server[1111]: 2026/09/22 11:26:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 91.698130] niks3-server[1111]: 2026/09/22 11:26:07 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst worker2 # [ 91.694559] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.871Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.707254] niks3-server[1111]: 2026/09/22 11:26:07 INFO Signed narinfos id=33 count=1 lb # [ 91.713396] niks3-server[1111]: 2026/09/22 11:26:07 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 91.723353] niks3-server[1111]: 2026/09/22 11:26:07 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 91.732594] niks3-server[1111]: 2026/09/22 11:26:07 INFO Completed upload id=33 worker2 # [ 91.720532] nix-grpc-daemon[1362]: time=2026-09-22T11:26:07.897Z level=INFO msg="Upload complete. (283ms)" worker2 # [ 91.722631] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 duration_s=0 paths=1 nar_bytes_in=656 lb # [ 91.735854] niks3-server[1111]: 2026/09/22 11:26:07 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 91.726972] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 91.734109] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 91.736540] nix-daemon[868]: reaped child process 1432, status = succeeded client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker2 # [ 91.743617] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 92.758244] nix-daemon[868]: reaped child process 1446, status = succeeded worker2 # [ 92.832843] nix-daemon[868]: accepted connection from pid 1462, user nix-grpc-daemon (trusted) worker2 # [ 92.846525] nix-daemon[868]: reaped child process 1465, status = succeeded lb # [ 92.866826] niks3-server[1111]: 2026/09/22 11:26:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 92.864812] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.041Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 92.866415] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.043Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 92.910226] niks3-server[1111]: 2026/09/22 11:26:08 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 92.922784] niks3-server[1111]: 2026/09/22 11:26:08 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 92.929488] niks3-server[1111]: 2026/09/22 11:26:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 92.934601] niks3-server[1111]: 2026/09/22 11:26:08 INFO Signed narinfos id=34 count=1 worker2 # [ 92.925862] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.102Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.945690] niks3-server[1111]: 2026/09/22 11:26:08 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 92.948691] niks3-server[1111]: 2026/09/22 11:26:08 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 92.955575] niks3-server[1111]: 2026/09/22 11:26:08 INFO Completed upload id=34 worker2 # [ 92.943385] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.120Z level=INFO msg="Upload complete. (193ms)" lb # [ 92.957504] niks3-server[1111]: 2026/09/22 11:26:08 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 92.953655] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 92.962239] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 92.967271] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 92.976607] nix-daemon[868]: reaped child process 1444, status = succeeded worker2 # [ 93.006912] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 93.019745] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 93.033586] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.210Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 93.042252] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 93.050585] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 93.148977] nix-daemon[868]: accepted connection from pid 1471, user nix-grpc-daemon (trusted) worker2 # [ 93.166786] nix-daemon[868]: reaped child process 1474, status = succeeded worker2 # [ 93.237116] nix-daemon[868]: accepted connection from pid 1476, user nix-grpc-daemon (trusted) worker2 # [ 93.251292] nix-daemon[868]: reaped child process 1479, status = succeeded lb # [ 93.268055] niks3-server[1111]: 2026/09/22 11:26:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 93.265200] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.442Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 93.267163] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.443Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 93.297158] niks3-server[1111]: 2026/09/22 11:26:08 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 93.311355] niks3-server[1111]: 2026/09/22 11:26:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 93.316709] niks3-server[1111]: 2026/09/22 11:26:08 INFO Signed narinfos id=35 count=1 worker2 # [ 93.307532] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.484Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.322815] niks3-server[1111]: 2026/09/22 11:26:08 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 93.336553] niks3-server[1111]: 2026/09/22 11:26:08 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 93.344529] niks3-server[1111]: 2026/09/22 11:26:08 INFO Completed upload id=35 worker2 # [ 93.332395] nix-grpc-daemon[1362]: time=2026-09-22T11:26:09.509Z level=INFO msg="Upload complete. (268ms)" lb # [ 93.346116] niks3-server[1111]: 2026/09/22 11:26:08 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 93.336503] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39160 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 93.341244] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 worker2 # [ 93.350737] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 93.360566] nix-daemon[868]: reaped child process 1469, status = succeeded worker2 # [ 93.364682] nix-daemon[868]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 94.005612] nix-daemon[868]: reaped child process 1483, status = succeeded worker2 # [ 94.085092] nix-daemon[868]: accepted connection from pid 1499, user nix-grpc-daemon (trusted) worker2 # [ 94.097772] nix-daemon[868]: reaped child process 1502, status = succeeded lb # [ 94.116981] niks3-server[1111]: 2026/09/22 11:26:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 94.114057] nix-grpc-daemon[1362]: time=2026-09-22T11:26:10.290Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 94.116052] nix-grpc-daemon[1362]: time=2026-09-22T11:26:10.292Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 94.160678] niks3-server[1111]: 2026/09/22 11:26:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 94.164773] niks3-server[1111]: 2026/09/22 11:26:09 INFO Signed narinfos id=36 count=1 worker2 # [ 94.154986] nix-grpc-daemon[1362]: time=2026-09-22T11:26:10.331Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.174128] niks3-server[1111]: 2026/09/22 11:26:09 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 94.181099] niks3-server[1111]: 2026/09/22 11:26:09 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 94.194147] niks3-server[1111]: 2026/09/22 11:26:09 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 94.196513] niks3-server[1111]: 2026/09/22 11:26:09 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 94.202133] niks3-server[1111]: 2026/09/22 11:26:09 INFO Completed upload id=36 worker2 # [ 94.190187] nix-grpc-daemon[1362]: time=2026-09-22T11:26:10.367Z level=INFO msg="Upload complete. (218ms)" lb # [ 94.205058] niks3-server[1111]: 2026/09/22 11:26:09 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 94.197766] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39160 duration_s=0 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 94.211612] nix-daemon[868]: reaped child process 1481, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 4.51 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.11 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 4.98 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 94.510753] systemd[1]: Stopping Nix worker-protocol over gRPC... lb # [ 94.691476] envoy[896]: conn peer=[2001:db8:1::3]:60534 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=21438 tx=4026 ms=71551 lb # [ 94.696235] envoy[896]: conn peer=[2001:db8:1::1]:48848 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1003 tx=282 ms=736 lb # [ 94.701792] envoy[896]: conn peer=[2001:db8:1::1]:48850 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9705 tx=4066 ms=4375 worker2 # [ 95.418139] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:11Z level=info event=signal_exit lb # [ 95.451584] niks3-server[1111]: 2026/09/22 11:26:10 INFO lead: released remote=192.168.1.4:55978 worker1 # [ 96.442378] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:11Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 96.444886] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:12Z level=info event=scheduler_restarting worker2 # [ 96.448765] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39148 worker2 # [ 96.452862] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:12Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 96.456464] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:12Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 96.459801] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39148 worker2 # [ 96.463314] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:12Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 96.466583] nix-grpc-daemon[1302]: E0000 00:00:1790076372.629597 1347 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 96.471587] nix-grpc-daemon[1302]: E0000 00:00:1790076372.633278 1347 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 96.489361] nix-daemon[868]: reaped child process 1354, status = succeeded worker1 # [ 96.642233] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.644341] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.655729] nix-grpc-daemon[1302]: ts=2026-09-22T11:26:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 96.845413] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.849286] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.049738] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.052222] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.253140] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.257212] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.458767] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.462581] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.663598] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.666764] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 97.667422] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.668452] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 97.669811] systemd[1]: nix-grpc-daemon.service: Consumed 1.093s CPU time over 12.365s wall clock time, 39.2M memory peak, 46.5K incoming IP traffic, 82.9K outgoing IP traffic. worker2 # [ 97.674710] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 97.676409] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 97.677798] systemd[1]: nix-grpc-daemon.socket: Consumed 324us CPU time over 13.200s wall clock time, 256K memory peak, 36.8K incoming IP traffic, 28.7K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 97.868291] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.872177] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.072964] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.077131] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.277525] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.279363] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.481297] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.485203] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 98.686298] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.690634] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 98.891747] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 98.896479] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.097054] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.099372] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.299836] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.301676] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.504473] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.507612] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.705209] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.706981] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 99.908094] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.912287] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.113292] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.117573] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.318546] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.322582] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.431990] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_take_over lb # [ 100.442401] niks3-server[1111]: 2026/09/22 11:26:15 INFO lead: acquired remote=192.168.1.3:51536 worker1 # [ 100.524759] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.528373] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.729480] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.733562] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 100.934404] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.936585] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.137845] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.141961] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.342393] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.349370] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42676 worker1 # [ 101.353858] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker1 # [ 102.032464] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39964 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 102.040856] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 102.051551] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5) worker1 # [ 102.099081] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 2/5) worker1 # [ 102.159121] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 375 ms (attempt 3/5) worker1 # [ 102.535728] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 531 ms (attempt 4/5) worker1 # [ 103.069898] nix-grpc-daemon[1174]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 103.073818] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 103.099154] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 103.103086] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 103.150884] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 103.160201] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39964 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 103.171698] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 103.181075] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 103.205086] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=info event=niks3_push_started pid=1259 worker1 # [ 103.316949] nix-grpc-daemon[1259]: time=2026-09-22T11:26:18.526Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 103.409728] nix-daemon[847]: accepted connection from pid 1272, user nix-grpc-daemon (trusted) worker1 # [ 103.423444] nix-daemon[847]: reaped child process 1275, status = succeeded worker1 # [ 103.512466] nix-daemon[847]: accepted connection from pid 1277, user nix-grpc-daemon (trusted) worker1 # [ 103.527302] nix-daemon[847]: reaped child process 1280, status = succeeded lb # [ 103.543091] niks3-server[1111]: 2026/09/22 11:26:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.542137] nix-grpc-daemon[1259]: time=2026-09-22T11:26:18.752Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 103.544021] nix-grpc-daemon[1259]: time=2026-09-22T11:26:18.754Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 103.583775] niks3-server[1111]: 2026/09/22 11:26:19 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 103.600446] niks3-server[1111]: 2026/09/22 11:26:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker1 # [ 103.594615] nix-grpc-daemon[1259]: time=2026-09-22T11:26:18.804Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.604921] niks3-server[1111]: 2026/09/22 11:26:19 INFO Signed narinfos id=37 count=1 lb # [ 103.613352] niks3-server[1111]: 2026/09/22 11:26:19 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 103.622822] niks3-server[1111]: 2026/09/22 11:26:19 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 103.625941] niks3-server[1111]: 2026/09/22 11:26:19 INFO Completed upload id=37 worker1 # [ 103.615917] nix-grpc-daemon[1259]: time=2026-09-22T11:26:18.826Z level=INFO msg="Upload complete. (295ms)" lb # [ 103.629893] niks3-server[1111]: 2026/09/22 11:26:19 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 103.620526] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 103.625965] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 103.634550] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 103.641234] nix-daemon[847]: reaped child process 1257, status = succeeded worker1 # [ 103.646663] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 104.463925] nix-daemon[847]: reaped child process 1284, status = succeeded worker1 # [ 104.538663] nix-daemon[847]: accepted connection from pid 1300, user nix-grpc-daemon (trusted) worker1 # [ 104.552307] nix-daemon[847]: reaped child process 1303, status = succeeded lb # [ 104.568186] niks3-server[1111]: 2026/09/22 11:26:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 104.566499] nix-grpc-daemon[1259]: time=2026-09-22T11:26:19.776Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 104.569083] nix-grpc-daemon[1259]: time=2026-09-22T11:26:19.778Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 104.599417] niks3-server[1111]: 2026/09/22 11:26:20 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 104.615595] niks3-server[1111]: 2026/09/22 11:26:20 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 104.622627] niks3-server[1111]: 2026/09/22 11:26:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 104.627703] niks3-server[1111]: 2026/09/22 11:26:20 INFO Signed narinfos id=38 count=1 worker1 # [ 104.619833] nix-grpc-daemon[1259]: time=2026-09-22T11:26:19.830Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.633107] niks3-server[1111]: 2026/09/22 11:26:20 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 104.642169] niks3-server[1111]: 2026/09/22 11:26:20 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 104.645478] niks3-server[1111]: 2026/09/22 11:26:20 INFO Completed upload id=38 lb # [ 104.647429] niks3-server[1111]: 2026/09/22 11:26:20 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker1 # [ 104.636791] nix-grpc-daemon[1259]: time=2026-09-22T11:26:19.847Z level=INFO msg="Upload complete. (183ms)" worker1 # [ 104.650954] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker1 # [ 104.656518] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:19Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 104.659652] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:19Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 104.667866] nix-daemon[847]: reaped child process 1282, status = succeeded lb # [ 104.692150] envoy[896]: conn peer=[2001:db8:1::4]:48490 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4934 tx=641 ms=11177 worker1 # [ 104.695152] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 104.706332] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 104.717258] nix-grpc-daemon[1259]: time=2026-09-22T11:26:19.927Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 104.724690] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 104.731289] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 104.819174] nix-daemon[847]: accepted connection from pid 1309, user nix-grpc-daemon (trusted) worker1 # [ 104.833524] nix-daemon[847]: reaped child process 1312, status = succeeded worker1 # [ 104.911190] nix-daemon[847]: accepted connection from pid 1314, user nix-grpc-daemon (trusted) worker1 # [ 104.926144] nix-daemon[847]: reaped child process 1317, status = succeeded lb # [ 104.941963] niks3-server[1111]: 2026/09/22 11:26:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 104.942866] nix-grpc-daemon[1259]: time=2026-09-22T11:26:20.152Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 104.944219] nix-grpc-daemon[1259]: time=2026-09-22T11:26:20.153Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 104.969630] niks3-server[1111]: 2026/09/22 11:26:20 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 104.981814] niks3-server[1111]: 2026/09/22 11:26:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 104.987558] niks3-server[1111]: 2026/09/22 11:26:20 INFO Signed narinfos id=39 count=1 worker1 # [ 104.980846] nix-grpc-daemon[1259]: time=2026-09-22T11:26:20.190Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.993978] niks3-server[1111]: 2026/09/22 11:26:20 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 105.006143] niks3-server[1111]: 2026/09/22 11:26:20 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 105.013110] niks3-server[1111]: 2026/09/22 11:26:20 INFO Completed upload id=39 worker1 # [ 105.002349] nix-grpc-daemon[1259]: time=2026-09-22T11:26:20.212Z level=INFO msg="Upload complete. (262ms)" worker1 # [ 105.005974] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 105.018974] niks3-server[1111]: 2026/09/22 11:26:20 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 105.011302] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 105.019490] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 105.025760] nix-daemon[847]: reaped child process 1307, status = succeeded worker1 # [ 105.030321] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 106.668278] nix-daemon[847]: reaped child process 1321, status = succeeded worker1 # [ 106.744698] nix-daemon[847]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker1 # [ 106.761318] nix-daemon[847]: reaped child process 1340, status = succeeded lb # [ 106.771540] niks3-server[1111]: 2026/09/22 11:26:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 106.769804] nix-grpc-daemon[1259]: time=2026-09-22T11:26:21.979Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 106.771307] nix-grpc-daemon[1259]: time=2026-09-22T11:26:21.981Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 106.810207] niks3-server[1111]: 2026/09/22 11:26:22 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 106.820432] niks3-server[1111]: 2026/09/22 11:26:22 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 106.827334] niks3-server[1111]: 2026/09/22 11:26:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 106.835374] niks3-server[1111]: 2026/09/22 11:26:22 INFO Signed narinfos id=40 count=1 worker1 # [ 106.825838] nix-grpc-daemon[1259]: time=2026-09-22T11:26:22.035Z level=INFO msg="Uploading 1 narinfos" lb # [ 106.843076] niks3-server[1111]: 2026/09/22 11:26:22 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 106.851205] niks3-server[1111]: 2026/09/22 11:26:22 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 106.853430] niks3-server[1111]: 2026/09/22 11:26:22 INFO Completed upload id=40 worker1 # [ 106.844561] nix-grpc-daemon[1259]: time=2026-09-22T11:26:22.054Z level=INFO msg="Upload complete. (206ms)" lb # [ 106.856327] niks3-server[1111]: 2026/09/22 11:26:22 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 106.847236] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 106.854636] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 106.856619] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 106.862946] nix-daemon[847]: reaped child process 1319, status = succeeded worker1 # [ 106.898768] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 106.910655] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 106.922865] nix-grpc-daemon[1259]: time=2026-09-22T11:26:22.133Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 106.931743] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 106.939933] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 107.036082] nix-daemon[847]: accepted connection from pid 1346, user nix-grpc-daemon (trusted) worker1 # [ 107.049874] nix-daemon[847]: reaped child process 1349, status = succeeded worker1 # [ 107.129738] nix-daemon[847]: accepted connection from pid 1351, user nix-grpc-daemon (trusted) worker1 # [ 107.143209] nix-daemon[847]: reaped child process 1354, status = succeeded lb # [ 107.159179] niks3-server[1111]: 2026/09/22 11:26:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 107.154329] nix-grpc-daemon[1259]: time=2026-09-22T11:26:22.364Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 107.155892] nix-grpc-daemon[1259]: time=2026-09-22T11:26:22.366Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 107.176856] niks3-server[1111]: 2026/09/22 11:26:22 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 107.180466] niks3-server[1111]: 2026/09/22 11:26:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 107.182679] niks3-server[1111]: 2026/09/22 11:26:22 INFO Signed narinfos id=41 count=1 worker1 # [ 107.172365] nix-grpc-daemon[1259]: time=2026-09-22T11:26:22.382Z level=INFO msg="Uploading 1 narinfos" lb # [ 107.185722] niks3-server[1111]: 2026/09/22 11:26:22 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 107.192121] niks3-server[1111]: 2026/09/22 11:26:22 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 107.196156] niks3-server[1111]: 2026/09/22 11:26:22 INFO Completed upload id=41 worker1 # [ 107.185958] nix-grpc-daemon[1259]: time=2026-09-22T11:26:22.396Z level=INFO msg="Upload complete. (234ms)" lb # [ 107.198643] niks3-server[1111]: 2026/09/22 11:26:22 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 107.188076] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 107.191078] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 107.196529] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 107.200621] nix-daemon[847]: reaped child process 1344, status = succeeded worker1 # [ 107.205577] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 108.424737] nix-daemon[847]: reaped child process 1358, status = succeeded worker1 # [ 108.494482] nix-daemon[847]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) lb # [ 108.519901] niks3-server[1111]: 2026/09/22 11:26:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 108.510481] nix-daemon[847]: reaped child process 1377, status = succeeded worker1 # [ 108.514314] nix-grpc-daemon[1259]: time=2026-09-22T11:26:23.724Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 108.515758] nix-grpc-daemon[1259]: time=2026-09-22T11:26:23.726Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 108.540249] niks3-server[1111]: 2026/09/22 11:26:23 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 108.545028] niks3-server[1111]: 2026/09/22 11:26:23 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 108.549244] niks3-server[1111]: 2026/09/22 11:26:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 108.552068] niks3-server[1111]: 2026/09/22 11:26:23 INFO Signed narinfos id=42 count=1 worker1 # [ 108.541996] nix-grpc-daemon[1259]: time=2026-09-22T11:26:23.752Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.555177] niks3-server[1111]: 2026/09/22 11:26:23 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 108.560387] niks3-server[1111]: 2026/09/22 11:26:23 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 108.564210] niks3-server[1111]: 2026/09/22 11:26:23 INFO Completed upload id=42 worker1 # [ 108.555281] nix-grpc-daemon[1259]: time=2026-09-22T11:26:23.765Z level=INFO msg="Upload complete. (142ms)" lb # [ 108.566465] niks3-server[1111]: 2026/09/22 11:26:24 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 108.558866] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 108.565885] nix-daemon[847]: reaped child process 1356, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 6.66 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.09 seconds) worker2 # [ 108.711814] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 108.717113] systemd[1]: Starting scheduler-token.service... worker2 # [ 108.760634] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 108.762319] systemd[1]: Finished scheduler-token.service. worker2 # [ 108.763699] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 45ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 108.768247] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 108.848068] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:25Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 108.850065] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 108.853294] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 108.857600] nix-grpc-daemon[1523]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 108.858978] nix-grpc-daemon[1523]: E0000 00:00:1790076385.034441 1523 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 108.865258] nix-grpc-daemon[1523]: E0000 00:00:1790076385.040007 1523 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 108.868976] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 108.872799] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 108.876128] nix-grpc-daemon[1523]: E0000 00:00:1790076385.051737 1564 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 108.889069] nix-grpc-daemon[1523]: E0000 00:00:1790076385.065474 1564 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 108.892286] nix-grpc-daemon[1523]: E0000 00:00:1790076385.065601 1564 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 108.902992] nix-grpc-daemon[1523]: E0000 00:00:1790076385.080007 1564 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 108.914767] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.924174] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=info event=oidc_jwks provider=mock keys=1 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 108.928710] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42676 worker1 # [ 108.933138] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.72 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 109.112957] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: b5645f3cf71e454daf9200618da3b475 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) client # [ 109.257446] nix[1296]: don't know how to build these paths: worker1 # [ 109.251099] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39964 client # [ 109.258532] nix[1296]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 109.259222] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 109.261840] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 109.302762] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 109.313631] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39964 client # [ 109.327104] nix[1296]: copying 1 paths to 'lb:50051'... client # [ 109.327987] nix[1296]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 109.322947] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 109.331109] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 109.417412] nix-daemon[847]: accepted connection from pid 1390, user nix-grpc-daemon (trusted) worker1 # [ 109.433403] nix-daemon[847]: reaped child process 1393, status = succeeded worker1 # [ 109.509594] nix-daemon[847]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker1 # [ 109.522687] nix-daemon[847]: reaped child process 1398, status = succeeded lb # [ 109.538422] niks3-server[1111]: 2026/09/22 11:26:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 109.533039] nix-grpc-daemon[1259]: time=2026-09-22T11:26:24.742Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 109.534443] nix-grpc-daemon[1259]: time=2026-09-22T11:26:24.742Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 109.550589] niks3-server[1111]: 2026/09/22 11:26:24 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 109.559981] niks3-server[1111]: 2026/09/22 11:26:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 109.564368] niks3-server[1111]: 2026/09/22 11:26:24 INFO Signed narinfos id=43 count=1 worker1 # [ 109.558058] nix-grpc-daemon[1259]: time=2026-09-22T11:26:24.768Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.571357] niks3-server[1111]: 2026/09/22 11:26:25 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 109.577061] niks3-server[1111]: 2026/09/22 11:26:25 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 109.580921] niks3-server[1111]: 2026/09/22 11:26:25 INFO Completed upload id=43 worker1 # [ 109.570660] nix-grpc-daemon[1259]: time=2026-09-22T11:26:24.781Z level=INFO msg="Upload complete. (232ms)" worker1 # [ 109.572859] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 109.583725] niks3-server[1111]: 2026/09/22 11:26:25 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 109.576319] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 worker1 # [ 109.583142] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker1 # [ 109.585443] nix-daemon[847]: reaped child process 1388, status = succeeded worker1 # [ 109.590423] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) client # [ 109.594776] nix[1296]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 111.687062] systemd-journald[284]: Received client request to rotate journal, rotating. worker2 # [ 111.697510] systemd-journald[284]: Vacuuming done, freed 0B of archived journals from /var/log/journal/9b94986bac5743088c4a144d9c816274. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.03 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 111.593323] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker1 # [ 112.300624] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:27Z level=info event=draining lb # [ 114.693909] envoy[896]: conn peer=[2001:db8:1::1]:37334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9620 tx=4097 ms=6538 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 116.812286] nix-daemon[847]: reaped child process 1402, status = succeeded worker1 # [ 116.886787] nix-daemon[847]: accepted connection from pid 1443, user nix-grpc-daemon (trusted) worker1 # [ 116.900255] nix-daemon[847]: reaped child process 1446, status = succeeded lb # [ 116.917966] niks3-server[1111]: 2026/09/22 11:26:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 116.916907] nix-grpc-daemon[1259]: time=2026-09-22T11:26:32.127Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 116.919812] nix-grpc-daemon[1259]: time=2026-09-22T11:26:32.128Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 116.952167] niks3-server[1111]: 2026/09/22 11:26:32 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 116.963629] niks3-server[1111]: 2026/09/22 11:26:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 116.963985] nix-grpc-daemon[1259]: time=2026-09-22T11:26:32.174Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.974517] niks3-server[1111]: 2026/09/22 11:26:32 INFO Signed narinfos id=44 count=1 lb # [ 116.981766] niks3-server[1111]: 2026/09/22 11:26:32 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 116.997082] niks3-server[1111]: 2026/09/22 11:26:32 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 117.000049] niks3-server[1111]: 2026/09/22 11:26:32 INFO Completed upload id=44 worker1 # [ 116.990000] nix-grpc-daemon[1259]: time=2026-09-22T11:26:32.200Z level=INFO msg="Upload complete. (187ms)" lb # [ 117.003025] niks3-server[1111]: 2026/09/22 11:26:32 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 117.009253] niks3-server[1111]: 2026/09/22 11:26:32 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 116.997818] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39964 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 117.011410] nix-daemon[847]: reaped child process 1400, status = succeeded client # [ 117.037323] systemd[1]: rs.service: Deactivated successfully. client # [ 117.040278] systemd[1]: rs.service: Consumed 128ms CPU time over 7.923s wall clock time, 43.4M memory peak, 7K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 117.302194] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:32Z level=info event=signal_exit lb # [ 117.446036] niks3-server[1111]: 2026/09/22 11:26:32 INFO lead: released remote=192.168.1.3:51536 worker2 # [ 118.434110] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:34Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 118.440886] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:33Z level=info event=scheduler_restarting worker1 # [ 118.444589] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:33Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 118.447798] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42676 worker1 # [ 118.451423] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:33Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 118.454935] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42676 worker1 # [ 118.458567] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:33Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 118.474460] nix-daemon[847]: reaped child process 1226, status = succeeded worker2 # [ 118.634527] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.636897] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.649344] nix-grpc-daemon[1174]: ts=2026-09-22T11:26:33Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.06 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 118.837531] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.839362] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } lb # [ 118.887189] niks3-server[1111]: 2026/09/22 11:26:34 INFO lead: acquired remote=192.168.1.4:42824 worker2 # [ 118.877776] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_take_over client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 119.019898] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 119.022866] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 119.026522] systemd[1]: nix-grpc-daemon.service: Consumed 1.300s CPU time over 29.830s wall clock time, 42.7M memory peak, 51.2K incoming IP traffic, 104.3K outgoing IP traffic. worker1 # [ 119.043408] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 119.040636] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.044738] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 119.138845] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 119.140895] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 119.143991] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 119.148394] nix-grpc-daemon[1453]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 119.149735] nix-grpc-daemon[1453]: E0000 00:00:1790076394.358570 1453 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 119.155937] nix-grpc-daemon[1453]: E0000 00:00:1790076394.363951 1453 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 119.159451] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 119.162277] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 119.165090] nix-grpc-daemon[1453]: E0000 00:00:1790076394.374059 1494 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 119.175677] nix-grpc-daemon[1453]: E0000 00:00:1790076394.386008 1494 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 119.179126] nix-grpc-daemon[1453]: E0000 00:00:1790076394.388203 1494 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 119.189825] nix-grpc-daemon[1453]: E0000 00:00:1790076394.400166 1494 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 119.197240] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.198795] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.245702] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.249534] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 119.400278] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.404151] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.451595] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.455224] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 119.604935] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.609087] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.655877] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.659984] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 119.809398] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.817270] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53084 worker2 # [ 119.821684] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 119.860576] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.870136] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:36Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 119.873947] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:36Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53084 worker2 # [ 119.878167] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.98 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 120.094696] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 53669231a416430daeb4ef3f5069f443 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker2 # [ 120.230180] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53096 worker2 # [ 120.242342] nix-daemon[868]: accepted connection from pid 1523, user nix-grpc-daemon (trusted) client # [ 120.259901] nix[1332]: don't know how to build these paths: client # [ 120.260912] nix[1332]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 120.262081] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:36Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 120.266076] nix-grpc-daemon[1523]: ts=2026-09-22T11:26:36Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 120.319435] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44318 worker1 # [ 120.325529] nix-daemon[847]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) worker1 # [ 120.333614] nix-grpc-daemon[1453]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) worker1 # [ 120.406219] nix-grpc-daemon[1453]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5) worker1 # [ 120.555962] nix-grpc-daemon[1453]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 274 ms (attempt 3/5) worker1 # [ 120.831411] nix-grpc-daemon[1453]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 730 ms (attempt 4/5) worker1 # [ 121.564870] nix-grpc-daemon[1453]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 121.568844] nix-grpc-daemon[1453]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 121.585586] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44318 client # [ 121.601595] nix[1332]: copying 1 paths to 'lb:50051'... client # [ 121.605878] nix[1332]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 121.600868] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44318 worker1 # [ 121.612827] nix-daemon[847]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) worker1 # [ 121.633334] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:36Z level=info event=niks3_push_started pid=1521 worker1 # [ 121.740191] nix-grpc-daemon[1521]: time=2026-09-22T11:26:36.950Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 121.828795] nix-daemon[847]: accepted connection from pid 1534, user nix-grpc-daemon (trusted) worker1 # [ 121.841250] nix-daemon[847]: reaped child process 1537, status = succeeded worker1 # [ 121.926197] nix-daemon[847]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) worker1 # [ 121.941123] nix-daemon[847]: reaped child process 1542, status = succeeded lb # [ 121.957426] niks3-server[1111]: 2026/09/22 11:26:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 121.956285] nix-grpc-daemon[1521]: time=2026-09-22T11:26:37.166Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 121.958049] nix-grpc-daemon[1521]: time=2026-09-22T11:26:37.168Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 121.993385] niks3-server[1111]: 2026/09/22 11:26:37 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 122.005583] niks3-server[1111]: 2026/09/22 11:26:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign worker1 # [ 122.001282] nix-grpc-daemon[1521]: time=2026-09-22T11:26:37.211Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.011770] niks3-server[1111]: 2026/09/22 11:26:37 INFO Signed narinfos id=45 count=1 lb # [ 122.024735] niks3-server[1111]: 2026/09/22 11:26:37 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 122.033416] niks3-server[1111]: 2026/09/22 11:26:37 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 122.039949] niks3-server[1111]: 2026/09/22 11:26:37 INFO Completed upload id=45 worker1 # [ 122.029802] nix-grpc-daemon[1521]: time=2026-09-22T11:26:37.240Z level=INFO msg="Upload complete. (286ms)" lb # [ 122.044579] niks3-server[1111]: 2026/09/22 11:26:37 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 122.032692] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44318 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 122.038941] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44318 worker1 # [ 122.050066] nix-daemon[847]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) worker1 # [ 122.055438] nix-daemon[847]: reaped child process 1519, status = succeeded worker1 # [ 122.059550] nix-daemon[847]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) client # [ 122.064256] nix[1332]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 123.656749] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1523 (nix-grpc-daemon) on client request. lb # [ 123.689291] niks3-server[1111]: 2026/09/22 11:26:39 INFO lead: released remote=192.168.1.4:42824 client # [ 123.684266] nix[1332]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 123.679517] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:38Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" worker2 # [ 123.669950] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. worker2 # [ 123.693166] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 123.694633] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 123.695860] systemd[1]: nix-grpc-daemon.service: Consumed 200ms CPU time over 14.922s wall clock time, 13.7M memory peak, 11.4K incoming IP traffic, 22K outgoing IP traffic. worker2 # [ 123.709948] systemd[1]: Starting scheduler-token.service... worker2 # [ 123.716349] nix-daemon[868]: reaped child process 1632, status = succeeded worker2 # [ 123.743353] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 123.744963] systemd[1]: Finished scheduler-token.service. worker2 # [ 123.746876] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 36ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 123.749088] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 123.752467] systemd[1]: Starting scheduler-token.service... worker2 # [ 123.781749] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 123.783447] systemd[1]: Finished scheduler-token.service. worker2 # [ 123.784790] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 30ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 123.789248] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 123.869765] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 123.879837] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.877111] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 123.881218] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 123.883139] nix-grpc-daemon[1666]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 123.889629] nix-grpc-daemon[1666]: E0000 00:00:1790076400.052644 1666 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 123.894128] nix-grpc-daemon[1666]: E0000 00:00:1790076400.056890 1666 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 123.911546] niks3-server[1111]: 2026/09/22 11:26:39 INFO lead: acquired remote=192.168.1.4:41830 worker2 # [ 123.898510] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 123.901904] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 123.905954] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=scheduler_take_over worker2 # [ 123.908093] nix-grpc-daemon[1666]: E0000 00:00:1790076400.080135 1706 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 123.910234] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:49012 worker2 # [ 123.911616] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=1 worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds) client: must succeed: sleep 5.0 worker2 # [ 123.923845] nix-grpc-daemon[1666]: E0000 00:00:1790076400.100853 1706 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 123.927142] nix-grpc-daemon[1666]: E0000 00:00:1790076400.102992 1706 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 123.938055] nix-grpc-daemon[1666]: E0000 00:00:1790076400.115030 1706 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 123.945154] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.949406] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 123.950719] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:49012 worker2 # [ 123.952333] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:40Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 124.694892] envoy[896]: conn peer=[2001:db8:1::1]:59222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=1384 ms=7760 lb # [ 124.698672] envoy[896]: conn peer=[2001:db8:1::3]:48650 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6173 tx=1376 ms=29295 lb # [ 124.702425] envoy[896]: conn peer=[2001:db8:1::4]:40784 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6953 tx=523 ms=14769 client: (finished: must succeed: sleep 5.0, in 5.02 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 129.303621] nix-daemon[847]: reaped child process 1546, status = succeeded worker1 # [ 129.387723] nix-daemon[847]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker1 # [ 129.400124] nix-daemon[847]: reaped child process 1586, status = succeeded lb # [ 129.415984] niks3-server[1111]: 2026/09/22 11:26:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 129.409974] nix-grpc-daemon[1521]: time=2026-09-22T11:26:44.620Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 129.413059] nix-grpc-daemon[1521]: time=2026-09-22T11:26:44.621Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 129.431781] niks3-server[1111]: 2026/09/22 11:26:44 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 129.439025] niks3-server[1111]: 2026/09/22 11:26:44 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 129.445064] niks3-server[1111]: 2026/09/22 11:26:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 129.447159] niks3-server[1111]: 2026/09/22 11:26:44 INFO Signed narinfos id=46 count=1 worker1 # [ 129.438862] nix-grpc-daemon[1521]: time=2026-09-22T11:26:44.648Z level=INFO msg="Uploading 1 narinfos" lb # [ 129.450712] niks3-server[1111]: 2026/09/22 11:26:44 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 129.456976] niks3-server[1111]: 2026/09/22 11:26:44 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 129.463467] niks3-server[1111]: 2026/09/22 11:26:44 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo lb # [ 129.472227] niks3-server[1111]: 2026/09/22 11:26:44 INFO Completed upload id=46 worker1 # [ 129.463312] nix-grpc-daemon[1521]: time=2026-09-22T11:26:44.673Z level=INFO msg="Upload complete. (190ms)" worker1 # [ 129.465925] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44318 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 129.472947] nix-daemon[847]: reaped child process 1544, status = succeeded client # [ 129.502325] systemd[1]: mid.service: Deactivated successfully. client # [ 129.506307] systemd[1]: mid.service: Consumed 133ms CPU time over 9.410s wall clock time, 39.4M memory peak, 7.7K incoming IP traffic, 8.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.06 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.16 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 130.233905] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: a65d0ee84acb4d70a4bbe2f7c067cedc client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker1 # [ 130.344797] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44318 client # [ 130.353854] nix[1368]: don't know how to build these paths: client # [ 130.354798] nix[1368]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 130.356908] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:46Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 130.362619] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:46Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 130.408668] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 130.420924] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 130.437565] nix-grpc-daemon[1666]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 1/5) worker2 # [ 130.544263] nix-grpc-daemon[1666]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 173 ms (attempt 2/5) worker2 # [ 130.719723] nix-grpc-daemon[1666]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 3/5) worker2 # [ 130.776787] nix-grpc-daemon[1666]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 562 ms (attempt 4/5) worker2 # [ 131.341962] nix-grpc-daemon[1666]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 131.344994] nix-grpc-daemon[1666]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 131.362910] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 client # [ 131.379594] nix[1368]: copying 1 paths to 'lb:50051'... client # [ 131.382871] nix[1368]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 131.376569] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 131.384995] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 131.412423] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:47Z level=info event=niks3_push_started pid=1743 worker2 # [ 131.524250] nix-grpc-daemon[1743]: time=2026-09-22T11:26:47.700Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 131.619675] nix-daemon[868]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker2 # [ 131.634188] nix-daemon[868]: reaped child process 1760, status = succeeded worker2 # [ 131.724263] nix-daemon[868]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker2 # [ 131.738492] nix-daemon[868]: reaped child process 1765, status = succeeded lb # [ 131.759479] niks3-server[1111]: 2026/09/22 11:26:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 131.758558] nix-grpc-daemon[1743]: time=2026-09-22T11:26:47.935Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 131.761710] nix-grpc-daemon[1743]: time=2026-09-22T11:26:47.937Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 131.799380] niks3-server[1111]: 2026/09/22 11:26:47 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 131.805493] niks3-server[1111]: 2026/09/22 11:26:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker2 # [ 131.803750] nix-grpc-daemon[1743]: time=2026-09-22T11:26:47.980Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.815183] niks3-server[1111]: 2026/09/22 11:26:47 INFO Signed narinfos id=47 count=1 lb # [ 131.822342] niks3-server[1111]: 2026/09/22 11:26:47 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 131.834535] niks3-server[1111]: 2026/09/22 11:26:47 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 131.840221] niks3-server[1111]: 2026/09/22 11:26:47 INFO Completed upload id=47 worker2 # [ 131.829492] nix-grpc-daemon[1743]: time=2026-09-22T11:26:48.006Z level=INFO msg="Upload complete. (301ms)" lb # [ 131.842778] niks3-server[1111]: 2026/09/22 11:26:47 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 131.833738] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 131.839290] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 131.848859] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 131.856177] nix-daemon[868]: reaped child process 1738, status = succeeded worker2 # [ 131.860265] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) client # [ 131.866655] nix[1368]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 133.646591] systemd[1]: intr.service: Sent signal SIGINT to main process 1368 (nix) on client request. worker2 # [ 133.647047] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:49Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 133.653661] nix[1368]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds) client # [ 133.659610] nix[1368]: [mutex.cc : 2506] RAW: thread should hold at least a read lock on Mutex 0x7b3c7fdfcc68 client # [ 133.670758] systemd-coredump[1382]: Process 1368 (nix) of user 0 terminated abnormally with signal 6/ABRT, processing... client # [ 133.685198] systemd[1]: Created slice Slice /system/systemd-coredump. client # [ 133.688470] systemd[1]: Started Process Core Dump (PID 1382/UID 0). worker2 # [ 133.681680] nix-daemon[868]: reaped child process 1767, status = succeeded worker2 # [ 133.684246] nix-daemon[1769]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 133.692658] nix-daemon[868]: reaped child process 1769, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.50 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 133.751953] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 4517aa6e61b441c28c0bd13c2b903e0a client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.05 seconds) worker2 # [ 134.023362] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49020 client # [ 134.038351] nix[1389]: don't know how to build these paths: client # [ 134.039265] nix[1389]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 134.046147] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:50Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 134.050404] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:50Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 134.092726] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44318 worker1 # [ 134.101625] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44318 client # [ 134.114082] nix[1389]: copying 1 paths to 'lb:50051'... worker1 # [ 134.108765] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44318 client # [ 134.122095] nix[1389]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 134.129719] nix-daemon[847]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) worker1 # [ 134.214202] nix-daemon[847]: accepted connection from pid 1614, user nix-grpc-daemon (trusted) worker1 # [ 134.229340] nix-daemon[847]: reaped child process 1617, status = succeeded worker1 # [ 134.308484] nix-daemon[847]: accepted connection from pid 1619, user nix-grpc-daemon (trusted) worker1 # [ 134.321901] nix-daemon[847]: reaped child process 1622, status = succeeded lb # [ 134.339738] niks3-server[1111]: 2026/09/22 11:26:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 134.338388] nix-grpc-daemon[1521]: time=2026-09-22T11:26:49.548Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 134.339832] nix-grpc-daemon[1521]: time=2026-09-22T11:26:49.548Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 134.370439] niks3-server[1111]: 2026/09/22 11:26:49 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 134.380449] niks3-server[1111]: 2026/09/22 11:26:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 134.386958] niks3-server[1111]: 2026/09/22 11:26:49 INFO Signed narinfos id=48 count=1 worker1 # [ 134.380311] nix-grpc-daemon[1521]: time=2026-09-22T11:26:49.590Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.394664] niks3-server[1111]: 2026/09/22 11:26:49 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 134.408945] niks3-server[1111]: 2026/09/22 11:26:49 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 134.413130] niks3-server[1111]: 2026/09/22 11:26:49 INFO Completed upload id=48 worker1 # [ 134.403075] nix-grpc-daemon[1521]: time=2026-09-22T11:26:49.613Z level=INFO msg="Upload complete. (268ms)" lb # [ 134.414966] niks3-server[1111]: 2026/09/22 11:26:49 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 134.406946] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44318 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 134.412269] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44318 worker1 # [ 134.423184] nix-daemon[847]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) worker1 # [ 134.426729] nix-daemon[847]: reaped child process 1612, status = succeeded client # [ 134.436044] nix[1389]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1 # [ 134.431698] nix-daemon[847]: accepted connection from pid 1453, user nix-grpc-daemon (trusted) lb # [ 134.695067] envoy[896]: conn peer=[2001:db8:1::1]:60838 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3074 tx=1519 ms=9260 worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 135.030486] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 135.058760] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker1 # [ 135.161152] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:50Z level=info event=draining worker2 # [ 135.397831] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49020 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 135.404232] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 135.420743] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 135.423002] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 135.469618] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 135.477674] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 client # copying 1 paths to 'lb:50051'... worker2 # [ 135.485815] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 135.502861] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 135.606378] nix-daemon[868]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker2 # [ 135.620517] nix-daemon[868]: reaped child process 1819, status = succeeded worker2 # [ 135.703535] nix-daemon[868]: accepted connection from pid 1821, user nix-grpc-daemon (trusted) worker2 # [ 135.716588] nix-daemon[868]: reaped child process 1824, status = succeeded lb # [ 135.737073] niks3-server[1111]: 2026/09/22 11:26:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.734695] nix-grpc-daemon[1743]: time=2026-09-22T11:26:51.911Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 135.736254] nix-grpc-daemon[1743]: time=2026-09-22T11:26:51.911Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 135.767606] niks3-server[1111]: 2026/09/22 11:26:51 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 135.774172] niks3-server[1111]: 2026/09/22 11:26:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker2 # [ 135.769438] nix-grpc-daemon[1743]: time=2026-09-22T11:26:51.946Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.781404] niks3-server[1111]: 2026/09/22 11:26:51 INFO Signed narinfos id=49 count=1 lb # [ 135.789559] niks3-server[1111]: 2026/09/22 11:26:51 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 135.794408] niks3-server[1111]: 2026/09/22 11:26:51 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 135.806247] niks3-server[1111]: 2026/09/22 11:26:51 INFO Completed upload id=49 worker2 # [ 135.793873] nix-grpc-daemon[1743]: time=2026-09-22T11:26:51.970Z level=INFO msg="Upload complete. (279ms)" client # [ 135.802499] systemd-coredump[1383]: Cannot store coredump of 1368 (nix): No space left on device lb # [ 135.807954] niks3-server[1111]: 2026/09/22 11:26:51 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 135.795984] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 135.802129] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 135.809743] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 135.816190] nix-daemon[868]: reaped child process 1814, status = succeeded client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker2 # [ 135.820530] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) client # [ 135.886568] systemd-coredump[1383]: Process 1368 (nix) of user 0 terminated abnormally without generating a coredump. client # [ 135.900692] systemd[1]: systemd-coredump@0-1-1382_1383-0.service: Deactivated successfully. client # [ 135.907797] systemd[1]: systemd-coredump@0-1-1382_1383-0.service: Consumed 1.572s CPU time over 2.206s wall clock time, 967.8M memory peak, 929.8M written to disk. client # [ 135.909858] systemd[1]: intr.service: Main process exited, code=dumped, status=6/ABRT client # [ 135.911346] systemd[1]: intr.service: Failed with result 'core-dump'. client # [ 135.912876] systemd[1]: intr.service: Consumed 264ms CPU time over 5.673s wall clock time, 41.6M memory peak, 4K written to disk, 6.4K incoming IP traffic, 8.2K outgoing IP traffic. client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 136.253788] nix-daemon[868]: reaped child process 1828, status = succeeded worker2 # [ 136.337871] nix-daemon[868]: accepted connection from pid 1844, user nix-grpc-daemon (trusted) worker2 # [ 136.349796] nix-daemon[868]: reaped child process 1847, status = succeeded lb # [ 136.368895] niks3-server[1111]: 2026/09/22 11:26:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.365501] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 136.367071] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.544Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 136.404436] niks3-server[1111]: 2026/09/22 11:26:51 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 136.419450] niks3-server[1111]: 2026/09/22 11:26:51 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 136.425527] niks3-server[1111]: 2026/09/22 11:26:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker2 # [ 136.418077] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.595Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.430266] niks3-server[1111]: 2026/09/22 11:26:51 INFO Signed narinfos id=50 count=1 lb # [ 136.435489] niks3-server[1111]: 2026/09/22 11:26:51 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 136.441472] niks3-server[1111]: 2026/09/22 11:26:51 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 136.445302] niks3-server[1111]: 2026/09/22 11:26:51 INFO Completed upload id=50 worker2 # [ 136.433334] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.610Z level=INFO msg="Upload complete. (206ms)" lb # [ 136.447648] niks3-server[1111]: 2026/09/22 11:26:51 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 136.438743] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=1 worker2 # [ 136.447866] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 136.453222] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 136.460467] nix-daemon[868]: reaped child process 1826, status = succeeded worker2 # [ 136.491811] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 136.502886] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 136.513597] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.690Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 136.520335] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 136.531274] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 136.623545] nix-daemon[868]: accepted connection from pid 1853, user nix-grpc-daemon (trusted) worker2 # [ 136.636728] nix-daemon[868]: reaped child process 1856, status = succeeded worker2 # [ 136.720419] nix-daemon[868]: accepted connection from pid 1858, user nix-grpc-daemon (trusted) worker2 # [ 136.733201] nix-daemon[868]: reaped child process 1861, status = succeeded lb # [ 136.752680] niks3-server[1111]: 2026/09/22 11:26:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.745241] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.922Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 136.747285] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.923Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 136.769404] niks3-server[1111]: 2026/09/22 11:26:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 136.772612] niks3-server[1111]: 2026/09/22 11:26:52 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 136.774615] niks3-server[1111]: 2026/09/22 11:26:52 INFO Signed narinfos id=51 count=1 worker2 # [ 136.762659] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.939Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.785780] niks3-server[1111]: 2026/09/22 11:26:52 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 136.793772] niks3-server[1111]: 2026/09/22 11:26:52 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 136.796185] niks3-server[1111]: 2026/09/22 11:26:52 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo lb # [ 136.798951] niks3-server[1111]: 2026/09/22 11:26:52 INFO Completed upload id=51 worker2 # [ 136.786742] nix-grpc-daemon[1743]: time=2026-09-22T11:26:52.963Z level=INFO msg="Upload complete. (246ms)" worker2 # [ 136.789074] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 136.791763] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 136.798842] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 136.801164] nix-daemon[868]: reaped child process 1851, status = succeeded client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker2 # [ 136.806580] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 137.622491] nix-daemon[868]: reaped child process 1865, status = succeeded worker2 # [ 137.697580] nix-daemon[868]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker2 # [ 137.709348] nix-daemon[868]: reaped child process 1884, status = succeeded lb # [ 137.729059] niks3-server[1111]: 2026/09/22 11:26:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.725196] nix-grpc-daemon[1743]: time=2026-09-22T11:26:53.902Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 137.726708] nix-grpc-daemon[1743]: time=2026-09-22T11:26:53.903Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 137.759229] niks3-server[1111]: 2026/09/22 11:26:53 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 137.776431] niks3-server[1111]: 2026/09/22 11:26:53 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 137.791446] niks3-server[1111]: 2026/09/22 11:26:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 137.795325] niks3-server[1111]: 2026/09/22 11:26:53 INFO Signed narinfos id=52 count=1 worker2 # [ 137.785907] nix-grpc-daemon[1743]: time=2026-09-22T11:26:53.962Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.800431] niks3-server[1111]: 2026/09/22 11:26:53 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 137.811248] niks3-server[1111]: 2026/09/22 11:26:53 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 137.815271] niks3-server[1111]: 2026/09/22 11:26:53 INFO Completed upload id=52 worker2 # [ 137.803169] nix-grpc-daemon[1743]: time=2026-09-22T11:26:53.980Z level=INFO msg="Upload complete. (189ms)" lb # [ 137.818370] niks3-server[1111]: 2026/09/22 11:26:53 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 137.811779] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=1 worker2 # [ 137.821463] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:53Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 137.825203] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:53Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 137.834759] nix-daemon[868]: reaped child process 1863, status = succeeded worker2 # [ 137.864278] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 137.876694] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 137.889717] nix-grpc-daemon[1743]: time=2026-09-22T11:26:54.066Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 137.898291] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 137.906552] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 138.002959] nix-daemon[868]: accepted connection from pid 1890, user nix-grpc-daemon (trusted) worker2 # [ 138.016734] nix-daemon[868]: reaped child process 1893, status = succeeded worker2 # [ 138.097377] nix-daemon[868]: accepted connection from pid 1895, user nix-grpc-daemon (trusted) worker2 # [ 138.110454] nix-daemon[868]: reaped child process 1898, status = succeeded lb # [ 138.129122] niks3-server[1111]: 2026/09/22 11:26:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 138.124372] nix-grpc-daemon[1743]: time=2026-09-22T11:26:54.301Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 138.125875] nix-grpc-daemon[1743]: time=2026-09-22T11:26:54.302Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 138.159573] niks3-server[1111]: 2026/09/22 11:26:53 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 138.167270] niks3-server[1111]: 2026/09/22 11:26:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 138.172859] niks3-server[1111]: 2026/09/22 11:26:53 INFO Signed narinfos id=53 count=1 worker2 # [ 138.164147] nix-grpc-daemon[1743]: time=2026-09-22T11:26:54.340Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.189081] niks3-server[1111]: 2026/09/22 11:26:53 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 138.193107] niks3-server[1111]: 2026/09/22 11:26:53 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 138.200316] niks3-server[1111]: 2026/09/22 11:26:53 INFO Completed upload id=53 worker2 # [ 138.187888] nix-grpc-daemon[1743]: time=2026-09-22T11:26:54.364Z level=INFO msg="Upload complete. (268ms)" lb # [ 138.204304] niks3-server[1111]: 2026/09/22 11:26:53 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 138.191478] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 138.197252] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 138.207590] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 138.213099] nix-daemon[868]: reaped child process 1888, status = succeeded worker2 # [ 138.216058] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 139.234194] nix-daemon[868]: reaped child process 1902, status = succeeded worker2 # [ 139.306449] nix-daemon[868]: accepted connection from pid 1918, user nix-grpc-daemon (trusted) worker2 # [ 139.319362] nix-daemon[868]: reaped child process 1921, status = succeeded lb # [ 139.338314] niks3-server[1111]: 2026/09/22 11:26:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 139.334272] nix-grpc-daemon[1743]: time=2026-09-22T11:26:55.511Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 139.335805] nix-grpc-daemon[1743]: time=2026-09-22T11:26:55.512Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 139.372153] niks3-server[1111]: 2026/09/22 11:26:54 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 139.383675] niks3-server[1111]: 2026/09/22 11:26:54 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 139.396211] niks3-server[1111]: 2026/09/22 11:26:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 139.400273] niks3-server[1111]: 2026/09/22 11:26:54 INFO Signed narinfos id=54 count=1 worker2 # [ 139.388477] nix-grpc-daemon[1743]: time=2026-09-22T11:26:55.565Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.408471] niks3-server[1111]: 2026/09/22 11:26:54 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 139.416073] niks3-server[1111]: 2026/09/22 11:26:54 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 139.420055] niks3-server[1111]: 2026/09/22 11:26:54 INFO Completed upload id=54 worker2 # [ 139.408079] nix-grpc-daemon[1743]: time=2026-09-22T11:26:55.585Z level=INFO msg="Upload complete. (184ms)" lb # [ 139.422565] niks3-server[1111]: 2026/09/22 11:26:54 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 139.415898] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=1 worker2 # [ 139.428423] nix-daemon[868]: reaped child process 1900, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.35 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 139.652565] nix-daemon[847]: reaped child process 1626, status = succeeded worker1 # [ 139.721947] nix-daemon[847]: accepted connection from pid 1663, user nix-grpc-daemon (trusted) worker1 # [ 139.735537] nix-daemon[847]: reaped child process 1666, status = succeeded lb # [ 139.752320] niks3-server[1111]: 2026/09/22 11:26:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.750157] nix-grpc-daemon[1521]: time=2026-09-22T11:26:54.960Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.751710] nix-grpc-daemon[1521]: time=2026-09-22T11:26:54.962Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 139.794225] niks3-server[1111]: 2026/09/22 11:26:55 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 139.804646] niks3-server[1111]: 2026/09/22 11:26:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 139.811344] niks3-server[1111]: 2026/09/22 11:26:55 INFO Signed narinfos id=55 count=1 worker1 # [ 139.804814] nix-grpc-daemon[1521]: time=2026-09-22T11:26:55.014Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.817054] niks3-server[1111]: 2026/09/22 11:26:55 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 139.820626] niks3-server[1111]: 2026/09/22 11:26:55 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 139.831758] niks3-server[1111]: 2026/09/22 11:26:55 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 139.834442] niks3-server[1111]: 2026/09/22 11:26:55 INFO Completed upload id=55 worker1 # [ 139.824307] nix-grpc-daemon[1521]: time=2026-09-22T11:26:55.034Z level=INFO msg="Upload complete. (182ms)" lb # [ 139.836284] niks3-server[1111]: 2026/09/22 11:26:55 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 139.826965] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44318 duration_s=5 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=1 worker1 # [ 139.834826] nix-daemon[847]: reaped child process 1624, status = succeeded client # [ 139.864559] systemd[1]: sw.service: Deactivated successfully. client # [ 139.868070] systemd[1]: sw.service: Consumed 153ms CPU time over 6.115s wall clock time, 41.5M memory peak, 4K written to disk, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 140.163139] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:55Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.04 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.02 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 141.171274] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49012 worker2 # [ 141.175171] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:57Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 141.177508] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:56Z level=info event=scheduler_restarting worker1 # [ 141.186581] nix-grpc-daemon[1453]: ts=2026-09-22T11:26:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 141.209246] nix-daemon[847]: reaped child process 1509, status = succeeded worker1 # [ 141.396616] nix-grpc-daemon[1453]: E0000 00:00:1790076416.606776 1498 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 141.404342] nix-grpc-daemon[1453]: E0000 00:00:1790076416.614634 1498 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 143.179781] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 143.181528] systemd[1]: nix-grpc-daemon.service: Consumed 753ms CPU time over 24.138s wall clock time, 36.8M memory peak, 24.7K incoming IP traffic, 34.4K outgoing IP traffic. worker1 # [ 143.188429] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 143.267739] nix-grpc-daemon[1680]: ts=2026-09-22T11:26:58Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 143.272116] nix-grpc-daemon[1680]: ts=2026-09-22T11:26:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 143.276970] nix-grpc-daemon[1680]: ts=2026-09-22T11:26:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 143.281102] nix-grpc-daemon[1680]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 143.285433] nix-grpc-daemon[1680]: E0000 00:00:1790076418.485101 1680 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 143.288659] nix-grpc-daemon[1680]: E0000 00:00:1790076418.487135 1680 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 143.291583] nix-grpc-daemon[1680]: ts=2026-09-22T11:26:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 143.295144] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 143.296034] nix-grpc-daemon[1680]: E0000 00:00:1790076418.503881 1721 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 143.310070] nix-grpc-daemon[1680]: E0000 00:00:1790076418.518045 1721 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 143.313138] nix-grpc-daemon[1680]: E0000 00:00:1790076418.518138 1721 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.67 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 143.323322] nix-grpc-daemon[1680]: E0000 00:00:1790076418.533671 1721 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 143.336408] nix-grpc-daemon[1680]: ts=2026-09-22T11:26:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 143.337671] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:49012 worker2 # [ 143.341641] nix-grpc-daemon[1666]: ts=2026-09-22T11:26:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 10.76 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 144.608861] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 144.615292] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 144.653241] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:00Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 144.655222] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:00Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 144.657039] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:00Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 144.658605] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:00Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 lb # [ 144.695487] envoy[896]: conn peer=[2001:db8:1::1]:52794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554536:system_library:OPENSSL_internal:Connection_reset_by_peer:TLS_error_end" rx=2993 tx=914 ms=5550 lb # [ 144.701370] envoy[896]: conn peer=[2001:db8:1::1]:45092 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9512 tx=4027 ms=4040 lb # [ 144.704956] envoy[896]: conn peer=[2001:db8:1::1]:45080 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=1402 ms=5825 lb # [ 144.708586] envoy[896]: conn peer=[2001:db8:1::3]:37894 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1762 tx=503 ms=21981 worker1 # [ 144.710396] nix-grpc-daemon[1680]: ts=2026-09-22T11:26:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 144.721677] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 144.737886] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5) worker1 # [ 144.795651] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 2/5) worker1 # [ 144.842468] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 355 ms (attempt 3/5) worker1 # [ 145.199593] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 787 ms (attempt 4/5) worker1 # [ 145.989905] nix-grpc-daemon[1680]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 145.993941] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 146.011124] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 146.024331] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 146.035666] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 146.054923] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:01Z level=info event=niks3_push_started pid=1740 worker1 # [ 146.155493] nix-grpc-daemon[1740]: time=2026-09-22T11:27:01.365Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 146.244150] nix-daemon[847]: accepted connection from pid 1753, user nix-grpc-daemon (trusted) worker1 # [ 146.257541] nix-daemon[847]: reaped child process 1756, status = succeeded worker1 # [ 146.338132] nix-daemon[847]: accepted connection from pid 1758, user nix-grpc-daemon (trusted) worker1 # [ 146.351903] nix-daemon[847]: reaped child process 1761, status = succeeded lb # [ 146.368900] niks3-server[1111]: 2026/09/22 11:27:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.367769] nix-grpc-daemon[1740]: time=2026-09-22T11:27:01.577Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.369153] nix-grpc-daemon[1740]: time=2026-09-22T11:27:01.577Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 146.404176] niks3-server[1111]: 2026/09/22 11:27:01 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 146.410728] niks3-server[1111]: 2026/09/22 11:27:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 146.406719] nix-grpc-daemon[1740]: time=2026-09-22T11:27:01.616Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.416687] niks3-server[1111]: 2026/09/22 11:27:01 INFO Signed narinfos id=56 count=1 lb # [ 146.431089] niks3-server[1111]: 2026/09/22 11:27:01 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 146.433755] niks3-server[1111]: 2026/09/22 11:27:01 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 146.438288] niks3-server[1111]: 2026/09/22 11:27:01 INFO Completed upload id=56 worker1 # [ 146.427670] nix-grpc-daemon[1740]: time=2026-09-22T11:27:01.638Z level=INFO msg="Upload complete. (268ms)" lb # [ 146.440238] niks3-server[1111]: 2026/09/22 11:27:01 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 146.429770] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 146.434490] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 146.441245] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 146.442612] nix-daemon[847]: reaped child process 1738, status = succeeded worker1 # [ 146.447906] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 147.693664] nix-daemon[847]: reaped child process 1765, status = succeeded worker1 # [ 147.768733] nix-daemon[847]: accepted connection from pid 1781, user nix-grpc-daemon (trusted) worker1 # [ 147.781846] nix-daemon[847]: reaped child process 1784, status = succeeded lb # [ 147.799827] niks3-server[1111]: 2026/09/22 11:27:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.797584] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.007Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.799386] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.009Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 147.831266] niks3-server[1111]: 2026/09/22 11:27:03 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 147.846109] niks3-server[1111]: 2026/09/22 11:27:03 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 147.856621] niks3-server[1111]: 2026/09/22 11:27:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 147.853865] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.063Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.863655] niks3-server[1111]: 2026/09/22 11:27:03 INFO Signed narinfos id=57 count=1 lb # [ 147.876324] niks3-server[1111]: 2026/09/22 11:27:03 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 147.879751] niks3-server[1111]: 2026/09/22 11:27:03 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 147.882927] niks3-server[1111]: 2026/09/22 11:27:03 INFO Completed upload id=57 worker1 # [ 147.873921] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.084Z level=INFO msg="Upload complete. (216ms)" lb # [ 147.885212] niks3-server[1111]: 2026/09/22 11:27:03 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 147.877338] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=1 worker1 # [ 147.884764] nix-daemon[847]: reaped child process 1763, status = succeeded worker2 # [ 147.877837] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:04Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 147.886866] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:04Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 147.922553] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 147.930131] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 147.936786] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 147.941851] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 148.029134] nix-daemon[847]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) worker1 # [ 148.044054] nix-daemon[847]: reaped child process 1791, status = succeeded worker1 # [ 148.126266] nix-daemon[847]: accepted connection from pid 1793, user nix-grpc-daemon (trusted) worker1 # [ 148.140665] nix-daemon[847]: reaped child process 1796, status = succeeded lb # [ 148.156644] niks3-server[1111]: 2026/09/22 11:27:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.154249] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.364Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.155689] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.364Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 148.185550] niks3-server[1111]: 2026/09/22 11:27:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 148.192122] niks3-server[1111]: 2026/09/22 11:27:03 INFO Signed narinfos id=58 count=1 worker1 # [ 148.185054] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.395Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.200601] niks3-server[1111]: 2026/09/22 11:27:03 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 148.207569] niks3-server[1111]: 2026/09/22 11:27:03 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 148.219488] niks3-server[1111]: 2026/09/22 11:27:03 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 148.213399] nix-grpc-daemon[1740]: time=2026-09-22T11:27:03.423Z level=INFO msg="Upload complete. (266ms)" lb # [ 148.223621] niks3-server[1111]: 2026/09/22 11:27:03 INFO Completed upload id=58 worker1 # [ 148.216075] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 148.219133] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 lb # [ 148.231242] niks3-server[1111]: 2026/09/22 11:27:03 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 148.226258] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 148.229161] nix-daemon[847]: reaped child process 1786, status = succeeded worker1 # [ 148.234199] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 149.452154] nix-daemon[847]: reaped child process 1800, status = succeeded worker1 # [ 149.525217] nix-daemon[847]: accepted connection from pid 1816, user nix-grpc-daemon (trusted) worker1 # [ 149.539067] nix-daemon[847]: reaped child process 1819, status = succeeded lb # [ 149.555922] niks3-server[1111]: 2026/09/22 11:27:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.552628] nix-grpc-daemon[1740]: time=2026-09-22T11:27:04.762Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.554153] nix-grpc-daemon[1740]: time=2026-09-22T11:27:04.764Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 149.586140] niks3-server[1111]: 2026/09/22 11:27:05 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 149.595894] niks3-server[1111]: 2026/09/22 11:27:05 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 149.606861] niks3-server[1111]: 2026/09/22 11:27:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 149.600898] nix-grpc-daemon[1740]: time=2026-09-22T11:27:04.811Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.611444] niks3-server[1111]: 2026/09/22 11:27:05 INFO Signed narinfos id=59 count=1 lb # [ 149.616903] niks3-server[1111]: 2026/09/22 11:27:05 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 149.622879] niks3-server[1111]: 2026/09/22 11:27:05 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 149.625566] niks3-server[1111]: 2026/09/22 11:27:05 INFO Completed upload id=59 worker1 # [ 149.615297] nix-grpc-daemon[1740]: time=2026-09-22T11:27:04.825Z level=INFO msg="Upload complete. (174ms)" worker1 # [ 149.619064] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=1 worker2 # [ 149.617780] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:05Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 149.625113] nix-daemon[847]: reaped child process 1798, status = succeeded worker2 # [ 149.627374] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:05Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 149.668936] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 149.677087] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 149.684679] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 149.688453] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 149.776324] nix-daemon[847]: accepted connection from pid 1823, user nix-grpc-daemon (trusted) worker1 # [ 149.789645] nix-daemon[847]: reaped child process 1826, status = succeeded worker1 # [ 149.875194] nix-daemon[847]: accepted connection from pid 1828, user nix-grpc-daemon (trusted) worker1 # [ 149.889502] nix-daemon[847]: reaped child process 1831, status = succeeded lb # [ 149.905656] niks3-server[1111]: 2026/09/22 11:27:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.903620] nix-grpc-daemon[1740]: time=2026-09-22T11:27:05.113Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.904975] nix-grpc-daemon[1740]: time=2026-09-22T11:27:05.113Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 149.931528] niks3-server[1111]: 2026/09/22 11:27:05 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 149.942105] niks3-server[1111]: 2026/09/22 11:27:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 149.947680] niks3-server[1111]: 2026/09/22 11:27:05 INFO Signed narinfos id=60 count=1 worker1 # [ 149.940528] nix-grpc-daemon[1740]: time=2026-09-22T11:27:05.150Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.957107] niks3-server[1111]: 2026/09/22 11:27:05 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 149.968066] niks3-server[1111]: 2026/09/22 11:27:05 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 149.965078] nix-grpc-daemon[1740]: time=2026-09-22T11:27:05.175Z level=INFO msg="Upload complete. (270ms)" lb # [ 149.975445] niks3-server[1111]: 2026/09/22 11:27:05 INFO Completed upload id=60 worker1 # [ 149.967109] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 149.978481] niks3-server[1111]: 2026/09/22 11:27:05 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 149.970772] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 149.977755] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 149.980132] nix-daemon[847]: reaped child process 1821, status = succeeded worker1 # [ 149.985257] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 151.024597] nix-daemon[847]: reaped child process 1835, status = succeeded worker1 # [ 151.110081] nix-daemon[847]: accepted connection from pid 1851, user nix-grpc-daemon (trusted) worker1 # [ 151.123947] nix-daemon[847]: reaped child process 1854, status = succeeded lb # [ 151.143506] niks3-server[1111]: 2026/09/22 11:27:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.142548] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.352Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.144614] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.354Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 151.180898] niks3-server[1111]: 2026/09/22 11:27:06 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 151.194708] niks3-server[1111]: 2026/09/22 11:27:06 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 151.206582] niks3-server[1111]: 2026/09/22 11:27:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 151.202474] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.412Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.212971] niks3-server[1111]: 2026/09/22 11:27:06 INFO Signed narinfos id=61 count=1 lb # [ 151.218097] niks3-server[1111]: 2026/09/22 11:27:06 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 151.227759] niks3-server[1111]: 2026/09/22 11:27:06 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 151.232588] niks3-server[1111]: 2026/09/22 11:27:06 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo lb # [ 151.235769] niks3-server[1111]: 2026/09/22 11:27:06 INFO Completed upload id=61 worker1 # [ 151.225673] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.436Z level=INFO msg="Upload complete. (233ms)" worker1 # [ 151.228471] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=1 worker2 # [ 151.228378] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:07Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 151.237112] nix-daemon[847]: reaped child process 1833, status = succeeded worker2 # [ 151.239095] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:07Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 151.280237] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 151.288728] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 151.297559] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.507Z level=INFO msg="All 1 paths already cached" worker1 # [ 151.301957] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 151.305727] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 151.392598] nix-daemon[847]: accepted connection from pid 1858, user nix-grpc-daemon (trusted) worker1 # [ 151.408662] nix-daemon[847]: reaped child process 1861, status = succeeded worker1 # [ 151.486109] nix-daemon[847]: accepted connection from pid 1863, user nix-grpc-daemon (trusted) worker1 # [ 151.500595] nix-daemon[847]: reaped child process 1866, status = succeeded lb # [ 151.516131] niks3-server[1111]: 2026/09/22 11:27:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.513841] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.723Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 151.515164] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.724Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 151.542919] niks3-server[1111]: 2026/09/22 11:27:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 151.539972] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.750Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.550413] niks3-server[1111]: 2026/09/22 11:27:06 INFO Signed narinfos id=62 count=1 lb # [ 151.558713] niks3-server[1111]: 2026/09/22 11:27:06 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 151.571373] niks3-server[1111]: 2026/09/22 11:27:07 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete worker1 # [ 151.570095] nix-grpc-daemon[1740]: time=2026-09-22T11:27:06.780Z level=INFO msg="Upload complete. (258ms)" lb # [ 151.580601] niks3-server[1111]: 2026/09/22 11:27:07 INFO Completed upload id=62 worker1 # [ 151.572228] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 151.584178] niks3-server[1111]: 2026/09/22 11:27:07 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls worker1 # [ 151.578573] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 lb # [ 151.588797] niks3-server[1111]: 2026/09/22 11:27:07 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 151.583206] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 151.585587] nix-daemon[847]: reaped child process 1856, status = succeeded worker1 # [ 151.590875] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 152.830934] nix-daemon[847]: reaped child process 1870, status = succeeded worker1 # [ 152.910860] nix-daemon[847]: accepted connection from pid 1886, user nix-grpc-daemon (trusted) worker1 # [ 152.923080] nix-daemon[847]: reaped child process 1889, status = succeeded lb # [ 152.939478] niks3-server[1111]: 2026/09/22 11:27:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.939473] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.149Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.944062] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.151Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 152.976330] niks3-server[1111]: 2026/09/22 11:27:08 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 152.995303] niks3-server[1111]: 2026/09/22 11:27:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 153.000780] niks3-server[1111]: 2026/09/22 11:27:08 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 153.005389] niks3-server[1111]: 2026/09/22 11:27:08 INFO Signed narinfos id=63 count=1 worker1 # [ 152.995120] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.205Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.013202] niks3-server[1111]: 2026/09/22 11:27:08 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 153.021792] niks3-server[1111]: 2026/09/22 11:27:08 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 153.024326] niks3-server[1111]: 2026/09/22 11:27:08 INFO Completed upload id=63 lb # [ 153.026135] niks3-server[1111]: 2026/09/22 11:27:08 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 153.015479] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.225Z level=INFO msg="Upload complete. (217ms)" worker2 # [ 153.021261] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:09Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.023441] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=1 worker2 # [ 153.029177] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:09Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 153.037198] nix-daemon[847]: reaped child process 1868, status = succeeded worker1 # [ 153.065106] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 153.076946] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 153.090300] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.300Z level=INFO msg="All 1 paths already cached" worker1 # [ 153.097135] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 153.105176] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 153.205552] nix-daemon[847]: accepted connection from pid 1893, user nix-grpc-daemon (trusted) worker1 # [ 153.218847] nix-daemon[847]: reaped child process 1896, status = succeeded worker1 # [ 153.304707] nix-daemon[847]: accepted connection from pid 1898, user nix-grpc-daemon (trusted) worker1 # [ 153.317833] nix-daemon[847]: reaped child process 1901, status = succeeded lb # [ 153.335251] niks3-server[1111]: 2026/09/22 11:27:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.332480] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.542Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 153.333854] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.542Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 153.359073] niks3-server[1111]: 2026/09/22 11:27:08 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 153.372839] niks3-server[1111]: 2026/09/22 11:27:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 153.368636] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.578Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.378596] niks3-server[1111]: 2026/09/22 11:27:08 INFO Signed narinfos id=64 count=1 lb # [ 153.383375] niks3-server[1111]: 2026/09/22 11:27:08 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 153.396689] niks3-server[1111]: 2026/09/22 11:27:08 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete worker1 # [ 153.391023] nix-grpc-daemon[1740]: time=2026-09-22T11:27:08.601Z level=INFO msg="Upload complete. (273ms)" lb # [ 153.401971] niks3-server[1111]: 2026/09/22 11:27:08 INFO Completed upload id=64 worker1 # [ 153.393441] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 153.396862] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 lb # [ 153.407479] niks3-server[1111]: 2026/09/22 11:27:08 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 153.403317] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 153.411345] nix-daemon[847]: reaped child process 1891, status = succeeded worker1 # [ 153.414792] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 154.631745] nix-daemon[847]: reaped child process 1905, status = succeeded worker1 # [ 154.709910] nix-daemon[847]: accepted connection from pid 1921, user nix-grpc-daemon (trusted) worker1 # [ 154.723675] nix-daemon[847]: reaped child process 1924, status = succeeded lb # [ 154.741642] niks3-server[1111]: 2026/09/22 11:27:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.739273] nix-grpc-daemon[1740]: time=2026-09-22T11:27:09.949Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.740942] nix-grpc-daemon[1740]: time=2026-09-22T11:27:09.951Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 154.776579] niks3-server[1111]: 2026/09/22 11:27:10 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 154.790292] niks3-server[1111]: 2026/09/22 11:27:10 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 154.801451] niks3-server[1111]: 2026/09/22 11:27:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 154.806883] niks3-server[1111]: 2026/09/22 11:27:10 INFO Signed narinfos id=65 count=1 worker1 # [ 154.800138] nix-grpc-daemon[1740]: time=2026-09-22T11:27:10.010Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.813725] niks3-server[1111]: 2026/09/22 11:27:10 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 154.821875] niks3-server[1111]: 2026/09/22 11:27:10 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 154.825837] niks3-server[1111]: 2026/09/22 11:27:10 INFO Completed upload id=65 worker1 # [ 154.815709] nix-grpc-daemon[1740]: time=2026-09-22T11:27:10.026Z level=INFO msg="Upload complete. (192ms)" lb # [ 154.827478] niks3-server[1111]: 2026/09/22 11:27:10 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 154.820596] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=1 worker2 # [ 154.821199] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:10Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.827734] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker2 # [ 154.828605] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:11Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 154.836594] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 154.844690] nix-daemon[847]: reaped child process 1903, status = succeeded worker1 # [ 154.846201] nix-grpc-daemon[1740]: time=2026-09-22T11:27:10.056Z level=INFO msg="All 1 paths already cached" worker1 # [ 154.849756] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 154.853578] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 154.943038] nix-daemon[847]: accepted connection from pid 1928, user nix-grpc-daemon (trusted) worker1 # [ 154.956581] nix-daemon[847]: reaped child process 1931, status = succeeded worker1 # [ 155.043168] nix-daemon[847]: accepted connection from pid 1933, user nix-grpc-daemon (trusted) worker1 # [ 155.057137] nix-daemon[847]: reaped child process 1936, status = succeeded lb # [ 155.074073] niks3-server[1111]: 2026/09/22 11:27:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.070955] nix-grpc-daemon[1740]: time=2026-09-22T11:27:10.281Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.072473] nix-grpc-daemon[1740]: time=2026-09-22T11:27:10.282Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 155.104834] niks3-server[1111]: 2026/09/22 11:27:10 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 155.112353] niks3-server[1111]: 2026/09/22 11:27:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 155.116844] niks3-server[1111]: 2026/09/22 11:27:10 INFO Signed narinfos id=66 count=1 worker1 # [ 155.109465] nix-grpc-daemon[1740]: time=2026-09-22T11:27:10.319Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.126317] niks3-server[1111]: 2026/09/22 11:27:10 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 155.136078] niks3-server[1111]: 2026/09/22 11:27:10 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 155.140536] niks3-server[1111]: 2026/09/22 11:27:10 INFO Completed upload id=66 worker1 # [ 155.133075] nix-grpc-daemon[1740]: time=2026-09-22T11:27:10.343Z level=INFO msg="Upload complete. (273ms)" worker1 # [ 155.135220] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 155.146964] niks3-server[1111]: 2026/09/22 11:27:10 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 155.141494] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 155.146401] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 155.148720] nix-daemon[847]: reaped child process 1926, status = succeeded worker1 # [ 155.153904] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 155.769414] nix-daemon[847]: reaped child process 1940, status = succeeded worker1 # [ 155.840221] nix-daemon[847]: accepted connection from pid 1956, user nix-grpc-daemon (trusted) worker1 # [ 155.853952] nix-daemon[847]: reaped child process 1959, status = succeeded lb # [ 155.868467] niks3-server[1111]: 2026/09/22 11:27:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.867042] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.077Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.869545] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.078Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 155.904132] niks3-server[1111]: 2026/09/22 11:27:11 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 155.914736] niks3-server[1111]: 2026/09/22 11:27:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker1 # [ 155.909510] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.119Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.920448] niks3-server[1111]: 2026/09/22 11:27:11 INFO Signed narinfos id=67 count=1 lb # [ 155.926161] niks3-server[1111]: 2026/09/22 11:27:11 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 155.933924] niks3-server[1111]: 2026/09/22 11:27:11 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 155.943154] niks3-server[1111]: 2026/09/22 11:27:11 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 155.947692] niks3-server[1111]: 2026/09/22 11:27:11 INFO Completed upload id=67 lb # [ 155.949613] niks3-server[1111]: 2026/09/22 11:27:11 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 155.938989] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.149Z level=INFO msg="Upload complete. (178ms)" worker2 # [ 155.946379] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:12Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.947986] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=1 worker1 # [ 155.954139] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker2 # [ 155.953288] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:12Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 155.965539] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 155.973248] nix-daemon[847]: reaped child process 1938, status = succeeded worker1 # [ 155.976148] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.185Z level=INFO msg="All 2 paths already cached" worker1 # [ 155.979767] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 155.985811] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 156.065480] nix-daemon[847]: accepted connection from pid 1963, user nix-grpc-daemon (trusted) worker1 # [ 156.079225] nix-daemon[847]: reaped child process 1966, status = succeeded worker1 # [ 156.154259] nix-daemon[847]: accepted connection from pid 1968, user nix-grpc-daemon (trusted) worker1 # [ 156.168567] nix-daemon[847]: reaped child process 1971, status = succeeded lb # [ 156.184226] niks3-server[1111]: 2026/09/22 11:27:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.182205] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.392Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 156.183573] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.392Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 156.214495] niks3-server[1111]: 2026/09/22 11:27:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 156.220671] niks3-server[1111]: 2026/09/22 11:27:11 INFO Signed narinfos id=68 count=1 worker1 # [ 156.216726] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.426Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.230635] niks3-server[1111]: 2026/09/22 11:27:11 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 156.235261] niks3-server[1111]: 2026/09/22 11:27:11 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 156.248250] niks3-server[1111]: 2026/09/22 11:27:11 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 156.253343] niks3-server[1111]: 2026/09/22 11:27:11 INFO Completed upload id=68 worker1 # [ 156.245413] nix-grpc-daemon[1740]: time=2026-09-22T11:27:11.455Z level=INFO msg="Upload complete. (254ms)" worker1 # [ 156.248234] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 156.259530] niks3-server[1111]: 2026/09/22 11:27:11 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 156.253882] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 156.262534] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 156.270306] nix-daemon[847]: reaped child process 1961, status = succeeded worker1 # [ 156.273535] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 157.490517] nix-daemon[847]: reaped child process 1975, status = succeeded worker1 # [ 157.563136] nix-daemon[847]: accepted connection from pid 1991, user nix-grpc-daemon (trusted) worker1 # [ 157.577410] nix-daemon[847]: reaped child process 1994, status = succeeded lb # [ 157.593780] niks3-server[1111]: 2026/09/22 11:27:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.591210] nix-grpc-daemon[1740]: time=2026-09-22T11:27:12.801Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 157.594059] nix-grpc-daemon[1740]: time=2026-09-22T11:27:12.803Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 157.631719] niks3-server[1111]: 2026/09/22 11:27:13 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 157.640222] niks3-server[1111]: 2026/09/22 11:27:13 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 157.653891] niks3-server[1111]: 2026/09/22 11:27:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker1 # [ 157.649404] nix-grpc-daemon[1740]: time=2026-09-22T11:27:12.859Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.658985] niks3-server[1111]: 2026/09/22 11:27:13 INFO Signed narinfos id=69 count=1 lb # [ 157.666515] niks3-server[1111]: 2026/09/22 11:27:13 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 157.677542] niks3-server[1111]: 2026/09/22 11:27:13 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 157.680962] niks3-server[1111]: 2026/09/22 11:27:13 INFO Completed upload id=69 worker1 # [ 157.671085] nix-grpc-daemon[1740]: time=2026-09-22T11:27:12.881Z level=INFO msg="Upload complete. (190ms)" lb # [ 157.683729] niks3-server[1111]: 2026/09/22 11:27:13 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 157.676572] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=1 worker2 # [ 157.675694] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:13Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.691611] nix-daemon[847]: reaped child process 1973, status = succeeded worker1 # [ 157.720894] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 157.732458] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 157.744515] nix-grpc-daemon[1740]: time=2026-09-22T11:27:12.954Z level=INFO msg="All 2 paths already cached" worker1 # [ 157.751128] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 157.760164] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 157.858158] nix-daemon[847]: accepted connection from pid 1998, user nix-grpc-daemon (trusted) worker1 # [ 157.872117] nix-daemon[847]: reaped child process 2001, status = succeeded worker1 # [ 157.954193] nix-daemon[847]: accepted connection from pid 2003, user nix-grpc-daemon (trusted) worker1 # [ 157.967045] nix-daemon[847]: reaped child process 2006, status = succeeded lb # [ 157.984347] niks3-server[1111]: 2026/09/22 11:27:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.982586] nix-grpc-daemon[1740]: time=2026-09-22T11:27:13.192Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 157.983928] nix-grpc-daemon[1740]: time=2026-09-22T11:27:13.192Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 158.011282] niks3-server[1111]: 2026/09/22 11:27:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 158.021124] niks3-server[1111]: 2026/09/22 11:27:13 INFO Signed narinfos id=70 count=1 worker1 # [ 158.013956] nix-grpc-daemon[1740]: time=2026-09-22T11:27:13.224Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.026643] niks3-server[1111]: 2026/09/22 11:27:13 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 158.032232] niks3-server[1111]: 2026/09/22 11:27:13 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 158.045607] niks3-server[1111]: 2026/09/22 11:27:13 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete worker1 # [ 158.041051] nix-grpc-daemon[1740]: time=2026-09-22T11:27:13.251Z level=INFO msg="Upload complete. (269ms)" lb # [ 158.051272] niks3-server[1111]: 2026/09/22 11:27:13 INFO Completed upload id=70 worker1 # [ 158.043142] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 158.057537] niks3-server[1111]: 2026/09/22 11:27:13 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 158.047492] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 158.055051] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 158.062237] nix-daemon[847]: reaped child process 1996, status = succeeded worker1 # [ 158.065169] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 159.104969] nix-daemon[847]: reaped child process 2010, status = succeeded worker1 # [ 159.170209] nix-daemon[847]: accepted connection from pid 2026, user nix-grpc-daemon (trusted) worker1 # [ 159.184205] nix-daemon[847]: reaped child process 2029, status = succeeded lb # [ 159.201732] niks3-server[1111]: 2026/09/22 11:27:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.199254] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.409Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.200866] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.411Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 159.237785] niks3-server[1111]: 2026/09/22 11:27:14 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 159.249598] niks3-server[1111]: 2026/09/22 11:27:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 159.255799] niks3-server[1111]: 2026/09/22 11:27:14 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst worker1 # [ 159.252470] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.462Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.262955] niks3-server[1111]: 2026/09/22 11:27:14 INFO Signed narinfos id=71 count=1 lb # [ 159.268423] niks3-server[1111]: 2026/09/22 11:27:14 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 159.279455] niks3-server[1111]: 2026/09/22 11:27:14 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 159.283884] niks3-server[1111]: 2026/09/22 11:27:14 INFO Completed upload id=71 lb # [ 159.285638] niks3-server[1111]: 2026/09/22 11:27:14 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 159.275154] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.485Z level=INFO msg="Upload complete. (202ms)" worker2 # [ 159.279932] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:15Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.280905] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=1 worker1 # [ 159.290390] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 159.302549] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 159.308437] nix-daemon[847]: reaped child process 2008, status = succeeded worker1 # [ 159.314453] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.524Z level=INFO msg="All 2 paths already cached" worker1 # [ 159.320700] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 159.327275] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 159.413893] nix-daemon[847]: accepted connection from pid 2033, user nix-grpc-daemon (trusted) worker1 # [ 159.429573] nix-daemon[847]: reaped child process 2036, status = succeeded worker1 # [ 159.508826] nix-daemon[847]: accepted connection from pid 2038, user nix-grpc-daemon (trusted) worker1 # [ 159.522044] nix-daemon[847]: reaped child process 2041, status = succeeded lb # [ 159.539467] niks3-server[1111]: 2026/09/22 11:27:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.536081] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.746Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.537565] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.747Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 159.569473] niks3-server[1111]: 2026/09/22 11:27:15 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 159.578368] niks3-server[1111]: 2026/09/22 11:27:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 159.584138] niks3-server[1111]: 2026/09/22 11:27:15 INFO Signed narinfos id=72 count=1 worker1 # [ 159.576675] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.593211] niks3-server[1111]: 2026/09/22 11:27:15 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 159.605293] niks3-server[1111]: 2026/09/22 11:27:15 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 159.610540] niks3-server[1111]: 2026/09/22 11:27:15 INFO Completed upload id=72 worker1 # [ 159.600117] nix-grpc-daemon[1740]: time=2026-09-22T11:27:14.810Z level=INFO msg="Upload complete. (266ms)" lb # [ 159.614803] niks3-server[1111]: 2026/09/22 11:27:15 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 159.603818] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 159.610282] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 worker1 # [ 159.617475] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 159.624057] nix-daemon[847]: reaped child process 2031, status = succeeded worker1 # [ 159.628911] nix-daemon[847]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 160.461405] nix-daemon[847]: reaped child process 2045, status = succeeded worker1 # [ 160.527127] nix-daemon[847]: accepted connection from pid 2061, user nix-grpc-daemon (trusted) worker1 # [ 160.540889] nix-daemon[847]: reaped child process 2064, status = succeeded lb # [ 160.557454] niks3-server[1111]: 2026/09/22 11:27:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.551481] nix-grpc-daemon[1740]: time=2026-09-22T11:27:15.761Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.552907] nix-grpc-daemon[1740]: time=2026-09-22T11:27:15.763Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 160.576409] niks3-server[1111]: 2026/09/22 11:27:16 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 160.580603] niks3-server[1111]: 2026/09/22 11:27:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 160.582834] niks3-server[1111]: 2026/09/22 11:27:16 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 160.584895] niks3-server[1111]: 2026/09/22 11:27:16 INFO Signed narinfos id=73 count=1 worker1 # [ 160.575995] nix-grpc-daemon[1740]: time=2026-09-22T11:27:15.786Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.589273] niks3-server[1111]: 2026/09/22 11:27:16 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 160.594053] niks3-server[1111]: 2026/09/22 11:27:16 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 160.596981] niks3-server[1111]: 2026/09/22 11:27:16 INFO Completed upload id=73 worker1 # [ 160.586772] nix-grpc-daemon[1740]: time=2026-09-22T11:27:15.797Z level=INFO msg="Upload complete. (151ms)" worker1 # [ 160.589182] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42830 duration_s=0 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=1 lb # [ 160.601096] niks3-server[1111]: 2026/09/22 11:27:16 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 160.596130] nix-daemon[847]: reaped child process 2043, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.17 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 160.718911] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: b3d6a5ef21624818b36810d6fd3a439c client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 160.845763] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49020 client # [ 160.858754] nix[1473]: don't know how to build these paths: client # [ 160.859822] nix[1473]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 160.854324] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2 # [ 160.873275] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:17Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 160.884295] nix[1473]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 164.696446] envoy[896]: conn peer=[2001:db8:1::1]:33304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27068 tx=11312 ms=15998 client # [ 190.885515] nix[1473]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 190.893499] nix[1473]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 190.924233] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 190.927822] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 190.931974] systemd[1]: gpu.service: Consumed 128ms CPU time over 30.209s wall clock time, 35.6M memory peak, 5.1K incoming IP traffic, 5.1K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.35 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 46.98 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1 # [ 192.298115] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:47Z level=info event=unhealthy reason=min_free worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 worker1 # [ 192.613304] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42830 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 192.624945] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 192.644516] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:48Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 192.650349] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:48Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 192.655283] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 192.665967] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 192.677789] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 192.689579] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 192.795477] nix-daemon[868]: accepted connection from pid 1955, user nix-grpc-daemon (trusted) worker2 # [ 192.812947] nix-daemon[868]: reaped child process 1958, status = succeeded worker2 # [ 192.905679] nix-daemon[868]: accepted connection from pid 1960, user nix-grpc-daemon (trusted) worker2 # [ 192.922169] nix-daemon[868]: reaped child process 1963, status = succeeded lb # [ 192.941405] niks3-server[1111]: 2026/09/22 11:27:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 192.937319] nix-grpc-daemon[1743]: time=2026-09-22T11:27:49.114Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 192.939163] nix-grpc-daemon[1743]: time=2026-09-22T11:27:49.115Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 192.973871] niks3-server[1111]: 2026/09/22 11:27:48 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 192.984644] niks3-server[1111]: 2026/09/22 11:27:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker2 # [ 192.980938] nix-grpc-daemon[1743]: time=2026-09-22T11:27:49.157Z level=INFO msg="Uploading 1 narinfos" lb # [ 192.993060] niks3-server[1111]: 2026/09/22 11:27:48 INFO Signed narinfos id=74 count=1 lb # [ 193.003871] niks3-server[1111]: 2026/09/22 11:27:48 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 193.015441] niks3-server[1111]: 2026/09/22 11:27:48 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 193.018467] niks3-server[1111]: 2026/09/22 11:27:48 INFO Completed upload id=74 worker2 # [ 193.007411] nix-grpc-daemon[1743]: time=2026-09-22T11:27:49.184Z level=INFO msg="Upload complete. (306ms)" lb # [ 193.020058] niks3-server[1111]: 2026/09/22 11:27:48 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 193.009816] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 193.012632] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 193.020061] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 193.025624] nix-daemon[868]: reaped child process 1953, status = succeeded worker2 # [ 193.029967] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 194.076513] nix-daemon[868]: reaped child process 1967, status = succeeded worker2 # [ 194.152990] nix-daemon[868]: accepted connection from pid 1983, user nix-grpc-daemon (trusted) worker2 # [ 194.168248] nix-daemon[868]: reaped child process 1986, status = succeeded lb # [ 194.186455] niks3-server[1111]: 2026/09/22 11:27:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 194.182525] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.359Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 194.184034] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.361Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 194.227698] niks3-server[1111]: 2026/09/22 11:27:49 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 194.237045] niks3-server[1111]: 2026/09/22 11:27:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 194.242663] niks3-server[1111]: 2026/09/22 11:27:49 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 194.247628] niks3-server[1111]: 2026/09/22 11:27:49 INFO Signed narinfos id=75 count=1 worker2 # [ 194.238885] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.415Z level=INFO msg="Uploading 1 narinfos" lb # [ 194.254451] niks3-server[1111]: 2026/09/22 11:27:49 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 194.259069] niks3-server[1111]: 2026/09/22 11:27:49 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 194.264592] niks3-server[1111]: 2026/09/22 11:27:49 INFO Completed upload id=75 lb # [ 194.265848] niks3-server[1111]: 2026/09/22 11:27:49 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 194.252393] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.429Z level=INFO msg="Upload complete. (213ms)" worker2 # [ 194.258631] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=1 worker2 # [ 194.272697] nix-daemon[868]: reaped child process 1965, status = succeeded worker2 # [ 194.305928] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 194.310927] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 194.351293] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 194.364683] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 194.378255] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.555Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 194.386394] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 194.397127] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 194.500180] nix-daemon[868]: accepted connection from pid 1992, user nix-grpc-daemon (trusted) worker2 # [ 194.516673] nix-daemon[868]: reaped child process 1995, status = succeeded worker2 # [ 194.599459] nix-daemon[868]: accepted connection from pid 1997, user nix-grpc-daemon (trusted) worker2 # [ 194.613666] nix-daemon[868]: reaped child process 2000, status = succeeded lb # [ 194.632904] niks3-server[1111]: 2026/09/22 11:27:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 194.630036] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.807Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 194.632060] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.808Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 194.662775] niks3-server[1111]: 2026/09/22 11:27:50 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 194.666438] niks3-server[1111]: 2026/09/22 11:27:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign lb # [ 194.669508] niks3-server[1111]: 2026/09/22 11:27:50 INFO Signed narinfos id=76 count=1 worker2 # [ 194.657575] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.834Z level=INFO msg="Uploading 1 narinfos" lb # [ 194.672400] niks3-server[1111]: 2026/09/22 11:27:50 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 194.678814] niks3-server[1111]: 2026/09/22 11:27:50 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 194.681718] niks3-server[1111]: 2026/09/22 11:27:50 INFO Completed upload id=76 worker2 # [ 194.670739] nix-grpc-daemon[1743]: time=2026-09-22T11:27:50.847Z level=INFO msg="Upload complete. (260ms)" lb # [ 194.683755] niks3-server[1111]: 2026/09/22 11:27:50 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 194.672946] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 194.676189] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 194.683830] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) lb # [ 194.697858] envoy[896]: conn peer=[2001:db8:1::1]:43006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=30054 worker2 # [ 194.687595] nix-daemon[868]: reaped child process 1990, status = succeeded worker2 # [ 194.692924] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 195.732532] nix-daemon[868]: reaped child process 2004, status = succeeded worker2 # [ 195.819101] nix-daemon[868]: accepted connection from pid 2020, user nix-grpc-daemon (trusted) worker2 # [ 195.832871] nix-daemon[868]: reaped child process 2023, status = succeeded lb # [ 195.851734] niks3-server[1111]: 2026/09/22 11:27:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 195.848610] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.025Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 195.850247] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.027Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 195.897462] niks3-server[1111]: 2026/09/22 11:27:51 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 195.906405] niks3-server[1111]: 2026/09/22 11:27:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 195.912635] niks3-server[1111]: 2026/09/22 11:27:51 INFO Signed narinfos id=77 count=1 worker2 # [ 195.903862] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.080Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.918763] niks3-server[1111]: 2026/09/22 11:27:51 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 195.928334] niks3-server[1111]: 2026/09/22 11:27:51 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 195.937238] niks3-server[1111]: 2026/09/22 11:27:51 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 195.942183] niks3-server[1111]: 2026/09/22 11:27:51 INFO Completed upload id=77 lb # [ 195.944224] niks3-server[1111]: 2026/09/22 11:27:51 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 195.931492] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.108Z level=INFO msg="Upload complete. (229ms)" worker2 # [ 195.939900] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=1 worker2 # [ 195.950079] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 195.954405] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 195.964986] nix-daemon[868]: reaped child process 2002, status = succeeded worker2 # [ 195.994893] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 196.008256] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 196.021351] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.198Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 196.029813] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 196.039924] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 196.144136] nix-daemon[868]: accepted connection from pid 2029, user nix-grpc-daemon (trusted) worker2 # [ 196.160202] nix-daemon[868]: reaped child process 2032, status = succeeded worker2 # [ 196.245620] nix-daemon[868]: accepted connection from pid 2034, user nix-grpc-daemon (trusted) worker2 # [ 196.261187] nix-daemon[868]: reaped child process 2037, status = succeeded lb # [ 196.278229] niks3-server[1111]: 2026/09/22 11:27:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 196.273722] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.450Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 196.275291] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.450Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 196.303321] niks3-server[1111]: 2026/09/22 11:27:51 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 196.316440] niks3-server[1111]: 2026/09/22 11:27:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 196.322438] niks3-server[1111]: 2026/09/22 11:27:51 INFO Signed narinfos id=78 count=1 worker2 # [ 196.313777] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.490Z level=INFO msg="Uploading 1 narinfos" lb # [ 196.329310] niks3-server[1111]: 2026/09/22 11:27:51 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 196.342613] niks3-server[1111]: 2026/09/22 11:27:51 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete worker2 # [ 196.335757] nix-grpc-daemon[1743]: time=2026-09-22T11:27:52.512Z level=INFO msg="Upload complete. (282ms)" lb # [ 196.347706] niks3-server[1111]: 2026/09/22 11:27:51 INFO Completed upload id=78 worker2 # [ 196.338293] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 196.352559] niks3-server[1111]: 2026/09/22 11:27:51 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 196.344630] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 worker2 # [ 196.356525] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 196.359659] nix-daemon[868]: reaped child process 2027, status = succeeded worker2 # [ 196.363379] nix-daemon[868]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 197.579830] nix-daemon[868]: reaped child process 2041, status = succeeded worker2 # [ 197.659713] nix-daemon[868]: accepted connection from pid 2057, user nix-grpc-daemon (trusted) worker2 # [ 197.675426] nix-daemon[868]: reaped child process 2060, status = succeeded lb # [ 197.691967] niks3-server[1111]: 2026/09/22 11:27:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 197.688620] nix-grpc-daemon[1743]: time=2026-09-22T11:27:53.865Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 197.691158] nix-grpc-daemon[1743]: time=2026-09-22T11:27:53.867Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 197.724097] niks3-server[1111]: 2026/09/22 11:27:53 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 197.739642] niks3-server[1111]: 2026/09/22 11:27:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 197.746061] niks3-server[1111]: 2026/09/22 11:27:53 INFO Signed narinfos id=79 count=1 worker2 # [ 197.736907] nix-grpc-daemon[1743]: time=2026-09-22T11:27:53.913Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.757794] niks3-server[1111]: 2026/09/22 11:27:53 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 197.763101] niks3-server[1111]: 2026/09/22 11:27:53 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 197.769775] niks3-server[1111]: 2026/09/22 11:27:53 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 197.773560] niks3-server[1111]: 2026/09/22 11:27:53 INFO Completed upload id=79 worker2 # [ 197.761522] nix-grpc-daemon[1743]: time=2026-09-22T11:27:53.938Z level=INFO msg="Upload complete. (191ms)" lb # [ 197.775608] niks3-server[1111]: 2026/09/22 11:27:53 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 197.770547] nix-grpc-daemon[1666]: ts=2026-09-22T11:27:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49020 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=1 worker2 # [ 197.784653] nix-daemon[868]: reaped child process 2039, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.33 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 198.300277] nix-grpc-daemon[1680]: ts=2026-09-22T11:27:53Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.06 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 7.70 seconds) (finished: run the VM test script, in 200.03 seconds) test script finished in 200.20s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T11:27:55Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T11:27:55Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T11:27:55Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T11:27:56Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.26 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh