tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 50) worker1 # Formatting '/build/vm-state-worker1/tmp.XYgQzG8yZY', fmt=raw size=1073741824 lb: QEMU running (pid 51) worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) worker2: QEMU running (pid 52) lb # Disk image does not exist, creating the virtualisation disk image... worker1 # Discarding device blocks: 0/262144 done client # Formatting '/build/vm-state-client/tmp.mgVH6d2ey5', fmt=raw size=1073741824 worker2 # Formatting '/build/vm-state-worker2/tmp.89i8RE13U4', fmt=raw size=1073741824 worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes client # mke2fs 1.47.4 (6-Mar-2025) worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Filesystem UUID: 688df2ac-7044-48b9-9783-5d722ba44790 lb # Formatting '/build/vm-state-lb/tmp.jJh7ISGLai', fmt=raw size=1073741824 (finished: start all VMs, in 0.24 seconds) worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # client: waiting for unit network-addresses-eth1.service worker2 # Discarding device blocks: 0/262144 done client # Discarding device blocks: 0/262144 done worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for the VM to finish booting lb # Discarding device blocks: 0/262144 done worker2 # Filesystem UUID: 82997474-45fa-4f34-9f32-e5a34a68465a client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Creating journal (8192 blocks): done lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Superblock backups stored on blocks: client # Filesystem UUID: accde53a-de24-4fec-b7f0-5a65914d7031 worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Filesystem UUID: 68373e2e-e441-4427-b5a7-8bf2eee61f33 worker2 # 32768, 98304, 163840, 229376 client # Superblock backups stored on blocks: worker1 # lb # Superblock backups stored on blocks: worker2 # client # 32768, 98304, 163840, 229376 worker1 # Virtualisation disk image created. lb # 32768, 98304, 163840, 229376 worker2 # Allocating group tables: 0/8 done client # worker1 # Starting virtiofs daemons... lb # worker2 # Writing inode tables: 0/8 done client # Allocating group tables: 0/8 done worker1 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # Allocating group tables: 0/8 done worker2 # Creating journal (8192 blocks): done client # Writing inode tables: 0/8 done worker1 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # Writing inode tables: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Creating journal (8192 blocks): done worker1 # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # Creating journal (8192 blocks): done worker2 # client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Virtualisation disk image created. client # worker1 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # worker2 # Starting virtiofs daemons... client # Virtualisation disk image created. worker1 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # Virtualisation disk image created. worker2 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Starting virtiofs daemons... worker1 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # Starting virtiofs daemons... worker2 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-21T14:43:11Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-21T14:43:11Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-21T14:43:11Z INFO virtiofsd] Client connected, servicing requests lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # worker2 # worker1 # worker2 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # lb # lb # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker2 # worker2 # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # lb # Booting from ROM... worker2 # Booting from ROM... worker1 # Booting from ROM... client # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ywx2cfw2bd45f1sp7w8ib468r0dscq27-nixos-system-lb-test/init regInfo=/nix/store/lhzhb7lk7gq3c4r6bxsdb6n35xs7cgxx-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/34sn5q3k4s5dxk2cjrq9ddxmzik393xp-nixos-system-worker2-test/init regInfo=/nix/store/h9n6cylsxy742q82s34bdn6a6b8y5qpj-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/31zfsnqjsdrlaxry041lgw659q8r9wr8-nixos-system-worker1-test/init regInfo=/nix/store/521hynx6hwn1lbh7ayndc850rf0kyhm0-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test/init regInfo=/nix/store/1aad4czwnalfgj7xv63axcwczg4d46d5-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000001] kvm-clock: using sched offset of 489856842 cycles worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] kvm-clock: using sched offset of 470196928 cycles lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000001] kvm-clock: using sched offset of 476851846 cycles lb # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.002749] Using GB pages for direct mapping worker2 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.002838] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker2 # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.002846] ACPI: Early table checksum verification disabled worker2 # [ 0.002745] Using GB pages for direct mapping worker1 # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.002844] RAMDISK: [mem 0x5e36f000-0x5ffcffff] lb # [ 0.002850] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002743] Using GB pages for direct mapping client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.002877] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.002853] ACPI: Early table checksum verification disabled lb # [ 0.002854] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.002856] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002886] ACPI: Early table checksum verification disabled client # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.002889] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.002858] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002860] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.002893] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002866] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.002864] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002868] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.002898] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002871] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002869] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002873] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.002905] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002907] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.002871] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] kvm-clock: using sched offset of 482200680 cycles worker2 # [ 0.002874] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002873] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002909] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002876] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.002910] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002874] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002877] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002875] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.002912] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002879] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000833] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.002877] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.002913] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002880] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.002877] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002915] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002881] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.002724] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002878] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002735] Using GB pages for direct mapping worker1 # [ 0.002916] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002882] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.002878] RAMDISK: [mem 0x5e370000-0x5ffcffff] lb # [ 0.002878] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.002916] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.002882] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002888] ACPI: Early table checksum verification disabled lb # [ 0.002878] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.002917] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.002883] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.002891] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.002879] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.002917] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002883] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.003114] No NUMA configuration found client # [ 0.002895] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002917] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.003115] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.002884] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.003111] No NUMA configuration found client # [ 0.002899] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003117] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.002918] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.005537] Zone ranges: worker1 # [ 0.003156] No NUMA configuration found worker2 # [ 0.003112] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002907] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.005538] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.003115] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.003156] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002909] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.005485] Zone ranges: lb # [ 0.005540] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.003159] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005541] Normal empty client # [ 0.002910] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005970] Zone ranges: worker2 # [ 0.005486] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.005542] Device empty worker2 # [ 0.005487] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.005542] Movable zone start for each node worker1 # [ 0.005971] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.005489] Normal empty lb # [ 0.005543] Early memory node ranges client # [ 0.002912] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005490] Device empty worker1 # [ 0.005973] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.005974] Normal empty lb # [ 0.005544] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.005490] Movable zone start for each node client # [ 0.002914] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005975] Device empty worker2 # [ 0.005491] Early memory node ranges lb # [ 0.005545] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.005976] Movable zone start for each node worker2 # [ 0.005491] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.002915] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005976] Early memory node ranges lb # [ 0.005546] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.005492] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.005977] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.002916] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.005570] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.005493] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.005978] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.002918] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.005852] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.005519] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.005979] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.002918] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.034002] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.034465] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.005797] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.005999] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.002919] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.033069] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.034477] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.006294] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.002919] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.033539] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.033433] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.034507] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.033551] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.002920] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.033888] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.034510] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.033582] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.033900] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.002920] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.034511] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.003161] No NUMA configuration found worker2 # [ 0.033585] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.033930] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.034512] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.033586] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.033933] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.003163] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.034514] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.003165] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.033587] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.033934] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.005591] Zone ranges: lb # [ 0.034514] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.033588] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.033935] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.005593] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.034517] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.033937] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.005594] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.033589] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.005595] Normal empty lb # [ 0.034518] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.033591] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.034521] TSC deadline timer available worker1 # [ 0.033937] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.005596] Device empty client # [ 0.005597] Movable zone start for each node lb # [ 0.034525] CPU topo: Max. logical packages: 1 worker2 # [ 0.033593] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.033940] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.005598] Early memory node ranges worker2 # [ 0.033596] TSC deadline timer available lb # [ 0.034526] CPU topo: Max. logical dies: 1 worker1 # [ 0.033941] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.005598] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.034526] CPU topo: Max. dies per package: 1 worker2 # [ 0.033600] CPU topo: Max. logical packages: 1 worker1 # [ 0.033944] TSC deadline timer available worker2 # [ 0.033601] CPU topo: Max. logical dies: 1 lb # [ 0.034529] CPU topo: Max. threads per core: 1 worker1 # [ 0.033949] CPU topo: Max. logical packages: 1 client # [ 0.005599] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.033601] CPU topo: Max. dies per package: 1 lb # [ 0.034530] CPU topo: Num. cores per package: 1 worker1 # [ 0.033949] CPU topo: Max. logical dies: 1 client # [ 0.005600] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.033604] CPU topo: Max. threads per core: 1 lb # [ 0.034530] CPU topo: Num. threads per package: 1 worker1 # [ 0.033950] CPU topo: Max. dies per package: 1 worker2 # [ 0.033605] CPU topo: Num. cores per package: 1 client # [ 0.005621] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.034531] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.033953] CPU topo: Max. threads per core: 1 worker2 # [ 0.033605] CPU topo: Num. threads per package: 1 client # [ 0.005894] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.033954] CPU topo: Num. cores per package: 1 lb # [ 0.034550] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.033605] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.033954] CPU topo: Num. threads per package: 1 client # [ 0.032414] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.032884] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.034580] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.033623] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.033954] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.032896] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.034581] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.033974] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.033656] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.032926] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.034583] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.034006] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.033657] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.034584] Booting paravirtualized kernel on KVM client # [ 0.032929] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.033659] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.034007] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.032931] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.033660] Booting paravirtualized kernel on KVM lb # [ 0.034587] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.034009] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.032932] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.034010] Booting paravirtualized kernel on KVM lb # [ 0.039094] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.033663] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.032933] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.041757] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.038159] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.034013] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.032934] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.041804] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.040321] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.038514] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.032936] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.040369] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.032938] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.040669] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.032942] TSC deadline timer available worker1 # [ 0.040716] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.032946] CPU topo: Max. logical packages: 1 client # [ 0.032947] CPU topo: Max. logical dies: 1 client # [ 0.032947] CPU topo: Max. dies per package: 1 lb # [ 0.041805] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ywx2cfw2bd45f1sp7w8ib468r0dscq27-nixos-system-lb-test/init regInfo=/nix/store/lhzhb7lk7gq3c4r6bxsdb6n35xs7cgxx-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.032951] CPU topo: Max. threads per core: 1 client # [ 0.032951] CPU topo: Num. cores per package: 1 worker2 # [ 0.040370] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/34sn5q3k4s5dxk2cjrq9ddxmzik393xp-nixos-system-worker2-test/init regInfo=/nix/store/h9n6cylsxy742q82s34bdn6a6b8y5qpj-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.032952] CPU topo: Num. threads per package: 1 lb # [ 0.041902] Unknown kernel command line parameters "regInfo=/nix/store/lhzhb7lk7gq3c4r6bxsdb6n35xs7cgxx-closure-info/registration", will be passed to user space. worker1 # [ 0.040718] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/31zfsnqjsdrlaxry041lgw659q8r9wr8-nixos-system-worker1-test/init regInfo=/nix/store/521hynx6hwn1lbh7ayndc850rf0kyhm0-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.032952] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.041915] random: crng init done worker2 # [ 0.040466] Unknown kernel command line parameters "regInfo=/nix/store/h9n6cylsxy742q82s34bdn6a6b8y5qpj-closure-info/registration", will be passed to user space. client # [ 0.032977] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.041915] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.040478] random: crng init done worker1 # [ 0.040814] Unknown kernel command line parameters "regInfo=/nix/store/521hynx6hwn1lbh7ayndc850rf0kyhm0-closure-info/registration", will be passed to user space. client # [ 0.033008] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.044154] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.040479] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.040826] random: crng init done client # [ 0.033009] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.045274] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.040827] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.042598] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.045304] Fallback order for Node 0: 0 client # [ 0.033011] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.042950] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.043850] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.033012] Booting paravirtualized kernel on KVM lb # [ 0.045308] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.043882] Fallback order for Node 0: 0 lb # [ 0.045309] Policy zone: DMA32 worker1 # [ 0.044022] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.043885] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.044052] Fallback order for Node 0: 0 lb # [ 0.047891] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.033015] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.043886] Policy zone: DMA32 worker1 # [ 0.044055] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.051199] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.037499] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.046368] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.044056] Policy zone: DMA32 lb # [ 0.054698] allocated 3145728 bytes of page_ext client # [ 0.039833] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.049626] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.046741] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.065050] ftrace: allocating 48787 entries in 192 pages client # [ 0.039880] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.052955] allocated 3145728 bytes of page_ext lb # [ 0.065052] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.049898] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.063230] ftrace: allocating 48787 entries in 192 pages lb # [ 0.065893] Dynamic Preempt: lazy worker1 # [ 0.053224] allocated 3145728 bytes of page_ext worker2 # [ 0.063232] ftrace: allocated 192 pages with 2 groups lb # [ 0.066015] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.063567] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.064067] Dynamic Preempt: lazy lb # [ 0.066015] rcu: RCU event tracing is enabled. worker1 # [ 0.063569] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.064230] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.064423] Dynamic Preempt: lazy lb # [ 0.066016] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.064231] rcu: RCU event tracing is enabled. worker1 # [ 0.064579] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.066017] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.064232] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.039881] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test/init regInfo=/nix/store/1aad4czwnalfgj7xv63axcwczg4d46d5-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.064579] rcu: RCU event tracing is enabled. lb # [ 0.066018] Rude variant of Tasks RCU enabled. worker2 # [ 0.064233] Trampoline variant of Tasks RCU enabled. lb # [ 0.066018] Tracing variant of Tasks RCU enabled. worker1 # [ 0.064580] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.064234] Rude variant of Tasks RCU enabled. worker1 # [ 0.064582] Trampoline variant of Tasks RCU enabled. lb # [ 0.066019] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.039985] Unknown kernel command line parameters "regInfo=/nix/store/1aad4czwnalfgj7xv63axcwczg4d46d5-closure-info/registration", will be passed to user space. worker2 # [ 0.064234] Tracing variant of Tasks RCU enabled. worker1 # [ 0.064582] Rude variant of Tasks RCU enabled. client # [ 0.039997] random: crng init done lb # [ 0.066019] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.064583] Tracing variant of Tasks RCU enabled. worker2 # [ 0.064234] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.039998] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.064235] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.066036] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.064583] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.042092] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.064584] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.064256] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.066038] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.043131] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.043161] Fallback order for Node 0: 0 worker1 # [ 0.064606] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.064258] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.066038] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.043164] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.070451] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.043165] Policy zone: DMA32 worker1 # [ 0.064607] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.064259] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.070728] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.068878] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.045601] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.064608] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.048702] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.069144] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.069062] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.070734] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.052173] allocated 3145728 bytes of page_ext worker1 # [ 0.069354] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.069150] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.062347] ftrace: allocating 48787 entries in 192 pages lb # [ 0.070839] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.062349] ftrace: allocated 192 pages with 2 groups lb # [ 0.074383] Console: colour VGA+ 80x25 worker1 # [ 0.069361] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.063194] Dynamic Preempt: lazy worker2 # [ 0.069250] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.074386] printk: legacy console [tty0] enabled worker2 # [ 0.072818] Console: colour VGA+ 80x25 client # [ 0.063327] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.104018] printk: legacy console [ttyS0] enabled worker1 # [ 0.069466] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.072820] printk: legacy console [tty0] enabled client # [ 0.063328] rcu: RCU event tracing is enabled. worker1 # [ 0.073001] Console: colour VGA+ 80x25 lb # [ 0.199910] ACPI: Core revision 20250807 worker2 # [ 0.102231] printk: legacy console [ttyS0] enabled client # [ 0.063329] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.073004] printk: legacy console [tty0] enabled worker2 # [ 0.197670] ACPI: Core revision 20250807 client # [ 0.063330] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.102473] printk: legacy console [ttyS0] enabled client # [ 0.063331] Rude variant of Tasks RCU enabled. lb # [ 0.200760] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.198291] ACPI: Core revision 20250807 client # [ 0.063331] Tracing variant of Tasks RCU enabled. worker2 # [ 0.198549] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.202250] APIC: Switch to symmetric I/O mode setup client # [ 0.063332] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.203208] x2apic enabled worker2 # [ 0.200051] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.199159] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.063332] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.201017] x2apic enabled lb # [ 0.203947] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.200646] APIC: Switch to symmetric I/O mode setup client # [ 0.063347] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.201581] x2apic enabled worker2 # [ 0.201794] APIC: Switched APIC routing to: physical x2apic client # [ 0.063348] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.202324] APIC: Switched APIC routing to: physical x2apic lb # [ 0.205785] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.063349] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.203625] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.067760] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.206773] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.204105] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.068031] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.204620] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.208454] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.205057] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.068037] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.206266] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.209541] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.068145] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.206669] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.207352] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.071637] Console: colour VGA+ 80x25 lb # [ 0.210583] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.071639] printk: legacy console [tty0] enabled worker1 # [ 0.207755] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.208376] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.101112] printk: legacy console [ttyS0] enabled lb # [ 0.212134] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.208843] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.197437] ACPI: Core revision 20250807 worker2 # [ 0.209979] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.209666] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.212455] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.198318] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.210266] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.214451] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.210670] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.199867] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.212262] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.200857] x2apic enabled lb # [ 0.215452] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.211666] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.213263] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.217164] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.201643] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.212666] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.214980] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.217451] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.213666] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.215262] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.203716] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.214666] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.204692] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.218451] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.206416] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.220458] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.216262] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.215665] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.207501] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.218270] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.217673] Spectre V2 : Enabling IBPB for BPF lb # [ 0.221452] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.209566] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.219263] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.222451] active return thunk: srso_alias_return_thunk worker1 # [ 0.218401] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.210413] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.220263] active return thunk: srso_alias_return_thunk worker1 # [ 0.219666] active return thunk: srso_alias_return_thunk lb # [ 0.224093] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.221283] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.225328] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.211403] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.220686] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.222262] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.226179] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.221666] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.212412] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.223982] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.227180] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.222665] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.214412] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.224977] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.228182] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.223665] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.215412] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.225262] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.229175] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.224666] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.216412] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.226262] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.230216] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.225666] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.227262] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.231451] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.226666] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.229262] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.232451] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.227666] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.230192] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.233451] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.228666] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.217412] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.230991] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.234385] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.219426] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.229666] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.231971] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.235159] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.230665] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.220132] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.232989] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.231666] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.221412] active return thunk: srso_alias_return_thunk lb # [ 0.236163] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.233970] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.222427] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.232666] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.223412] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.224412] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.225411] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.226412] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.227412] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.228412] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.229412] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.231160] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.232158] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.233155] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.234154] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.235157] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.271286] Freeing SMP alternatives memory: 44K worker2 # [ 0.268339] Freeing SMP alternatives memory: 44K lb # [ 0.272042] pid_max: default: 32768 minimum: 301 worker2 # [ 0.269137] pid_max: default: 32768 minimum: 301 worker1 # [ 0.267944] Freeing SMP alternatives memory: 44K lb # [ 0.272569] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.269962] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.268669] pid_max: default: 32768 minimum: 301 lb # [ 0.273560] landlock: Up and running. worker2 # [ 0.271085] landlock: Up and running. worker1 # [ 0.269508] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.274451] Yama: becoming mindful. worker2 # [ 0.271703] Yama: becoming mindful. worker1 # [ 0.270467] landlock: Up and running. lb # [ 0.275595] LSM support for eBPF active worker2 # [ 0.272474] LSM support for eBPF active worker1 # [ 0.271124] Yama: becoming mindful. worker1 # [ 0.271880] LSM support for eBPF active lb # [ 0.276357] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.273349] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.272796] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.277493] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.274300] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.273714] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.276938] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.280036] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.276517] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.277772] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.281024] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.278267] ... version: 2 lb # [ 0.281455] ... version: 2 worker1 # [ 0.277244] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.278995] ... bit width: 48 lb # [ 0.282146] ... bit width: 48 worker1 # [ 0.277670] ... version: 2 worker2 # [ 0.279264] ... generic counters: 6 lb # [ 0.282453] ... generic counters: 6 worker1 # [ 0.278376] ... bit width: 48 worker2 # [ 0.280003] ... generic bitmap: 000000000000003f client # [ 0.270253] Freeing SMP alternatives memory: 44K lb # [ 0.283176] ... generic bitmap: 000000000000003f worker1 # [ 0.278669] ... generic counters: 6 worker2 # [ 0.280313] ... fixed-purpose counters: 0 lb # [ 0.283459] ... fixed-purpose counters: 0 client # [ 0.270980] pid_max: default: 32768 minimum: 301 worker1 # [ 0.279353] ... generic bitmap: 000000000000003f worker2 # [ 0.281033] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.279678] ... fixed-purpose counters: 0 lb # [ 0.284123] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.271522] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.280356] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.281265] ... value mask: 0000ffffffffffff lb # [ 0.284454] ... value mask: 0000ffffffffffff client # [ 0.272526] landlock: Up and running. client # [ 0.273413] Yama: becoming mindful. worker1 # [ 0.280668] ... value mask: 0000ffffffffffff worker2 # [ 0.282130] ... max period: 00007fffffffffff lb # [ 0.285321] ... max period: 00007fffffffffff client # [ 0.274480] LSM support for eBPF active worker2 # [ 0.282928] ... global_ctrl mask: 000000000000003f worker1 # [ 0.281528] ... max period: 00007fffffffffff lb # [ 0.286134] ... global_ctrl mask: 000000000000003f worker1 # [ 0.282322] ... global_ctrl mask: 000000000000003f lb # [ 0.286568] signal: max sigframe size: 3376 worker2 # [ 0.283388] signal: max sigframe size: 3376 client # [ 0.275223] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.282782] signal: max sigframe size: 3376 lb # [ 0.287324] rcu: Hierarchical SRCU implementation. worker2 # [ 0.284170] rcu: Hierarchical SRCU implementation. worker2 # [ 0.284827] rcu: Max phase no-delay instances is 400. client # [ 0.276435] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.288012] rcu: Max phase no-delay instances is 400. worker1 # [ 0.283545] rcu: Hierarchical SRCU implementation. worker1 # [ 0.284219] rcu: Max phase no-delay instances is 400. client # [ 0.278765] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.279995] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.280421] ... version: 2 worker2 # [ 0.289810] smp: Bringing up secondary CPUs ... lb # [ 0.293219] smp: Bringing up secondary CPUs ... client # [ 0.281160] ... bit width: 48 worker2 # [ 0.290277] smp: Brought up 1 node, 1 CPU worker1 # [ 0.289294] smp: Bringing up secondary CPUs ... client # [ 0.281415] ... generic counters: 6 lb # [ 0.293468] smp: Brought up 1 node, 1 CPU worker1 # [ 0.289682] smp: Brought up 1 node, 1 CPU worker2 # [ 0.290936] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.282094] ... generic bitmap: 000000000000003f lb # [ 0.294124] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.290333] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.282415] ... fixed-purpose counters: 0 client # [ 0.283166] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.291453] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) lb # [ 0.294611] Memory: 1454624K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) client # [ 0.283415] ... value mask: 0000ffffffffffff worker2 # [ 0.292525] devtmpfs: initialized lb # [ 0.295731] devtmpfs: initialized worker1 # [ 0.291132] Memory: 1454600K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) client # [ 0.284302] ... max period: 00007fffffffffff worker2 # [ 0.293384] x86/mm: Memory block size: 128MB lb # [ 0.296486] x86/mm: Memory block size: 128MB worker1 # [ 0.291934] devtmpfs: initialized client # [ 0.285048] ... global_ctrl mask: 000000000000003f worker1 # [ 0.292799] x86/mm: Memory block size: 128MB client # [ 0.285537] signal: max sigframe size: 3376 client # [ 0.286332] rcu: Hierarchical SRCU implementation. worker2 # [ 0.295169] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.298299] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.287015] rcu: Max phase no-delay instances is 400. worker1 # [ 0.294672] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.296197] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.299358] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.297341] pinctrl core: initialized pinctrl subsystem lb # [ 0.300543] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.295696] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.298439] PM: RTC time: 14:43:11, date: 2026-09-21 worker1 # [ 0.296750] pinctrl core: initialized pinctrl subsystem lb # [ 0.301645] PM: RTC time: 14:43:11, date: 2026-09-21 worker1 # [ 0.297843] PM: RTC time: 14:43:11, date: 2026-09-21 client # [ 0.292157] smp: Bringing up secondary CPUs ... client # [ 0.292429] smp: Brought up 1 node, 1 CPU worker2 # [ 0.302005] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.305354] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.293119] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.301586] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.302792] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.306699] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.303291] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.302879] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.293591] Memory: 1454632K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) lb # [ 0.307478] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.294684] devtmpfs: initialized worker1 # [ 0.303692] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.304536] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.308722] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.295508] x86/mm: Memory block size: 128MB worker2 # [ 0.305274] audit: initializing netlink subsys (disabled) lb # [ 0.309463] audit: initializing netlink subsys (disabled) worker1 # [ 0.304939] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.305679] audit: initializing netlink subsys (disabled) worker2 # [ 0.306267] audit: type=2000 audit(1790001792.062:1): state=initialized audit_enabled=0 res=1 lb # [ 0.310673] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.297201] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.306763] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.307401] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.310675] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.298270] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.306765] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.307403] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.311455] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.299495] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.307670] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.312374] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.308266] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.300632] PM: RTC time: 14:43:11, date: 2026-09-21 worker1 # [ 0.308582] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.309196] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.313150] audit: type=2000 audit(1790001792.063:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.309998] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.309358] audit: type=2000 audit(1790001792.062:1): state=initialized audit_enabled=0 res=1 lb # [ 0.314456] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.310286] cpuidle: using governor menu lb # [ 0.314469] cpuidle: using governor menu worker1 # [ 0.310671] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.310686] cpuidle: using governor menu worker2 # [ 0.312501] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.304195] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.316712] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.312900] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.313547] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.305652] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.317721] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.313891] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.314268] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.306444] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.318456] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.315276] PCI: Using configuration type 1 for base access worker1 # [ 0.314672] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.319465] PCI: Using configuration type 1 for base access client # [ 0.307689] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.315680] PCI: Using configuration type 1 for base access worker2 # [ 0.316352] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.308426] audit: initializing netlink subsys (disabled) lb # [ 0.320593] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.316775] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.309524] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.309526] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.310416] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.311419] audit: type=2000 audit(1790001792.077:1): state=initialized audit_enabled=0 res=1 lb # [ 0.325694] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.313418] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.326454] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.313420] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.323279] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.314418] cpuidle: using governor menu worker2 # [ 0.324265] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.323926] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.316642] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.324669] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.317655] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.331454] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.318418] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.332454] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.319427] PCI: Using configuration type 1 for base access worker2 # [ 0.329266] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.330265] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.320541] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.329669] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.330669] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.325687] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.326416] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.342826] ACPI: Added _OSI(Module Device) lb # [ 0.343455] ACPI: Added _OSI(Processor Device) worker1 # [ 0.339279] ACPI: Added _OSI(Module Device) worker1 # [ 0.339670] ACPI: Added _OSI(Processor Device) lb # [ 0.344244] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.341505] ACPI: Added _OSI(Module Device) worker1 # [ 0.340415] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.342202] ACPI: Added _OSI(Processor Device) client # [ 0.331416] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.342815] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.332415] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.347184] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.348615] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.350446] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.350627] ACPI: Interpreter enabled client # [ 0.342825] ACPI: Added _OSI(Module Device) worker2 # [ 0.352669] ACPI: Interpreter enabled worker1 # [ 0.351169] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.356863] ACPI: Interpreter enabled worker2 # [ 0.353281] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.343417] ACPI: Added _OSI(Processor Device) worker1 # [ 0.351670] ACPI: Using IOAPIC for interrupt routing lb # [ 0.357470] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.353984] ACPI: Using IOAPIC for interrupt routing client # [ 0.344144] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.358186] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.352505] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.356326] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.360507] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.357266] PCI: Using E820 reservations for host bridge windows lb # [ 0.361454] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.357669] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.358803] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.360380] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.364590] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.352974] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.356836] ACPI: Interpreter enabled client # [ 0.357431] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.367804] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.358168] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.367513] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.372121] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.368271] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.358469] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.372459] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.359415] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.368866] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.369343] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.373532] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.369746] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.370394] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.374577] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.370801] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.371661] PCI host bridge to bus 0000:00 client # [ 0.362462] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.375817] PCI host bridge to bus 0000:00 worker1 # [ 0.372030] PCI host bridge to bus 0000:00 worker2 # [ 0.372269] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.376459] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.372673] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.373265] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.377454] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.373669] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.374265] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.378453] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.374668] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.375265] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.375668] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.379454] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.376265] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.376668] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.380453] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.377265] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.378265] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.377674] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.381454] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.382454] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.378668] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.371041] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.379276] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.379670] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.383467] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.371422] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.380728] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.381122] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.372713] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.384904] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.373539] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.374866] PCI host bridge to bus 0000:00 client # [ 0.375420] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.376415] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.377415] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.378415] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.383409] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.379415] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.383737] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.384305] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.387540] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.380415] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.384680] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.388536] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.385215] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.381416] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.385595] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.389477] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.386509] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.382354] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.386966] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.390813] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.383856] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.388178] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.388602] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.392172] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.390302] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.391686] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.391218] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.395488] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.392533] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.392010] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.396361] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.393416] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.397205] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.392271] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.393675] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.397460] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.393865] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.386579] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.395219] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.399037] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.387428] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.388414] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.395273] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.396686] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.396228] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.401313] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.389745] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.397576] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.397024] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.402066] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.398390] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.402476] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.391158] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.397802] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.399234] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.404038] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.393454] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.394344] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.400304] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.401688] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.395166] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.401188] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.406486] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.402538] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.407365] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.395421] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.401998] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.403383] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.408189] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.402813] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.396964] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.404258] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.409032] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.398423] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.404302] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.405686] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.399252] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.405194] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.410483] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.406523] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.400155] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.411320] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.406000] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.407370] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.406272] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.401006] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.407676] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.412189] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.412462] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.407841] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.409168] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.413997] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.403456] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.409307] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.410693] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.404317] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.410275] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.411635] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.415497] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.405179] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.416459] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.411822] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.413052] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.405968] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.418025] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.414691] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.413306] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.408212] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.415654] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.414288] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.409099] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.419466] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.421212] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.417093] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.415831] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.409437] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.410422] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.422038] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.418681] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.417307] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.419612] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.418270] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.411966] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.423466] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.421050] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.424459] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.419807] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.413452] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.414437] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.422681] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.426032] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.421310] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.415980] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.423645] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.422287] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.427467] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.425204] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.428476] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.423811] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.417457] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.429991] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.418438] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.426689] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.425945] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.427522] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.426273] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.420174] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.428437] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.431489] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.427257] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.432460] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.430045] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.422427] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.433453] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.423408] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.428717] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.434998] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.424957] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.431688] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.430301] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.433322] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.431142] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.436498] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.427142] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.433690] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.432006] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.437356] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.427437] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.438192] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.435250] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.432854] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.428949] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.436383] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.439025] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.433951] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker1 # [ 0.436896] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.440169] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.434473] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.430433] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.431239] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.438347] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.440649] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.432194] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.436614] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.438875] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.442482] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.437487] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.433885] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.440351] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.443555] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.438962] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.445117] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.435423] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.436279] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.437241] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.438941] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.440244] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.441376] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.443143] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.440883] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.443610] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.439478] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.443290] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.445667] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.445053] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.441912] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.443943] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.448171] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.442534] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.444963] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.448770] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.443705] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.445926] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.449751] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.444515] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.447696] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.448559] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.450709] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.446281] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.447198] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.449729] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.452482] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.453361] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.448358] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.451507] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.454537] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.449879] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.456099] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.445631] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.455495] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.448089] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.456564] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.453662] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.457541] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.448707] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.454385] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.460147] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.458510] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.455377] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.449706] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.460569] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.459488] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.456366] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.460475] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.461555] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.450707] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.457360] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.461481] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.462550] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.458362] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.452408] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.462495] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.463550] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.459363] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.453255] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.463406] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.464549] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.463680] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.460362] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.454441] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.461303] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.464684] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.465555] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.462285] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.465682] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.456055] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.466559] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.463280] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.466647] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.467492] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.467405] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.464279] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.468468] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.467685] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.465253] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.469425] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.468636] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.466020] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.470180] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.460079] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.466277] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.470465] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.460543] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.470550] iommu: Default domain type: Translated worker2 # [ 0.467257] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.471429] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.461519] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.471250] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.472241] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.471942] ACPI: bus type USB registered client # [ 0.462520] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.469304] iommu: Default domain type: Translated lb # [ 0.473232] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.472676] usbcore: registered new interface driver usbfs worker2 # [ 0.470102] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.463515] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.473554] usbcore: registered new interface driver hub worker2 # [ 0.471274] ACPI: bus type USB registered client # [ 0.464513] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.474490] iommu: Default domain type: Translated worker1 # [ 0.474333] usbcore: registered new device driver usb worker2 # [ 0.472032] usbcore: registered new interface driver usbfs lb # [ 0.475285] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.465516] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.472289] usbcore: registered new interface driver hub lb # [ 0.476498] ACPI: bus type USB registered worker1 # [ 0.475523] NetLabel: Initializing client # [ 0.466522] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.473183] usbcore: registered new device driver usb worker1 # [ 0.476085] NetLabel: domain hash size = 128 lb # [ 0.477256] usbcore: registered new interface driver usbfs client # [ 0.467458] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.476668] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.478145] usbcore: registered new interface driver hub worker2 # [ 0.474798] NetLabel: Initializing worker1 # [ 0.477637] NetLabel: unlabeled traffic allowed by default client # [ 0.468431] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.478473] usbcore: registered new device driver usb worker2 # [ 0.475266] NetLabel: domain hash size = 128 worker1 # [ 0.478334] PCI: Using ACPI for IRQ routing client # [ 0.469392] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.476007] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.480244] NetLabel: Initializing client # [ 0.470182] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.476303] NetLabel: unlabeled traffic allowed by default lb # [ 0.480460] NetLabel: domain hash size = 128 worker2 # [ 0.477222] PCI: Using ACPI for IRQ routing client # [ 0.470428] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.481220] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.471427] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.481492] NetLabel: unlabeled traffic allowed by default client # [ 0.472426] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.482466] PCI: Using ACPI for IRQ routing client # [ 0.473433] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.475554] iommu: Default domain type: Translated client # [ 0.476382] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.477510] ACPI: bus type USB registered client # [ 0.478274] usbcore: registered new interface driver usbfs client # [ 0.479133] usbcore: registered new interface driver hub client # [ 0.479425] usbcore: registered new device driver usb client # [ 0.481196] NetLabel: Initializing client # [ 0.481421] NetLabel: domain hash size = 128 client # [ 0.482171] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.482457] NetLabel: unlabeled traffic allowed by default client # [ 0.483383] PCI: Using ACPI for IRQ routing worker1 # [ 0.521638] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.521664] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.521664] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.521104] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.521673] vgaarb: loaded worker2 # [ 0.521261] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.522441] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.521261] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.522669] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.526660] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.521270] vgaarb: loaded lb # [ 0.527450] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.522015] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.522265] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.527450] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.527457] vgaarb: loaded lb # [ 0.528252] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.526757] clocksource: Switched to clocksource kvm-clock lb # [ 0.529116] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.525350] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.530270] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.531018] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.528974] VFS: Disk quotas dquot_6.6.0 lb # [ 0.533553] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.532413] pnp: PnP ACPI init worker2 # [ 0.529667] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.533253] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.531043] pnp: PnP ACPI init worker2 # [ 0.531847] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.534238] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.528484] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.537301] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.535775] pnp: PnP ACPI: found 5 devices worker2 # [ 0.532790] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.529411] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.537982] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.534281] pnp: PnP ACPI: found 5 devices client # [ 0.529411] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.539294] pnp: PnP ACPI init client # [ 0.529419] vgaarb: loaded lb # [ 0.540085] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.530209] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.541091] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.531066] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.542661] pnp: PnP ACPI: found 5 devices worker1 # [ 0.543346] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.534503] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.544811] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.541855] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.536206] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.545792] NET: Registered PF_INET protocol family worker2 # [ 0.543304] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.544260] NET: Registered PF_INET protocol family worker1 # [ 0.547132] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.545467] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.538718] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.540049] pnp: PnP ACPI init lb # [ 0.550354] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.551886] clocksource: Switched to clocksource acpi_pm client # [ 0.540926] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.552921] NET: Registered PF_INET protocol family client # [ 0.541914] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.554130] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.543498] pnp: PnP ACPI: found 5 devices client # [ 0.551437] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.552983] clocksource: Switched to clocksource acpi_pm client # [ 0.554113] NET: Registered PF_INET protocol family worker1 # [ 0.563870] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.555440] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.562487] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.565444] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.566701] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.563981] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.568052] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.565291] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.569299] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.566633] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.570848] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.570408] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.567857] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.572382] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.571660] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.568962] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.573742] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.572737] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.570231] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.575083] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.573917] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.571288] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.574865] NET: Registered PF_XDP protocol family lb # [ 0.576323] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.572466] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.575707] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.573418] NET: Registered PF_XDP protocol family lb # [ 0.577442] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.576710] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.574258] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.578782] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.577691] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.575252] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.579884] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.578789] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.576263] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.581055] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.579910] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.577375] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.582014] NET: Registered PF_XDP protocol family worker1 # [ 0.580996] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.582821] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.578476] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.583825] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.582665] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.579575] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.572601] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.584820] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.581252] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.573975] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.585936] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.585021] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.575304] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.587009] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.583481] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.576679] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.588114] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.587442] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.577914] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.589791] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.585763] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.579068] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.589630] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.580431] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.587733] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.592181] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.591408] PCI: CLS 0 bytes, default 64 client # [ 0.581521] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.589434] PCI: CLS 0 bytes, default 64 worker1 # [ 0.592434] Trying to unpack rootfs image as initramfs... client # [ 0.582773] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.594851] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.583744] NET: Registered PF_XDP protocol family worker2 # [ 0.590434] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.584611] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.592154] Trying to unpack rootfs image as initramfs... lb # [ 0.596841] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.585637] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.586673] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.598594] PCI: CLS 0 bytes, default 64 worker1 # [ 0.596652] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.587803] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.588916] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.599592] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.601389] Trying to unpack rootfs image as initramfs... client # [ 0.590029] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.591851] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.594645] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.596969] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.599003] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.600796] PCI: CLS 0 bytes, default 64 client # [ 0.601868] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.603686] Trying to unpack rootfs image as initramfs... worker2 # [ 0.635309] Initialise system trusted keyrings worker1 # [ 0.638234] Initialise system trusted keyrings worker2 # [ 0.638190] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.641386] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.645672] Initialise system trusted keyrings lb # [ 0.648804] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.648868] Initialise system trusted keyrings client # [ 0.651463] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.659409] Key type asymmetric registered worker1 # [ 0.662586] Key type asymmetric registered worker2 # [ 0.660163] Asymmetric key parser 'x509' registered worker1 # [ 0.663288] Asymmetric key parser 'x509' registered worker2 # [ 0.660991] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.664151] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.669054] Key type asymmetric registered worker2 # [ 0.666288] io scheduler mq-deadline registered worker1 # [ 0.669441] io scheduler mq-deadline registered worker2 # [ 0.667057] io scheduler kyber registered worker1 # [ 0.670215] io scheduler kyber registered lb # [ 0.671749] Asymmetric key parser 'x509' registered lb # [ 0.672623] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.669769] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.672957] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.671063] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.674260] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.677913] io scheduler mq-deadline registered lb # [ 0.678767] io scheduler kyber registered worker2 # [ 0.676537] Linux agpgart interface v0.103 worker1 # [ 0.679943] Linux agpgart interface v0.103 worker2 # [ 0.677322] ACPI: bus type drm_connector registered worker1 # [ 0.680747] ACPI: bus type drm_connector registered lb # [ 0.682323] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.683655] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.673452] Key type asymmetric registered worker2 # [ 0.680585] usbcore: registered new interface driver usbserial_generic client # [ 0.674190] Asymmetric key parser 'x509' registered worker1 # [ 0.683774] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.681618] usbserial: USB Serial support registered for generic worker1 # [ 0.684847] usbserial: USB Serial support registered for generic client # [ 0.675026] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.689020] Linux agpgart interface v0.103 worker2 # [ 0.684153] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.684153] Please enable it if your BIOS has the CPPC option. lb # [ 0.689825] ACPI: bus type drm_connector registered worker1 # [ 0.688348] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.686394] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.688348] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.690664] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.681526] io scheduler mq-deadline registered client # [ 0.682304] io scheduler kyber registered lb # [ 0.693140] usbcore: registered new interface driver usbserial_generic lb # [ 0.694242] usbserial: USB Serial support registered for generic worker2 # [ 0.690280] drop_monitor: Initializing network drop monitor service worker2 # [ 0.691448] NET: Registered PF_INET6 protocol family worker1 # [ 0.694474] drop_monitor: Initializing network drop monitor service worker1 # [ 0.695662] NET: Registered PF_INET6 protocol family lb # [ 0.696746] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.686059] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.696746] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.694590] Segment Routing with IPv6 client # [ 0.687316] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.698946] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.698795] Segment Routing with IPv6 worker1 # [ 0.699549] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.697184] In-situ OAM (IOAM) with IPv6 client # [ 0.691266] Linux agpgart interface v0.103 worker2 # [ 0.698255] IPI shorthand broadcast: enabled worker1 # [ 0.701629] IPI shorthand broadcast: enabled client # [ 0.692023] ACPI: bus type drm_connector registered lb # [ 0.703890] drop_monitor: Initializing network drop monitor service lb # [ 0.705073] NET: Registered PF_INET6 protocol family client # [ 0.694854] usbcore: registered new interface driver usbserial_generic client # [ 0.696004] usbserial: USB Serial support registered for generic lb # [ 0.708209] Segment Routing with IPv6 lb # [ 0.708912] In-situ OAM (IOAM) with IPv6 lb # [ 0.711023] IPI shorthand broadcast: enabled worker1 # [ 0.709906] sched_clock: Marking stable (576015509, 133303823)->(785506162, -76186830) client # [ 0.700412] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.707617] sched_clock: Marking stable (574015804, 133111265)->(786462298, -79335229) client # [ 0.700412] Please enable it if your BIOS has the CPPC option. client # [ 0.702656] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.710220] registered taskstats version 1 worker2 # [ 0.711196] Loading compiled-in X.509 certificates worker1 # [ 0.714481] registered taskstats version 1 worker1 # [ 0.715443] Loading compiled-in X.509 certificates client # [ 0.705591] drop_monitor: Initializing network drop monitor service client # [ 0.706785] NET: Registered PF_INET6 protocol family lb # [ 0.719229] sched_clock: Marking stable (585014440, 133715891)->(796915275, -78184944) client # [ 0.710898] Segment Routing with IPv6 client # [ 0.713426] In-situ OAM (IOAM) with IPv6 lb # [ 0.724865] registered taskstats version 1 client # [ 0.714516] IPI shorthand broadcast: enabled lb # [ 0.725835] Loading compiled-in X.509 certificates client # [ 0.722626] sched_clock: Marking stable (589013112, 133374138)->(796132879, -73745629) worker1 # [ 0.733338] Demotion targets for Node 0: null worker2 # [ 0.731134] Demotion targets for Node 0: null worker2 # [ 0.732018] Key type .fscrypt registered worker1 # [ 0.736364] Key type .fscrypt registered client # [ 0.726667] registered taskstats version 1 worker1 # [ 0.737017] Key type fscrypt-provisioning registered client # [ 0.727654] Loading compiled-in X.509 certificates worker2 # [ 0.735140] Key type fscrypt-provisioning registered worker1 # [ 0.737995] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.736082] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.737050] ima: Allocated hash algorithm: sha1 worker1 # [ 0.740337] ima: Allocated hash algorithm: sha1 worker1 # [ 0.741124] ima: No architecture policies found lb # [ 0.742742] Demotion targets for Node 0: null worker2 # [ 0.739158] ima: No architecture policies found lb # [ 0.743640] Key type .fscrypt registered worker1 # [ 0.743332] PM: Magic number: 10:765:738 worker2 # [ 0.741145] PM: Magic number: 10:765:738 lb # [ 0.745741] Key type fscrypt-provisioning registered worker1 # [ 0.745006] RAS: Correctable Errors collector initialized. lb # [ 0.746700] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.742807] RAS: Correctable Errors collector initialized. lb # [ 0.747637] ima: Allocated hash algorithm: sha1 lb # [ 0.750762] ima: No architecture policies found lb # [ 0.753751] PM: Magic number: 10:765:738 lb # [ 0.755419] RAS: Correctable Errors collector initialized. worker2 # [ 0.751807] clk: Disabling unused clocks worker1 # [ 0.756036] clk: Disabling unused clocks client # [ 0.746403] Demotion targets for Node 0: null worker1 # [ 0.758345] PM: genpd: Disabling unused power domains worker2 # [ 0.756162] PM: genpd: Disabling unused power domains client # [ 0.749454] Key type .fscrypt registered client # [ 0.750139] Key type fscrypt-provisioning registered client # [ 0.751120] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.764403] clk: Disabling unused clocks client # [ 0.753405] ima: Allocated hash algorithm: sha1 client # [ 0.754202] ima: No architecture policies found client # [ 0.756409] PM: Magic number: 10:765:738 lb # [ 0.768746] PM: genpd: Disabling unused power domains client # [ 0.758154] RAS: Correctable Errors collector initialized. client # [ 0.769171] clk: Disabling unused clocks client # [ 0.771402] PM: genpd: Disabling unused power domains worker2 # [ 0.919882] Freeing initrd memory: 29060K worker1 # [ 0.922918] Freeing initrd memory: 29056K worker2 # [ 0.923214] Freeing unused decrypted memory: 2028K worker1 # [ 0.926239] Freeing unused decrypted memory: 2028K lb # [ 0.928865] Freeing initrd memory: 29064K worker2 # [ 0.925938] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.928994] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.927036] Write protecting the kernel read-only data: 32768k worker1 # [ 0.930105] Write protecting the kernel read-only data: 32768k lb # [ 0.932151] Freeing unused decrypted memory: 2028K worker2 # [ 0.928945] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.932040] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.930502] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.934876] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.933590] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.935967] Write protecting the kernel read-only data: 32768k lb # [ 0.937935] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.939467] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.934700] Freeing initrd memory: 29056K client # [ 0.938190] Freeing unused decrypted memory: 2028K client # [ 0.941133] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.942268] Write protecting the kernel read-only data: 32768k client # [ 0.944288] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.945920] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.981139] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.984523] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.982232] Run /init as init process worker1 # [ 0.985621] Run /init as init process lb # [ 0.990384] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.991531] Run /init as init process worker2 # [ 0.993296] systemd[1]: Inserted module 'autofs4' worker1 # [ 0.996587] systemd[1]: Inserted module 'autofs4' lb # [ 1.002361] systemd[1]: Inserted module 'autofs4' client # [ 0.996939] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.998033] Run /init as init process worker2 # [ 1.013220] fuse: init (API version 7.45) worker1 # [ 1.016484] fuse: init (API version 7.45) client # [ 1.009602] systemd[1]: Inserted module 'autofs4' lb # [ 1.022355] fuse: init (API version 7.45) worker2 # [ 1.020632] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.023895] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.023035] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.026352] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.029884] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.026094] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.029517] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.032385] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.028142] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.032195] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.035514] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.037571] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.033288] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.034811] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.038351] virtiofs virtio5: discovered new tag: nix-store client # [ 1.029860] fuse: init (API version 7.45) worker1 # [ 1.039988] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.042865] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.044460] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.041431] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.042942] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.037456] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.047124] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.048784] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.046387] virtiofs virtio7: discovered new tag: xchg lb # [ 1.051137] virtiofs virtio6: discovered new tag: shared client # [ 1.040061] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.047879] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.052573] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.052485] virtiofs virtio7: discovered new tag: xchg client # [ 1.043507] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.054035] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.055935] virtiofs virtio7: discovered new tag: xchg client # [ 1.045729] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.057344] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.051590] virtiofs virtio5: discovered new tag: nix-store client # [ 1.053323] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.061320] virtiofs virtio6: discovered new tag: shared client # [ 1.062787] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.070241] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.075117] systemd[1]: Successfully made /usr/ read-only. client # [ 1.066947] virtiofs virtio7: discovered new tag: xchg client # [ 1.068506] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.079916] systemd[1]: Successfully made /usr/ read-only. client # [ 1.090471] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.410707] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.415638] systemd[1]: Detected virtualization kvm. worker1 # [ 1.416475] systemd[1]: Detected architecture x86-64. worker2 # [ 1.405904] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.417322] systemd[1]: Running in initrd. lb # [ 1.415596] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.418356] systemd[1]: Initializing machine ID from random generator. lb # [ 1.420441] systemd[1]: Detected virtualization kvm. worker2 # [ 1.415411] systemd[1]: Detected virtualization kvm. worker1 # [ 1.419479] systemd[1]: Hostname set to . lb # [ 1.421291] systemd[1]: Detected architecture x86-64. lb # [ 1.422152] systemd[1]: Running in initrd. worker2 # [ 1.417491] systemd[1]: Detected architecture x86-64. lb # [ 1.423260] systemd[1]: Initializing machine ID from random generator. lb # [ 1.424495] systemd[1]: Hostname set to . worker2 # [ 1.419572] systemd[1]: Running in initrd. worker2 # [ 1.422000] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.424856] systemd[1]: Hostname set to . client # [ 1.427120] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.439120] systemd[1]: Detected virtualization kvm. client # [ 1.441318] systemd[1]: Detected architecture x86-64. client # [ 1.443494] systemd[1]: Running in initrd. client # [ 1.446064] systemd[1]: Initializing machine ID from random generator. client # [ 1.449036] systemd[1]: Hostname set to . worker1 # [ 1.613638] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.615500] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.651072] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.654825] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.655614] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.651848] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.656805] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.659072] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.658228] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.660232] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.659367] systemd[1]: Reached target Path Units. worker1 # [ 1.660202] systemd[1]: Reached target Slice Units. lb # [ 1.661645] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.661082] systemd[1]: Reached target Swaps. lb # [ 1.662777] systemd[1]: Reached target Path Units. worker1 # [ 1.661890] systemd[1]: Reached target Timer Units. lb # [ 1.663658] systemd[1]: Reached target Slice Units. lb # [ 1.664545] systemd[1]: Reached target Swaps. worker1 # [ 1.662869] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.665344] systemd[1]: Reached target Timer Units. worker1 # [ 1.664092] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.666346] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.665257] systemd[1]: Listening on Journal Sockets. lb # [ 1.667638] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.666260] systemd[1]: Listening on udev Control Socket. lb # [ 1.668780] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.667248] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.668221] systemd[1]: Reached target Socket Units. lb # [ 1.669772] systemd[1]: Listening on udev Control Socket. lb # [ 1.670819] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.670036] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.671803] systemd[1]: Reached target Socket Units. lb # [ 1.673645] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.674390] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.677562] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.677148] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.683896] systemd[1]: Starting Journal Service... lb # [ 1.687923] systemd[1]: Starting Journal Service... worker2 # [ 1.700926] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.707897] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.705499] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.706681] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.708098] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.713375] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.709254] systemd[1]: Reached target Path Units. worker2 # [ 1.710143] systemd[1]: Reached target Slice Units. worker1 # [ 1.712444] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.711007] systemd[1]: Reached target Swaps. worker2 # [ 1.711831] systemd[1]: Reached target Timer Units. worker2 # [ 1.712809] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.714049] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.717863] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.715267] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.716334] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.719385] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.717355] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.718318] systemd[1]: Reached target Socket Units. worker2 # [ 1.720204] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.724920] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.723958] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.732671] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.734015] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.737938] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.740082] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.741489] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.743439] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.733475] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.745713] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.736809] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.734324] systemd[1]: Starting Journal Service... client # [ 1.738084] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.739649] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.751783] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.740843] systemd[1]: Reached target Path Units. client # [ 1.741755] systemd[1]: Reached target Slice Units. client # [ 1.742701] systemd[1]: Reached target Swaps. client # [ 1.743565] systemd[1]: Reached target Timer Units. worker1 # [ 1.752777] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.744708] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.745985] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.747178] systemd[1]: Listening on Journal Sockets. lb # [ 1.758200] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.748194] systemd[1]: Listening on udev Control Socket. client # [ 1.749404] systemd[1]: Listening on udev Kernel Socket. client # [ 1.750435] systemd[1]: Reached target Socket Units. client # [ 1.752359] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.759785] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.764409] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.756239] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.764272] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.771817] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.773017] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.772214] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.781017] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.783640] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.766105] systemd[1]: Starting Journal Service... lb # [ 1.788862] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.785462] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.786746] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.793713] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.791467] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.800540] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.805389] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.795503] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.811321] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.806571] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.812522] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.803577] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.818205] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.822648] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.814709] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.821931] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.827392] systemd[1]: Finished Load Kernel Modules. client # [ 1.817507] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.832292] systemd[1]: Finished Load Kernel Modules. client # [ 1.823338] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.835542] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.841947] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.837329] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.830860] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.837301] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.849483] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.855551] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.847473] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.723857] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.862037] systemd[1]: Started Journal Service. worker1 # [ 1.727323] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.728328] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.858742] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.864024] systemd[1]: Reached target Local File Systems. lb # [ 1.729343] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.733305] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.734431] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.868504] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.738238] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.739464] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.861333] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.869369] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.741310] systemd[1]: Reached target Local File Systems. worker1 # [ 1.875510] systemd[1]: Started Journal Service. lb # [ 1.746062] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.747204] systemd[1]: Finished Apply Kernel Variables. client # [ 1.871568] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.881207] systemd[1]: Finished Load Kernel Modules. lb # [ 1.753151] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.758411] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.889336] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.760883] systemd[1]: Finished Apply Kernel Variables. client # [ 1.889989] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.898643] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.910283] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.780334] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.785224] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.781702] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.785608] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.783346] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.918340] systemd[1]: Started Journal Service. client # [ 1.911951] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.794345] systemd-udevd[74]: Using default interface naming scheme 'v261'. client # [ 1.920483] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.797130] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.798070] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.799114] systemd[1]: Reached target Local File Systems. worker2 # [ 1.801954] systemd[1]: Starting Create System Files and Directories... lb # [ 1.810330] systemd-udevd[76]: Using default interface naming scheme 'v261'. worker2 # [ 1.806842] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.817050] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.943493] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.811678] systemd-modules-load[67]: Inserted module 'dm_mod' client # [ 1.815288] systemd-modules-load[67]: Inserted module 'virtio_balloon' client # [ 1.817342] systemd-modules-load[67]: Inserted module 'virtio_gpu' client # [ 1.951515] systemd[1]: Started Journal Service. lb # [ 1.833071] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.836448] systemd[1]: Finished Create System Files and Directories. client # [ 1.830173] systemd[1]: Finished Apply Kernel Variables. client # [ 1.831078] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.833101] systemd[1]: Reached target Local File Systems. client # [ 1.836873] systemd[1]: Starting Create System Files and Directories... client # [ 1.844082] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.857267] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker1 # [ 1.876077] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.876930] systemd[1]: Reached target System Initialization. worker1 # [ 1.877829] systemd[1]: Reached target Basic System. client # [ 1.870225] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.880781] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.889638] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.890615] systemd[1]: Reached target System Initialization. lb # [ 1.892153] systemd[1]: Reached target Basic System. client # [ 1.894428] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 1.919361] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.933118] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.936090] systemd[1]: Reached target System Initialization. worker2 # [ 1.937547] systemd[1]: Reached target Basic System. client # [ 1.976165] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.978137] systemd[1]: Reached target System Initialization. client # [ 1.980660] systemd[1]: Reached target Basic System. worker1 # [ 2.161944] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.186578] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.202264] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.206018] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.211738] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.212614] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.219848] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.222773] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.229753] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.230481] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.236947] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.237839] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.239644] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.241688] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.242629] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.244394] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.246352] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.248367] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.249522] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.252638] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.254389] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.254322] usb usb1: Product: EHCI Host Controller lb # [ 2.255532] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.254983] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.255982] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.254305] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.257961] hub 1-0:1.0: USB hub found lb # [ 2.259733] usb usb1: Product: EHCI Host Controller lb # [ 2.260436] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.259423] hub 1-0:1.0: 6 ports detected lb # [ 2.262180] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.264917] hub 1-0:1.0: USB hub found lb # [ 2.265460] hub 1-0:1.0: 6 ports detected worker2 # [ 2.260895] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.266949] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.267717] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.265571] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.271348] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.272081] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.275840] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.286107] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.285857] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.283988] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.284907] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.286754] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.288780] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.293067] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.292540] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.294140] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.295321] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.165717] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.297879] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.299518] usb usb1: Product: EHCI Host Controller worker1 # [ 2.301789] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.303331] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.171061] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.302129] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.302862] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.304231] hub 1-0:1.0: USB hub found worker2 # [ 2.305427] hub 1-0:1.0: 6 ports detected worker1 # [ 2.175975] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.178084] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.314877] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.314255] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.318174] SCSI subsystem initialized lb # [ 2.322926] usb usb2: Product: UHCI Host Controller lb # [ 2.323660] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.315668] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.326601] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.316986] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.324738] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.332134] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.331342] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.334703] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.327242] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.329063] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.206944] systemd[1]: Starting Virtual Console Setup... lb # [ 2.209609] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.344561] SCSI subsystem initialized worker1 # [ 2.209323] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.343375] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.213069] systemd[1]: Finished Virtual Console Setup. lb # [ 2.213909] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.337502] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.215869] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.348593] usb usb2: Product: UHCI Host Controller worker1 # [ 2.349269] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.353098] hub 2-0:1.0: USB hub found worker2 # [ 2.353065] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.346957] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.347809] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.357859] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.349702] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.366747] hub 2-0:1.0: 2 ports detected worker1 # [ 2.365691] hub 2-0:1.0: USB hub found worker1 # [ 2.368389] hub 2-0:1.0: 2 ports detected worker2 # [ 2.232652] systemd[1]: Starting Virtual Console Setup... client # [ 2.358510] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.238491] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.368290] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.361990] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.238895] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.364549] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.242699] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.241808] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.242927] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.368396] usb usb1: Product: EHCI Host Controller client # [ 2.369055] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.243212] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.369944] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.371574] hub 1-0:1.0: USB hub found client # [ 2.373063] hub 1-0:1.0: 6 ports detected worker1 # [ 2.383241] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.383976] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.381710] SCSI subsystem initialized worker1 # [ 2.387393] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.388164] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.386352] usb usb2: Product: UHCI Host Controller client # [ 2.379562] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.387046] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.257681] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.380310] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.392197] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.395530] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.396304] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.263738] systemd[1]: Reached target Initrd Root Device. client # [ 2.388484] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.398648] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.389294] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.267068] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.396379] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.401362] usb usb3: Product: UHCI Host Controller worker1 # [ 2.402046] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.404349] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.269917] (udev-worker)[84]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.407044] hub 3-0:1.0: USB hub found lb # [ 2.408117] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.271948] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.408394] hub 3-0:1.0: 2 ports detected client # [ 2.402604] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.276331] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.403787] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.280544] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.416432] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.417267] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.419188] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.416432] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.286273] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.422351] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.423920] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.423161] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.422025] hub 2-0:1.0: USB hub found worker2 # [ 2.423866] hub 2-0:1.0: 2 ports detected lb # [ 2.427775] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.418002] SCSI subsystem initialized lb # [ 2.428933] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.294309] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.430550] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.432866] usb usb3: Product: UHCI Host Controller worker1 # [ 2.431757] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.422403] usb usb2: Product: UHCI Host Controller lb # [ 2.433599] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.423074] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.437852] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.294192] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.437671] usb usb4: Product: UHCI Host Controller lb # [ 2.306320] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.436359] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.439380] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.437053] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.440153] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.442020] hub 3-0:1.0: USB hub found lb # [ 2.444082] hub 3-0:1.0: 2 ports detected worker1 # [ 2.443786] hub 4-0:1.0: USB hub found lb # [ 2.312718] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.445606] hub 4-0:1.0: 2 ports detected client # [ 2.435536] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.305096] systemd[1]: Starting Virtual Console Setup... lb # [ 2.452429] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.315830] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.453395] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.317234] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.452129] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.445424] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.456790] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.452903] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.457625] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.322082] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.461027] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.463778] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.460554] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.463477] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.466096] usb usb4: Product: UHCI Host Controller client # [ 2.322572] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.325148] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.467751] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.472850] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.473635] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.470159] usb usb3: Product: UHCI Host Controller worker2 # [ 2.470835] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.464628] hub 2-0:1.0: USB hub found worker1 # [ 2.474799] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.477227] hub 4-0:1.0: USB hub found worker1 # [ 2.475731] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.478798] hub 4-0:1.0: 2 ports detected worker2 # [ 2.475935] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.477538] hub 3-0:1.0: USB hub found worker2 # [ 2.480172] hub 3-0:1.0: 2 ports detected worker1 # [ 2.483216] scsi host0: ahci client # [ 2.473400] hub 2-0:1.0: 2 ports detected worker1 # [ 2.484882] scsi host1: ahci client # [ 2.341768] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.486186] scsi host2: ahci worker1 # [ 2.488012] scsi host3: ahci client # [ 2.346073] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.489534] scsi host4: ahci worker1 # [ 2.491106] scsi host5: ahci worker2 # [ 2.488265] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.488998] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.492187] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.357573] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.493852] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.495019] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.493192] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.496278] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.497530] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.498699] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.499822] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.490698] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.498145] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.366753] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.504807] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.502296] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.503451] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.508757] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.512773] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.513617] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.502459] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.510944] usb usb4: Product: UHCI Host Controller worker2 # [ 2.511749] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.517489] scsi host0: ahci client # [ 2.374065] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.519073] scsi host1: ahci client # [ 2.374891] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.515300] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.509412] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.521110] scsi host2: ahci client # [ 2.510177] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.517330] hub 4-0:1.0: USB hub found lb # [ 2.522700] scsi host3: ahci worker2 # [ 2.519042] hub 4-0:1.0: 2 ports detected client # [ 2.379299] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.524433] scsi host4: ahci lb # [ 2.526176] scsi host5: ahci lb # [ 2.527581] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.528952] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.517808] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.530170] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.531409] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.520709] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.532597] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.533842] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.526126] usb usb3: Product: UHCI Host Controller client # [ 2.526830] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.529424] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.533715] hub 3-0:1.0: USB hub found client # [ 2.534930] hub 3-0:1.0: 2 ports detected worker2 # [ 2.544522] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.545666] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.547153] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.541462] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.542202] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.545627] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.553059] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.556729] scsi host0: ahci client # [ 2.550418] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.558924] scsi host1: ahci client # [ 2.418578] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.560072] scsi host2: ahci worker2 # [ 2.561995] scsi host3: ahci worker2 # [ 2.563410] scsi host4: ahci client # [ 2.423105] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.565151] scsi host5: ahci worker2 # [ 2.565729] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.560292] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.567865] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.569030] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.562472] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.570206] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.571346] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.565557] usb usb4: Product: UHCI Host Controller worker2 # [ 2.572508] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.566270] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.567028] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.571009] hub 4-0:1.0: USB hub found client # [ 2.573493] hub 4-0:1.0: 2 ports detected client # [ 2.580064] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.581262] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.591516] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.604722] scsi host0: ahci client # [ 2.608337] scsi host1: ahci client # [ 2.610411] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.611888] scsi host2: ahci client # [ 2.616686] scsi host3: ahci client # [ 2.619166] scsi host4: ahci client # [ 2.621000] scsi host5: ahci worker1 # [ 2.629566] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.622177] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.623853] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.632437] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.625053] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.626221] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.635626] usb 1-1: Product: QEMU USB Tablet client # [ 2.627413] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.637569] usb 1-1: Manufacturer: QEMU client # [ 2.628571] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.638100] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.639193] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.641001] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.644329] usb 1-1: Product: QEMU USB Tablet lb # [ 2.646160] usb 1-1: Manufacturer: QEMU lb # [ 2.647885] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.673122] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.680217] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.677247] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.680019] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.683443] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.685252] usb 1-1: Manufacturer: QEMU worker2 # [ 2.686867] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.718747] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.596572] systemd[1]: Mounting /sysroot... lb # [ 2.601967] systemd[1]: Mounting /sysroot... client # [ 2.739537] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.740749] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.742049] usb 1-1: Product: QEMU USB Tablet client # [ 2.742736] usb 1-1: Manufacturer: QEMU client # [ 2.743298] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.757595] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.649215] systemd[1]: Mounting /sysroot... worker1 # [ 2.812644] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.814862] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.817391] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.819890] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.822235] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.824475] ata3.00: applying bridge limits client # [ 2.683593] systemd[1]: Mounting /sysroot... worker1 # [ 2.826398] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.828730] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.830991] ata3.00: configured for UDMA/100 worker1 # [ 2.833400] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.845909] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.848187] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.850912] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.853213] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.855483] ata3.00: applying bridge limits lb # [ 2.857423] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.859887] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.862237] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.864612] ata3.00: configured for UDMA/100 lb # [ 2.867219] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.882196] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.883972] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.886046] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.887809] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.889511] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.891245] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.893055] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.895229] ata3.00: applying bridge limits worker2 # [ 2.896655] ata3.00: configured for UDMA/100 worker2 # [ 2.898550] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.908211] usbcore: registered new interface driver usbhid worker1 # [ 2.909037] usbhid: USB HID core driver worker1 # [ 2.927482] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.940509] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.942225] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.944432] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.948053] usbcore: registered new interface driver usbhid lb # [ 2.948836] usbhid: USB HID core driver client # [ 2.939725] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.940706] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.941814] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.942722] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.943632] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.944658] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.945492] ata3.00: applying bridge limits client # [ 2.946176] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.947155] ata3.00: configured for UDMA/100 client # [ 2.948224] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.958504] EXT4-fs (vda): mounted filesystem 688df2ac-7044-48b9-9783-5d722ba44790 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.956530] usbcore: registered new interface driver usbhid lb # [ 2.961877] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.830171] systemd[1]: Mounted /sysroot. worker2 # [ 2.963508] usbhid: USB HID core driver worker1 # [ 2.833062] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.837067] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.974971] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.976951] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.978578] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.851312] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.854783] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.857981] systemd[1]: Reloading... worker2 # [ 2.990347] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.992423] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.997913] EXT4-fs (vda): mounted filesystem 68373e2e-e441-4427-b5a7-8bf2eee61f33 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.997430] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.870181] systemd[1]: Mounted /sysroot. lb # [ 2.873156] systemd[1]: Reached target Initrd Root File System. lb # [ 2.874638] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.998981] usbcore: registered new interface driver usbhid worker2 # [ 3.008271] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 3.010664] EXT4-fs (vda): mounted filesystem 82997474-45fa-4f34-9f32-e5a34a68465a r/w with ordered data mode. Quota mode: none. client # [ 3.005794] usbhid: USB HID core driver worker2 # [ 2.883263] systemd[1]: Mounted /sysroot. worker2 # [ 2.885719] systemd[1]: Reached target Initrd Root File System. lb # [ 2.890862] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.888735] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.017860] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.896071] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.897540] systemd[1]: Reloading... client # [ 3.022837] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 2.904127] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.909900] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.911381] systemd[1]: Reloading... client # [ 3.058582] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.935401] systemd[1]: Reloading finished in 78 ms. client # [ 3.066660] EXT4-fs (vda): mounted filesystem accde53a-de24-4fec-b7f0-5a65914d7031 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.944271] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... client # [ 3.068933] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.937702] systemd[1]: Mounted /sysroot. client # [ 2.938950] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.949154] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... client # [ 2.941550] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.951749] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.953095] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.954137] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 2.956280] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.959100] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.960607] systemd[1]: Reloading... lb # [ 2.977675] systemd[1]: Reloading finished in 81 ms. lb # [ 2.986081] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... lb # [ 2.991151] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... lb # [ 2.995145] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 2.992908] systemd[1]: Reloading finished in 84 ms. lb # [ 2.996896] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 2.997822] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.001524] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.006171] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker2 # [ 3.008985] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.010384] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.012276] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.044989] systemd[1]: Reloading finished in 83 ms. client # [ 3.054318] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... client # [ 3.059182] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... client # [ 3.061907] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.063283] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.064347] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.598276] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.603338] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.605161] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.610209] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.614172] systemd[1]: Mounting /sysroot/run... lb # [ 3.618304] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.624160] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.626309] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.635676] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.640687] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.649824] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.653789] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.657148] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.661145] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.668562] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.666150] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.674846] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.675884] systemd[1]: Mounted /sysroot/run. lb # [ 3.677684] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.680461] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.682727] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.682326] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.684309] systemd[1]: Mounted /sysroot/run. lb # [ 3.685938] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.685224] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.689853] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.693648] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.683108] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.695155] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.686070] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.696549] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.698623] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.690132] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.697546] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.699156] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.699867] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.700555] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.704347] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.693956] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.701306] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.705812] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.705114] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.702981] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.715451] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.718356] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.719398] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.717085] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.720893] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.719254] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.723466] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.722385] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.725848] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.729111] systemd[1]: Mounted /sysroot/run. client # [ 3.730402] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.741958] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.740772] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.734714] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.742075] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.743881] systemd[1]: Starting Find NixOS closure... client # [ 3.737928] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.748683] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.746352] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.749909] systemd[1]: Reached target Initrd Default Target. worker1 # [ 3.751842] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.748271] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.749758] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.751750] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.764987] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.766478] systemd[1]: Stopped target Basic System. worker2 # [ 3.763884] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 3.767376] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.768334] systemd[1]: Stopped target Path Units. worker1 # [ 3.770106] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.771161] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.772191] systemd[1]: Stopped target Slice Units. worker1 # [ 3.773070] systemd[1]: Stopped target Socket Units. worker2 # [ 3.771244] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.773817] systemd[1]: Stopped target System Initialization. worker1 # [ 3.774636] systemd[1]: Stopped target Swaps. worker2 # [ 3.772517] systemd[1]: Reached target Initrd Default Target. worker1 # [ 3.775312] systemd[1]: Stopped target Timer Units. worker1 # [ 3.776224] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.774456] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.777791] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.778674] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.779703] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.780899] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.771600] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.782117] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.772683] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.783164] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.774255] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.784182] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.786302] systemd[1]: Stopped Load Kernel Modules. client # [ 3.777138] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.787237] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.788455] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.789825] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.788441] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.791050] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.792241] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.789761] systemd[1]: Stopped target Basic System. worker2 # [ 3.790604] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.793147] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.791708] systemd[1]: Stopped target Path Units. worker1 # [ 3.795160] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.793119] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.796302] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.794124] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.795258] systemd[1]: Stopped target Slice Units. worker1 # [ 3.798073] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.795977] systemd[1]: Stopped target Socket Units. worker1 # [ 3.799106] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.796803] systemd[1]: Stopped target System Initialization. worker1 # [ 3.800067] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.797813] systemd[1]: Stopped target Swaps. worker2 # [ 3.798837] systemd[1]: Stopped target Timer Units. worker2 # [ 3.799755] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.800783] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.802140] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.795059] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.803163] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.804578] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.805481] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.809175] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.807336] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.810562] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.801863] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.809211] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.810181] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.810889] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.803911] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.811895] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.804967] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.812902] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.813864] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.818094] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.816503] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.819410] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.817331] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.818261] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.820916] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.819242] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.822355] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.821173] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.823755] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.825684] systemd[1]: Closed udev Control Socket. worker2 # [ 3.823193] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.824155] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.826645] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.827953] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.818494] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.829054] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.819762] systemd[1]: Stopped target Basic System. worker1 # [ 3.829920] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.820728] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.831280] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.822108] systemd[1]: Stopped target Path Units. client # [ 3.822771] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.833135] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.823820] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.834044] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.831689] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.824831] systemd[1]: Stopped target Slice Units. client # [ 3.825764] systemd[1]: Stopped target Socket Units. client # [ 3.826729] systemd[1]: Stopped target System Initialization. client # [ 3.827733] systemd[1]: Stopped target Swaps. client # [ 3.828665] systemd[1]: Stopped target Timer Units. worker2 # [ 3.836118] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.830134] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.830977] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.831771] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.832738] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.840620] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.834052] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.842187] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.835173] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.836241] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.837277] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.847484] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.846095] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.839298] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.847114] systemd[1]: Closed udev Control Socket. worker1 # [ 3.850105] systemd[1]: Finished Cleanup udev Database. client # [ 3.840288] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.850858] systemd[1]: Reached target Switch Root. client # [ 3.841537] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.849102] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.852279] systemd[1]: Starting NixOS Activation... worker2 # [ 3.849873] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.843118] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.850881] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.844188] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.851765] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.845045] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.853129] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.854091] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.847111] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.848033] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.848937] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.856111] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.856931] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.849873] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.858684] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.852070] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.853098] systemd[1]: Stopped Virtual Console Setup. client # [ 3.859924] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 3.862436] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.874462] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.876105] systemd[1]: Finished Cleanup udev Database. worker2 # [ 3.877301] systemd[1]: Reached target Switch Root. client # [ 3.870311] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.879051] systemd[1]: Starting NixOS Activation... client # [ 3.873065] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.874088] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 3.875153] systemd[1]: Closed udev Control Socket. client # [ 3.877212] systemd[1]: Starting Cleanup udev Database... client # [ 3.879986] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.881079] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.881939] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.883099] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.884070] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 3.884974] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 3.887199] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.888224] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.902814] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.904486] systemd[1]: Finished Cleanup udev Database. client # [ 3.906132] systemd[1]: Reached target Switch Root. client # [ 3.907652] systemd[1]: Starting NixOS Activation... worker1 # [ 3.921253] initrd-nixos-activation-start[190]: booting system configuration /nix/store/31zfsnqjsdrlaxry041lgw659q8r9wr8-nixos-system-worker1-test worker2 # [ 3.941504] initrd-nixos-activation-start[190]: booting system configuration /nix/store/34sn5q3k4s5dxk2cjrq9ddxmzik393xp-nixos-system-worker2-test worker1 # [ 3.947623] initrd-nixos-activation-start[190]: running activation script... worker2 # [ 3.965897] initrd-nixos-activation-start[190]: running activation script... client # [ 3.973077] initrd-nixos-activation-start[190]: booting system configuration /nix/store/p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test client # [ 3.997439] initrd-nixos-activation-start[190]: running activation script... worker1 # [ 4.136543] initrd-nixos-activation-start[213]: setting up /etc... worker2 # [ 4.144818] initrd-nixos-activation-start[213]: setting up /etc... client # [ 4.199382] initrd-nixos-activation-start[213]: setting up /etc... worker1 # [ 4.238651] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.241064] systemd[1]: Finished NixOS Activation. worker1 # [ 4.242182] systemd[1]: Starting Switch Root... worker2 # [ 4.243944] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.246196] systemd[1]: Finished NixOS Activation. worker2 # [ 4.247418] systemd[1]: Starting Switch Root... worker1 # [ 4.254446] systemd[1]: Switching root. worker2 # [ 4.262343] systemd[1]: Switching root. client # [ 4.303144] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.305203] systemd[1]: Finished NixOS Activation. client # [ 4.306522] systemd[1]: Starting Switch Root... client # [ 4.320173] systemd[1]: Switching root. worker1 # [ 4.514386] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.531091] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 4.585686] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.600886] NET: Registered PF_VSOCK protocol family worker2 # [ 4.619159] NET: Registered PF_VSOCK protocol family client # [ 4.681191] NET: Registered PF_VSOCK protocol family lb # [ 4.603438] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.653975] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.655458] systemd[1]: Reached target Initrd File Systems. lb # [ 4.657213] systemd[1]: Starting Find NixOS closure... lb # [ 4.660132] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.680056] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.683130] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.689704] systemd[1]: Finished Find NixOS closure. lb # [ 4.690954] systemd[1]: Reached target Initrd Default Target. lb # [ 4.693076] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.706825] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.709241] systemd[1]: Stopped target Basic System. lb # [ 4.710033] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.710827] systemd[1]: Stopped target Path Units. lb # [ 4.711530] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.712529] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.713530] systemd[1]: Stopped target Slice Units. lb # [ 4.714232] systemd[1]: Stopped target Socket Units. lb # [ 4.714940] systemd[1]: Stopped target System Initialization. lb # [ 4.715828] systemd[1]: Stopped target Swaps. lb # [ 4.716602] systemd[1]: Stopped target Timer Units. lb # [ 4.718141] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.718972] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.719834] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.720912] systemd[1]: Stopped Find NixOS closure. lb # [ 4.722241] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.723257] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.725243] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.727746] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.728763] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.730087] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.731263] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.732342] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.733629] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.734536] systemd[1]: Stopped target Local File Systems. lb # [ 4.735582] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.737125] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.739278] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.740096] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.741124] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.742421] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.752917] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.756135] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.757093] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.760073] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.763076] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.764173] systemd[1]: Closed udev Control Socket. lb # [ 4.766746] systemd[1]: Starting Cleanup udev Database... lb # [ 4.767633] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.769137] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.770027] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.771106] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.773114] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.774076] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.775200] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.776571] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.792386] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.793964] systemd[1]: Finished Cleanup udev Database. lb # [ 4.795217] systemd[1]: Reached target Switch Root. lb # [ 4.796842] systemd[1]: Starting NixOS Activation... worker1 # [ 4.959146] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 4.968899] systemd[1]: Detected virtualization kvm. worker1 # [ 4.970718] systemd[1]: Detected architecture x86-64. worker1 # [ 4.972767] systemd[1]: Detected first boot. worker1 # [ 4.976576] systemd[1]: Initializing machine ID from random generator. worker2 # [ 4.981418] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 4.991887] systemd[1]: Detected virtualization kvm. worker2 # [ 4.993910] systemd[1]: Detected architecture x86-64. worker2 # [ 4.996041] systemd[1]: Detected first boot. lb # [ 4.870829] initrd-nixos-activation-start[190]: booting system configuration /nix/store/ywx2cfw2bd45f1sp7w8ib468r0dscq27-nixos-system-lb-test worker2 # [ 5.000200] systemd[1]: Initializing machine ID from random generator. lb # [ 4.902755] initrd-nixos-activation-start[190]: running activation script... client # [ 5.039184] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.043054] systemd[1]: Detected virtualization kvm. client # [ 5.043765] systemd[1]: Detected architecture x86-64. client # [ 5.044560] systemd[1]: Detected first boot. client # [ 5.046965] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.212238] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.106262] initrd-nixos-activation-start[213]: setting up /etc... worker2 # [ 5.243927] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.269346] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.331613] systemd[1]: Applying preset policy. lb # [ 5.213456] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.343812] systemd[1]: Applying preset policy. lb # [ 5.215185] systemd[1]: Finished NixOS Activation. lb # [ 5.217241] systemd[1]: Starting Switch Root... lb # [ 5.230653] systemd[1]: Switching root. client # [ 5.368068] systemd[1]: Applying preset policy. lb # [ 5.490853] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.502898] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.521683] systemd[1]: Populated /etc with preset unit settings. client # [ 5.537907] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.566884] NET: Registered PF_VSOCK protocol family worker1 # [ 5.691501] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.692944] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.695277] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.697765] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.699204] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.700321] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.701556] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.702768] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.703549] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.704264] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.705089] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.705852] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.706684] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.707579] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.708569] systemd[1]: Reached target Path Units. worker1 # [ 5.709269] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.710053] systemd[1]: Reached target Slice Units. worker2 # [ 5.707743] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.709313] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.711521] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.713595] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.714914] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.715881] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.717077] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.718204] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.718911] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.710836] systemd[1]: Reached target Swaps. worker2 # [ 5.719662] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.720570] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.721321] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.722138] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.724604] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.723002] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.723933] systemd[1]: Reached target Path Units. worker2 # [ 5.724633] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.727476] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.725397] systemd[1]: Reached target Slice Units. worker2 # [ 5.726128] systemd[1]: Reached target Swaps. worker1 # [ 5.729413] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 5.721096] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.728074] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.731335] systemd[1]: Listening on Factory Reset Management. client # [ 5.722460] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.732214] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.730474] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.724784] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.735055] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.736392] systemd[1]: Listening on Journal Audit Socket. client # [ 5.726783] systemd[1]: Created slice Slice /system/getty. client # [ 5.728108] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.738758] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.729011] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.730198] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.740156] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 5.731292] systemd[1]: Expecting device /dev/hvc0... client # [ 5.732011] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.741259] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.732774] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.742614] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 5.733640] systemd[1]: Stopped target initrd-fs.target. client # [ 5.734399] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.735169] systemd[1]: Stopped target initrd-switch-root.target. client # [ 5.736001] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.736888] systemd[1]: Reached target Path Units. worker2 # [ 5.732221] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.746641] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.737600] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.747745] systemd[1]: Listening on udev Control Socket. client # [ 5.738428] systemd[1]: Reached target Slice Units. worker2 # [ 5.745761] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.748668] systemd[1]: Listening on udev Varlink Socket. client # [ 5.739101] systemd[1]: Reached target Swaps. worker2 # [ 5.746682] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.750801] systemd[1]: Mounting Huge Pages File System... client # [ 5.740870] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.749602] systemd[1]: Starting Journal Log Access Socket... client # [ 5.743341] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.750713] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.753622] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.753433] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.754566] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.755657] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.756988] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.760727] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.760863] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.761898] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.762744] systemd[1]: Listening on udev Varlink Socket. client # [ 5.745064] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.764880] systemd[1]: Mounting Huge Pages File System... client # [ 5.758420] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.768265] systemd[1]: Mounting Kernel Trace File System... client # [ 5.759397] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.768309] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.762092] systemd[1]: Starting Journal Log Access Socket... client # [ 5.763541] systemd[1]: Listening on Journal Audit Socket. client # [ 5.766233] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.776567] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.767341] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.774969] systemd[1]: Mounting Kernel Debug File System... client # [ 5.768477] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.769759] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.780373] systemd[1]: Mounting Kernel Trace File System... client # [ 5.773618] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 5.774669] systemd[1]: Listening on udev Control Socket. client # [ 5.775580] systemd[1]: Listening on udev Varlink Socket. client # [ 5.777732] systemd[1]: Mounting Huge Pages File System... client # [ 5.780107] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.790404] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.791306] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.789204] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.786761] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.798947] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.801469] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.794807] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.802034] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.809078] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.803745] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.811277] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.816908] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.821548] systemd[1]: Mounting FUSE Control File System... client # [ 5.814583] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.827140] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.828353] systemd[1]: Mounting FUSE Control File System... client # [ 5.823491] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.833475] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.840537] systemd[1]: Starting Journal Service... client # [ 5.831458] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.842271] systemd[1]: Starting Journal Service... worker1 # [ 5.845885] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.847393] systemd[1]: Starting Load Kernel Modules... worker1 # [ 5.853239] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 5.843674] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.857460] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.855593] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.859485] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.865115] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.862828] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 5.856926] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.864753] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.858684] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.870027] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 5.872813] systemd[1]: Mounted Huge Pages File System. worker1 # [ 5.874538] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.872889] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.877986] systemd[1]: Mounted Kernel Debug File System. client # [ 5.869678] systemd[1]: Starting Journal Service... worker1 # [ 5.880538] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.878156] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 5.882004] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.880187] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.881067] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.883763] systemd[1]: Mounted Kernel Debug File System. client # [ 5.877052] systemd[1]: Starting Load Kernel Modules... worker1 # [ 5.888604] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.886865] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.889170] systemd[1]: Mounted FUSE Control File System. client # [ 5.883275] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.892833] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 5.894629] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.891533] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.899140] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.898545] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.908214] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 5.925169] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 5.928357] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.921699] systemd-journald[283]: Collecting audit messages is enabled. worker1 # [ 5.933416] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.930745] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.932129] systemd[1]: Finished Load Kernel Module configfs. lb # [ 5.928691] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.938541] systemd[1]: Detected virtualization kvm. client # [ 5.928399] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.936635] systemd[1]: Mounting Kernel Configuration File System... lb # [ 5.940424] systemd[1]: Detected architecture x86-64. lb # [ 5.942421] systemd[1]: Detected first boot. client # [ 5.935386] systemd[1]: Mounted Huge Pages File System. lb # [ 5.946414] systemd[1]: Initializing machine ID from random generator. client # [ 5.940424] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.946022] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 5.956637] systemd[1]: Mounted Kernel Configuration File System. client # [ 5.951950] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.959364] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 5.964655] EXT4-fs (vda): re-mounted 688df2ac-7044-48b9-9783-5d722ba44790. worker2 # [ 5.963248] EXT4-fs (vda): re-mounted 82997474-45fa-4f34-9f32-e5a34a68465a. client # [ 5.961235] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.829313] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.831384] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 5.974868] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 5.966968] systemd[1]: Started Journal Service. worker1 # [ 5.976883] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.974662] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.975826] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 5.979394] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 5.979180] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.839704] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 5.985002] systemd-journald[283]: Collecting audit messages is enabled. client # [ 5.843098] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 5.986622] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.984807] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.985842] systemd-journald[283]: Collecting audit messages is enabled. worker1 # [ 5.988353] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.986774] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.996997] loop: module loaded worker2 # [ 5.996759] loop: module loaded client # [ 5.861081] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 6.005789] systemd[1]: Finished Load Kernel Modules. client # [ 5.999852] EXT4-fs (vda): re-mounted accde53a-de24-4fec-b7f0-5a65914d7031. worker1 # [ 6.009729] systemd[1]: Finished Load Kernel Modules. client # [ 5.869723] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 6.014525] systemd[1]: Starting Firewall... worker2 # [ 6.012329] systemd[1]: Starting Firewall... client # [ 6.005538] loop: module loaded worker1 # [ 6.018374] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.016797] systemd[1]: Starting Apply Kernel Variables... client # [ 5.877573] systemd-modules-load[284]: Inserted module 'loop' client # [ 5.885555] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 5.889141] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 5.904175] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.905111] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.050831] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 5.910206] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.050526] systemd[1]: Started Journal Service. worker1 # [ 6.053685] systemd[1]: Started Journal Service. client # [ 5.910992] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.922949] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.914521] systemd[1]: Mounted FUSE Control File System. worker1 # [ 5.924593] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 5.915523] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 5.921840] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.926335] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 5.929412] systemd-modules-load[284]: Inserted module 'loop' client # [ 5.922180] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.930953] systemd-modules-load[284]: Inserted module 'loop' worker1 # [ 5.937162] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 5.940318] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 5.939129] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 5.942167] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 5.947140] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 5.940912] systemd[1]: Starting Apply Kernel Variables... client # [ 5.941722] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.954144] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 5.956193] systemd[1]: Reached target First Boot Complete. worker1 # [ 5.968610] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 5.970140] systemd[1]: Reached target First Boot Complete. client # [ 6.112983] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 5.995256] systemd-oomd[285]: No swap; memory pressure usage will be degraded worker1 # [ 6.003246] systemd-oomd[285]: No swap; memory pressure usage will be degraded worker1 # [ 6.141414] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.011110] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.013456] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.148057] systemd-journald[283]: Received client request to flush runtime journal. lb # [ 6.175415] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.064414] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.066594] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.068348] systemd[1]: Reached target First Boot Complete. client # [ 6.072380] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.104514] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.106222] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 6.106978] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.098235] systemd[1]: Finished Apply Kernel Variables. client # [ 6.102076] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.112210] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.113137] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.104568] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.115357] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.116455] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.121105] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 6.124116] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.125243] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.296166] systemd[1]: Applying preset policy. client # [ 6.157318] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.168443] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.170173] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.172144] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.197555] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker2 # [ 6.205369] systemd-udevd[317]: Using default interface naming scheme 'v261'. client # [ 6.204101] systemd-udevd[315]: Using default interface naming scheme 'v261'. client # [ 6.236111] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.269700] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.276407] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.463296] systemd[1]: Populated /etc with preset unit settings. client # [ 6.319084] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.327198] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 6.337362] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.367063] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 6.382180] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.403267] (udev-worker)[318]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.410283] (udev-worker)[321]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.412554] (udev-worker)[321]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.426942] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.429740] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.491464] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.492958] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.494373] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.496410] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.498130] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.499337] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.516098] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 6.655939] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.657267] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.659276] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.661346] systemd[1]: Created slice Slice /system/getty. worker2 # [ 6.524156] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 6.662762] systemd[1]: Created slice User and Session Slice. lb # [ 6.663632] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.664839] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.665899] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.666577] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.667349] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.668184] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.668956] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.669736] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.670581] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.671520] systemd[1]: Reached target Path Units. lb # [ 6.672242] systemd[1]: Reached target Remote File Systems. lb # [ 6.673005] systemd[1]: Reached target Slice Units. lb # [ 6.673735] systemd[1]: Reached target Swaps. lb # [ 6.675551] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 6.678086] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.679940] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.546191] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 6.549129] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 6.681918] systemd[1]: Listening on Factory Reset Management. lb # [ 6.694387] systemd[1]: Listening on Hostname Service Socket. client # [ 6.684458] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 6.561589] systemd[1]: Mounting /run/wrappers... lb # [ 6.697238] systemd[1]: Starting Journal Log Access Socket... lb # [ 6.698921] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.701598] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.702763] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.703857] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.705140] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.709048] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.710063] systemd[1]: Listening on udev Control Socket. worker2 # [ 6.572459] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.710920] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.712965] systemd[1]: Mounting Huge Pages File System... lb # [ 6.715237] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.579163] systemd[1]: Mounting /run/wrappers... client # [ 6.710181] ACPI: button: Power Button [PWRF] lb # [ 6.721874] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.730099] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.594676] (udev-worker)[350]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.597642] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.592341] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.602610] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.603938] systemd[1]: Reached target Local File Systems. lb # [ 6.738952] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.728058] mousedev: PS/2 mouse device common for all mice worker1 # [ 6.606166] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 6.609460] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.606243] (udev-worker)[358]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.735153] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 6.609178] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.613068] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.748984] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.614790] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.618227] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 6.618103] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.621317] systemd[1]: Starting Create System Files and Directories... worker2 # [ 6.619749] systemd[1]: Reached target Local File Systems. lb # [ 6.757182] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.623086] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 6.626765] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.629358] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.764646] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.629417] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 6.630643] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.635849] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 6.776125] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.765662] parport_pc 00:02: reported by Plug and Play ACPI client # [ 6.766986] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 6.641137] systemd[1]: Starting Create System Files and Directories... client # [ 6.638508] systemd[1]: Mounted /run/wrappers. client # [ 6.639273] systemd[1]: Reached target Local File Systems. client # [ 6.773575] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 6.775051] rtc_cmos PNP0B00:00: setting system clock to 2026-09-21T14:43:18 UTC (1790001798) lb # [ 6.787783] systemd[1]: Mounting FUSE Control File System... client # [ 6.776602] systemd-journald[283]: Time jumped backwards, rotating. client # [ 6.777652] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 6.788650] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.806017] systemd[1]: Starting Journal Service... lb # [ 6.810504] systemd[1]: Starting Load Kernel Modules... lb # [ 6.822663] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.832481] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.837866] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.692973] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.843747] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.700635] systemd[1]: Starting register-nix-paths.service... client # [ 6.707599] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.708896] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.711944] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.723851] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.859942] systemd-journald[283]: Collecting audit messages is enabled. worker1 # [ 6.727978] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.863489] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.728178] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.868593] systemd[1]: Mounted Huge Pages File System. client # [ 6.724447] systemd[1]: Starting Create System Files and Directories... worker2 # [ 6.733481] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.872326] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.878053] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.881408] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.754591] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.755906] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.890737] systemd[1]: Started Journal Service. lb # [ 6.764244] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.757072] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.768402] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 6.771276] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.907869] loop: module loaded client # [ 6.763458] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.774862] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.776135] systemd[1]: Finished Create System Files and Directories. lb # [ 6.779895] systemd-modules-load[284]: Inserted module 'loop' worker1 # [ 6.782225] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.784194] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.790112] systemd[1]: Finished Load Kernel Modules. lb # [ 6.796430] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 6.793200] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.799054] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.804149] systemd[1]: Starting Firewall... worker2 # [ 6.801569] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.944771] EXT4-fs (vda): re-mounted 68373e2e-e441-4427-b5a7-8bf2eee61f33. lb # [ 6.818905] systemd[1]: Starting Apply Kernel Variables... client # [ 6.808396] systemd[1]: Finished Create System Files and Directories. lb # [ 6.823149] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.827238] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.817182] systemd[1]: Starting Rebuild Journal Catalog... client # [ 6.821540] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.838092] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.844623] systemd-oomd[286]: No swap; memory pressure usage will be degraded lb # [ 6.856136] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.857208] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.860966] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 6.866452] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.867382] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.868595] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.781653] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 6.880746] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.885935] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 6.918391] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 6.921129] systemd[1]: Starting Update is Completed... client # [ 6.912521] systemd[1]: Finished Rebuild Journal Catalog. client # [ 6.918139] systemd[1]: Starting Update is Completed... lb # [ 7.066549] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.937084] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.941826] systemd[1]: Starting Update is Completed... client # [ 6.968329] systemd[1]: Finished Update is Completed. client # [ 6.840812] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 6.932894] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.005876] Console: switching to colour dummy device 80x25 worker1 # [ 7.006909] systemd[1]: Finished Update is Completed. client # [ 7.135830] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.135833] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.138141] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.138823] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.018176] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.020175] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.024471] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.025805] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 7.023115] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.028409] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.029189] systemd[1]: Reached target First Boot Complete. worker2 # [ 7.025153] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.028506] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.033111] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 7.031629] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.034212] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.160930] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 7.040113] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.163214] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.039733] systemd[1]: Finished Update is Completed. lb # [ 7.043631] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 7.168428] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.169088] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.053862] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.057094] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.059913] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.062190] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.064537] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.066718] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.069943] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.133863] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.146132] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.147090] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.149724] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.297562] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.156875] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.307999] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.178800] systemd[1]: Finished Firewall. worker2 # [ 7.317738] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.324265] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.192831] systemd-udevd[324]: Using default interface naming scheme 'v261'. worker2 # [ 7.197538] systemd[1]: Finished Firewall. client # [ 7.328206] Console: switching to colour frame buffer device 160x50 client # [ 7.347385] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 7.242570] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.266527] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.269554] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.406550] ppdev: user-space parallel port driver worker2 # [ 7.286478] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.289250] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.291699] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.295189] systemd[1]: Stopped Virtual Console Setup. client # [ 7.307853] systemd[1]: Starting Virtual Console Setup... client # [ 7.332440] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.337606] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.352841] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.361303] ACPI: button: Power Button [PWRF] worker2 # [ 7.426006] mousedev: PS/2 mouse device common for all mice client # [ 7.484980] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 7.479494] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.480952] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.481035] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.487432] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.487499] rtc_cmos PNP0B00:00: setting system clock to 2026-09-21T14:43:19 UTC (1790001799) worker2 # [ 7.487571] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.358635] ACPI: button: Power Button [PWRF] worker1 # [ 7.451452] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.507043] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 7.458606] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.465810] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 7.465881] rtc_cmos PNP0B00:00: setting system clock to 2026-09-21T14:43:19 UTC (1790001799) worker2 # [ 7.489346] Console: switching to colour dummy device 80x25 worker2 # [ 7.492074] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.525789] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 7.390482] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.392770] systemd[1]: Stopped Virtual Console Setup. client # [ 7.399636] systemd[1]: Starting Virtual Console Setup... lb # [ 7.434908] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.565846] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.566304] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.465965] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.476726] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 7.452796] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.476805] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.481953] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.509572] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.602508] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.514345] Console: switching to colour dummy device 80x25 worker2 # [ 7.614118] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.617454] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.617456] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.488198] (udev-worker)[352]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.490490] (udev-worker)[352]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.625586] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.626232] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.620179] kvm_amd: TSC scaling supported client # [ 7.620635] kvm_amd: Nested Virtualization enabled client # [ 7.621083] kvm_amd: Nested Paging enabled client # [ 7.622423] kvm_amd: LBR virtualization supported client # [ 7.622863] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.623855] kvm_amd: Virtual GIF supported lb # [ 7.500948] (udev-worker)[355]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.624291] kvm_amd: Virtual NMI enabled worker1 # [ 7.639454] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.640112] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.649066] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.649750] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.526979] systemd[1]: Mounting /run/wrappers... client # [ 7.665058] EDAC MC: Ver: 3.0.0 lb # [ 7.568805] systemd[1]: Mounted /run/wrappers. lb # [ 7.569883] systemd[1]: Reached target Local File Systems. lb # [ 7.573966] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.577250] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.576228] systemd[1]: Finished register-nix-paths.service. worker1 # [ 7.578734] systemd[1]: Reached target System Initialization. worker1 # [ 7.579610] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.581478] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.581151] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.582500] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.582167] systemd[1]: Reached target Timer Units. worker1 # [ 7.583121] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 7.583955] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.591107] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.590478] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 7.593126] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 7.594340] systemd[1]: Reached target Socket Units. worker1 # [ 7.597477] systemd[1]: Reached target Basic System. worker1 # [ 7.598569] systemd[1]: Started backdoor.service. worker1 # [ 7.600140] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.601830] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.602820] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 7.609420] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.611179] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.617178] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.618807] systemd[1]: Reached target System Initialization. worker1 # [ 7.621425] systemd[1]: Starting resolvconf update... worker2 # [ 7.621433] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 7.625071] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 7.622921] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.624350] systemd[1]: Reached target Timer Units. worker2 # [ 7.625858] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.626761] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.628163] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 7.629661] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.631890] systemd[1]: Reached target Socket Units. worker2 # [ 7.633121] systemd[1]: Reached target Basic System. worker2 # [ 7.635695] systemd[1]: Started backdoor.service. worker2 # [ 7.638111] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.643177] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.650145] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.653295] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.710615] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.661852] systemd[1]: Starting resolvconf update... worker2 # [ 7.666085] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.682751] systemd[1]: Finished register-nix-paths.service. worker1 # [ 7.700308] systemd[1]: Starting Virtual Console Setup... lb # [ 7.703361] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.698430] systemd-vconsole-setup[420]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 7.710761] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.702072] systemd[1]: Finished Virtual Console Setup. worker1 # [ 7.712142] systemd[1]: Finished Post-Boot Actions. client # [ 7.703701] systemd[1]: Reached target System Initialization. client # [ 7.705111] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.716537] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.706557] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 7.717668] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.707595] systemd[1]: Reached target Timer Units. client # [ 7.709077] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.710077] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.721168] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.710794] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 7.712135] systemd[1]: Reached target Socket Units. lb # [ 7.722359] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.719979] systemd[1]: Starting Virtual Console Setup... client # [ 7.713195] systemd[1]: Reached target Basic System. client # [ 7.715158] systemd[1]: Started backdoor.service. lb # [ 7.724978] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.727387] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.719040] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.730551] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.724055] systemd[1]: Starting nftables firewall... worker1 # [ 7.738288] nsncd[514]: Sep 21 14:43:19.901 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.729923] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.733063] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.743747] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # connecting to host... worker1 # [ 7.748309] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.750457] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.753507] systemd[1]: Starting User Login Management... client # [ 7.746546] systemd[1]: Started Reset console on configuration changes. lb # [ 7.758898] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.755974] systemd[1]: Finished Post-Boot Actions. lb # [ 7.766108] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.758819] systemd[1]: Starting resolvconf update... lb # [ 7.772206] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.710853] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.775552] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.778929] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 7.782258] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.786769] nsncd[514]: Sep 21 14:43:19.926 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.791191] systemd[1]: Starting User Login Management... client # [ 7.788695] systemd[1]: Starting D-Bus System Message Bus... worker2 # connecting to host... client # connecting to host... client # [ 7.818202] nsncd[428]: Sep 21 14:43:19.675 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.738925] Console: switching to colour frame buffer device 160x50 worker2 # [ 7.960981] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.823550] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 7.823055] systemd[1]: Started Name Service Cache Daemon (nsncd). client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 7.839334] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.841527] systemd[1]: Stopped Virtual Console Setup. client # [ 7.833604] systemd[1]: Finished Post-Boot Actions. lb # [ 7.856256] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client: connected to guest root shell worker2 # [ 7.843130] systemd[1]: Starting Virtual Console Setup... client # [ 7.859563] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 7.720439] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client: (connecting took 8.54 seconds) worker2 # [ 7.858351] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... client: (finished: waiting for the VM to finish booting, in 8.54 seconds) worker2 # [ 7.875247] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' client # [ 7.860457] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.876772] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 7.870336] systemd[1]: Starting User Login Management... lb # [ 7.891634] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.880828] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 7.897080] systemd[1]: Starting Update is Completed... worker2 # [ 7.893522] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.055010] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.720682] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.928593] dbus-broker-launch[518]: Ready worker1 # [ 8.012184] Console: switching to colour frame buffer device 160x50 client # [ 7.940297] dbus-broker-launch[437]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.084208] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 7.780367] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 7.954602] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.095755] ACPI: button: Power Button [PWRF] worker1 # [ 7.963675] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.967384] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' worker1 # [ 7.970559] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 7.977190] dbus-broker-launch[518]: Ready worker1 # [ 7.982711] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 7.985314] nsncd[588]: Sep 21 14:43:20.147 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 7.976381] dbus-broker-launch[437]: NSS returned no entry for 'systemd-timesync' worker2 # [ 7.983717] systemd-logind[535]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 7.978184] dbus-broker-launch[437]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.992298] systemd[1]: Finished Update is Completed. worker1 # [ 7.993199] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 7.994109] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 7.987672] systemd-logind[535]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 7.992487] systemd-logind[535]: New seat seat0. worker1 # [ 7.994933] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.130671] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 7.998370] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.001266] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 7.998669] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 8.002173] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.002949] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.002131] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.005330] systemd-logind[538]: New seat seat0. worker2 # [ 8.002995] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 8.007135] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 8.008675] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.011586] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.012639] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.013551] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.012086] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.005376] systemd-logind[458]: New seat seat0. worker2 # [ 8.012900] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.016083] systemd[1]: Started User Login Management. client # [ 8.008687] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 8.016775] systemd[1]: Starting linger-users.service... client # [ 8.009988] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 8.017544] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.020346] systemd-logind[538]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 8.021524] systemd[1]: Started User Login Management. worker1 # [ 8.024071] systemd[1]: Starting linger-users.service... client # [ 8.014124] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 8.024844] systemd-logind[538]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.015980] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.016860] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.028499] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.029369] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.021336] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 8.032061] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.032936] systemd[1]: Finished resolvconf update. worker1 # [ 8.033661] systemd[1]: Reached target Preparation for Network. client # [ 8.024058] systemd-logind[458]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.025189] systemd-logind[458]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.026342] systemd-logind[458]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.037277] systemd[1]: Starting DHCP Client... worker1 # [ 8.037927] systemd[1]: Starting Address configuration of eth1... worker1 # [ 8.041128] systemd[1]: Starting Extra networking commands.... client # [ 8.032751] systemd[1]: Started User Login Management. client # [ 8.033512] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.038267] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.194048] mousedev: PS/2 mouse device common for all mice lb # [ 8.205573] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.207507] ppdev: user-space parallel port driver client # [ 8.065192] systemd[1]: Starting linger-users.service... lb # [ 8.209997] rtc_cmos PNP0B00:00: setting system clock to 2026-09-21T14:43:19 UTC (1790001799) lb # [ 8.211993] systemd-journald[283]: Time jumped backwards, rotating. worker1 # [ 8.080990] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.071572] dbus-broker-launch[437]: Ready worker1 # [ 8.081966] systemd[1]: Finished linger-users.service. client # [ 8.072259] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.080976] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.081976] systemd[1]: Finished linger-users.service. worker2 # [ 8.089964] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.091358] nsncd[590]: Sep 21 14:43:20.235 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.094277] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.096327] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.232156] ppdev: user-space parallel port driver worker2 # [ 8.113293] systemd[1]: Finished resolvconf update. worker2 # [ 8.115411] systemd[1]: Reached target Preparation for Network. lb # [ 8.253084] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 8.119225] systemd[1]: Starting DHCP Client... worker2 # [ 8.122646] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.124769] systemd[1]: Starting Extra networking commands.... lb # [ 8.266262] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.135767] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.148884] network-addresses-eth1-start[616]: adding address 192.168.1.3/24... done client # [ 8.138397] nsncd[520]: Sep 21 14:43:19.996 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.141536] systemd[1]: Finished linger-users.service. client # [ 8.144064] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.146386] systemd[1]: Finished resolvconf update. client # [ 8.149404] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.150783] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.154717] systemd[1]: Starting DHCP Client... worker1 # [ 8.168390] network-addresses-eth1-start[616]: adding address 2001:db8:1::3/64... done worker2 # [ 8.172329] systemd-vconsole-setup[550]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.178280] systemd[1]: Finished Virtual Console Setup. worker1 # [ 8.192454] systemd[1]: Finished Address configuration of eth1. worker2 # [ 8.241091] network-addresses-eth1-start[618]: adding address 192.168.1.4/24... done client # [ 8.244424] dhcpcd[553]: dhcpcd-10.3.2 starting worker2 # [ 8.254967] network-addresses-eth1-start[618]: adding address 2001:db8:1::4/64... done client # [ 8.249497] dhcpcd[559]: dev: loaded udev client # [ 8.391257] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.273215] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.280467] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.282754] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.289549] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.428978] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.302196] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.303201] systemd[1]: Stopped Virtual Console Setup. client # [ 8.296249] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.303898] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 8.307640] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.324651] dhcpcd[628]: dhcpcd-10.3.2 starting worker1 # [ 8.325801] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.327144] systemd[1]: Reached target Network. worker1 # [ 8.329290] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.336850] dhcpcd[688]: dev: loaded udev lb # [ 8.342773] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.466641] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.343242] systemd-logind[538]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.345843] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.342514] systemd-logind[535]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.478423] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.479078] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.490129] 8021q: 802.1Q VLAN Support v1.8 client # [ 8.481470] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 8.482277] cfg80211: failed to load regulatory.db worker1 # [ 8.492157] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.502467] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.370377] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.371239] systemd[1]: Reached target Network. worker2 # [ 8.373202] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.508447] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.277434] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.300049] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.384485] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.388472] systemd[1]: Started Getty on tty1. worker1 # [ 8.389786] systemd[1]: Reached target Login Prompts. client # [ 8.522236] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.390066] dhcpcd[559]: eth0: waiting for carrier lb # [ 8.312075] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 8.391160] dhcpcd[559]: eth0: carrier acquired lb # [ 8.312951] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.460678] Console: switching lb # [ 8.502400] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.407376] systemd[1]: Finished Firewall. worker1 # [ 8.540052] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.398748] dhcpcd[559]: DUID 00:01:00:01:32:43:ff:08:52:54:00:12:34:56 client # [ 8.399606] dhcpcd[559]: eth0: IAID 00:12:34:56 client # [ 8.400489] dhcpcd[559]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.411670] systemd[1]: Finished register-nix-paths.service. lb # [ 8.412580] systemd[1]: Reached target System Initialization. lb # [ 8.415042] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.416164] systemd[1]: Started niks3 garbage collection timer. client # [ 8.408057] systemd[1]: Finished nftables firewall. lb # [ 8.418742] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.419668] systemd[1]: Reached target Timer Units. client # [ 8.409634] systemd[1]: Reached target Preparation for Network. lb # [ 8.420878] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.412316] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.420525] systemd[1]: Finished Permit User Sessions. client # [ 8.414795] systemd[1]: Starting Extra networking commands.... lb # [ 8.426048] systemd[1]: Listening on niks3 server socket. worker2 # [ 8.422870] systemd[1]: Started Getty on tty1. lb # [ 8.426842] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 8.423852] systemd[1]: Reached target Login Prompts. lb # [ 8.427587] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.428713] systemd[1]: Reached target Socket Units. lb # [ 8.429475] systemd[1]: Reached target Basic System. worker1 # [ 8.429101] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.432860] systemd[1]: Started backdoor.service. lb # [ 8.434360] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 8.432172] dhcpcd[629]: dhcpcd-10.3.2 starting lb # [ 8.442375] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.439932] dhcpcd[691]: dev: loaded udev lb # [ 8.502509] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.515723] to colour dummy device 80x25 lb # [ 8.457805] systemd[1]: Starting Post-Boot Actions... lb # [ 8.578458] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 8.578738] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.467321] systemd[1]: Started Reset console on configuration changes. client # [ 8.591210] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 8.467423] network-addresses-eth1-start[585]: adding address 192.168.1.1/24... done client # [ 8.476361] network-addresses-eth1-start[585]: adding address 2001:db8:1::1/64... done lb # [ 8.491195] systemd[1]: Starting resolvconf update... worker2 # [ 8.626684] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.627281] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 8.489142] systemd[1]: Finished Address configuration of eth1. lb # [ 8.502501] systemd[1]: Started rustfs.service. lb # [ 8.519478] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 8.651370] kvm_amd: TSC scaling supported worker2 # [ 8.651792] kvm_amd: Nested Virtualization enabled client # [ 8.511614] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.652524] kvm_amd: Nested Paging enabled worker2 # [ 8.652926] kvm_amd: LBR virtualization supported worker2 # [ 8.653614] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.513582] systemd[1]: Reached target Network. worker2 # [ 8.654284] kvm_amd: Virtual GIF supported worker2 # [ 8.654669] kvm_amd: Virtual NMI enabled client # [ 8.516361] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.663633] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 8.532198] systemd[1]: Finished Permit User Sessions. client # [ 8.535511] systemd[1]: Started Getty on tty1. client # [ 8.536818] systemd[1]: Reached target Login Prompts. lb # [ 8.552596] systemd[1]: Finished Post-Boot Actions. worker1 # [ 8.685082] kvm_amd: TSC scaling supported worker1 # [ 8.685532] kvm_amd: Nested Virtualization enabled worker1 # [ 8.685963] kvm_amd: Nested Paging enabled worker1 # [ 8.686929] kvm_amd: LBR virtualization supported worker1 # [ 8.687562] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.688026] kvm_amd: Virtual GIF supported worker1 # [ 8.688619] kvm_amd: Virtual NMI enabled lb # connecting to host... worker2 # [ 8.557139] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.562817] nsncd[522]: Sep 21 14:43:19.985 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.700487] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.700931] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.571945] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.705060] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.705792] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.707853] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 8.708711] cfg80211: failed to load regulatory.db worker1 # [ 8.729105] EDAC MC: Ver: 3.0.0 lb # [ 8.606781] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.738310] EDAC MC: Ver: 3.0.0 lb # [ 8.608762] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.742687] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.750325] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.618332] dhcpcd[688]: eth0: waiting for carrier lb # [ 8.620246] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.619712] dhcpcd[688]: eth0: carrier acquired worker2 # [ 8.755296] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.625171] dhcpcd[688]: DUID 00:01:00:01:32:43:ff:08:52:54:00:12:34:56 worker2 # [ 8.755978] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.626339] dhcpcd[688]: eth0: IAID 00:12:34:56 worker1 # [ 8.627144] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 8.758215] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.759055] cfg80211: failed to load regulatory.db lb # [ 8.636173] systemd[1]: Starting User Login Management... lb # [ 8.781321] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.782016] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.649291] systemd-vconsole-setup[679]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.652764] systemd[1]: Finished Virtual Console Setup. worker2 # [ 8.787589] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.655810] dhcpcd[691]: eth0: waiting for carrier worker2 # [ 8.657289] dhcpcd[691]: libudev: received NULL device worker2 # [ 8.659967] dhcpcd[691]: libudev: received NULL device worker2 # [ 8.661154] dhcpcd[691]: eth0: carrier acquired worker2 # [ 8.664702] dhcpcd[691]: DUID 00:01:00:01:32:43:ff:08:52:54:00:12:34:56 worker2 # [ 8.665901] dhcpcd[691]: eth0: IAID 00:12:34:56 worker2 # [ 8.666756] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.674357] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.679368] systemd-vconsole-setup[669]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.682186] systemd[1]: Finished Virtual Console Setup. lb # [ 8.727733] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.889258] systemd-logind[552]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 9.093817] ppdev: user-space parallel port driver lb # [ 9.110896] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 9.158297] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.165998] Console: switching to colour frame buffer device 160x50 lb # [ 9.234764] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.894276] systemd-logind[552]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 9.105440] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 9.106668] dbus-broker-launch[550]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 9.109856] dbus-broker-launch[550]: NSS returned no entry for 'systemd-timesync' lb # [ 9.112196] dbus-broker-launch[550]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 9.116118] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 9.117428] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 9.120975] nsncd[612]: Sep 21 14:43:20.445 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: (finished: waiting for unit network-addresses-eth1.service, in 9.78 seconds) lb # [ 9.124931] systemd[1]: Stopping User and Group Name Lookups... client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 9.126494] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 9.130496] systemd[1]: nscd.service: Deactivated successfully. lb # [ 9.134298] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 9.135216] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.136070] systemd[1]: Started D-Bus System Message Bus. lb # [ 9.138798] dbus-broker-launch[550]: Ready lb # [ 9.139550] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.140428] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.141419] systemd[1]: Reached target User and Group Name Lookups. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb # [ 9.142227] systemd[1]: Finished resolvconf update. lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 9.142904] systemd[1]: Reached target Preparation for Network. lb # [ 9.145534] systemd[1]: Starting DHCP Client... lb # [ 9.146911] systemd[1]: Starting Address configuration of eth1... lb # [ 9.151503] systemd[1]: Starting Extra networking commands.... lb # [ 9.153467] systemd-logind[552]: New seat seat0. lb # [ 9.155255] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 9.156898] systemd[1]: Started User Login Management. lb # [ 9.157662] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.158654] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.177184] systemd[1]: Starting linger-users.service... lb # [ 9.183377] systemd[1]: Starting Virtual Console Setup... lb # [ 9.326505] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.331806] systemd[1]: Finished linger-users.service. lb # [ 9.347063] network-addresses-eth1-start[642]: adding address 192.168.1.2/24... done lb # [ 9.374899] network-addresses-eth1-start[642]: adding address 2001:db8:1::2/64... done client # [ 9.376864] dhcpcd[559]: eth0: soliciting a DHCP lease client # [ 9.527622] NET: Registered PF_PACKET protocol family lb # [ 9.410525] systemd[1]: Finished Address configuration of eth1. client # [ 9.401916] dhcpcd[559]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 9.404478] dhcpcd[559]: eth0: probing address 10.0.2.15/24 worker2 # [ 9.461842] dhcpcd[691]: eth0: soliciting a DHCP lease lb # [ 9.615361] kvm_amd: TSC scaling supported lb # [ 9.615813] kvm_amd: Nested Virtualization enabled lb # [ 9.616267] kvm_amd: Nested Paging enabled lb # [ 9.616660] kvm_amd: LBR virtualization supported worker2 # [ 9.612516] NET: Registered PF_PACKET protocol family lb # [ 9.618563] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 9.619403] kvm_amd: Virtual GIF supported lb # [ 9.620131] kvm_amd: Virtual NMI enabled worker2 # [ 9.488411] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.490661] dhcpcd[691]: eth0: probing address 10.0.2.15/24 lb # [ 9.501253] dhcpcd[669]: dhcpcd-10.3.2 starting lb # [ 9.510919] dhcpcd[722]: dev: loaded udev lb # [ 9.524818] systemd[1]: Finished Extra networking commands.. lb # [ 9.527549] systemd[1]: Reached target Network. lb # [ 9.535069] systemd[1]: Starting PostgreSQL Server... lb # [ 9.541567] systemd[1]: Starting Permit User Sessions... lb # [ 9.679016] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.679442] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.693926] EDAC MC: Ver: 3.0.0 lb # [ 9.606047] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.646936] systemd[1]: Finished Permit User Sessions. lb # [ 9.655736] systemd[1]: Started Getty on tty1. lb # [ 9.656427] systemd[1]: Reached target Login Prompts. lb # [ 9.844914] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.873182] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 9.873873] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.877859] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.878719] cfg80211: failed to load regulatory.db lb # [ 9.945631] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 9.813415] dhcpcd[722]: eth0: waiting for carrier lb # [ 9.814584] dhcpcd[722]: eth0: carrier acquired lb # [ 9.833510] dhcpcd[722]: DUID 00:01:00:01:32:43:ff:09:52:54:00:12:34:56 lb # [ 9.834413] dhcpcd[722]: eth0: IAID 00:12:34:56 lb # [ 9.835545] dhcpcd[722]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.843950] postgresql-pre-start[737]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.845289] postgresql-pre-start[737]: This user must also own the server process. lb # [ 9.854983] postgresql-pre-start[737]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.856167] postgresql-pre-start[737]: The default database encoding has accordingly been set to "UTF8". lb # [ 9.857281] postgresql-pre-start[737]: The default text search configuration will be set to "english". lb # [ 9.858434] postgresql-pre-start[737]: Data page checksums are enabled. lb # [ 9.859261] postgresql-pre-start[737]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.860457] postgresql-pre-start[737]: creating subdirectories ... ok lb # [ 9.861265] postgresql-pre-start[737]: selecting dynamic shared memory implementation ... posix lb # [ 9.948907] postgresql-pre-start[737]: selecting default "max_connections" ... 100 lb # [ 9.965894] systemd-vconsole-setup[651]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.971052] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.972814] dhcpcd[688]: eth0: soliciting a DHCP lease worker1 # [ 10.123071] NET: Registered PF_PACKET protocol family worker1 # [ 9.996141] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 9.999289] dhcpcd[688]: eth0: probing address 10.0.2.15/24 lb # [ 10.017521] postgresql-pre-start[737]: selecting default "shared_buffers" ... 128MB lb # [ 10.154103] dhcpcd[722]: eth0: soliciting a DHCP lease lb # [ 10.298062] NET: Registered PF_PACKET protocol family lb # [ 10.168422] dhcpcd[722]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 10.170160] dhcpcd[722]: eth0: probing address 10.0.2.15/24 lb: (finished: waiting for unit network-addresses-eth1.service, in 1.22 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } client # [ 10.366688] dhcpcd[559]: eth0: soliciting an IPv6 router lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 10.368651] dhcpcd[559]: eth0: Router Advertisement from fe80::2 client # [ 10.370592] dhcpcd[559]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.373401] dhcpcd[559]: eth0: adding route to fec0::/64 client # [ 10.375364] dhcpcd[559]: eth0: adding default route via fe80::2 worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.02 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service worker1 # [ 10.547779] dhcpcd[688]: eth0: soliciting an IPv6 router worker1 # [ 10.550442] dhcpcd[688]: eth0: Router Advertisement from fe80::2 worker1 # [ 10.552671] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.554860] dhcpcd[688]: eth0: adding route to fec0::/64 worker1 # [ 10.556811] dhcpcd[688]: eth0: adding default route via fe80::2 lb # [ 10.645369] postgresql-pre-start[737]: selecting default time zone ... UTC lb # [ 10.647672] postgresql-pre-start[737]: creating configuration files ... ok lb # [ 10.811117] postgresql-pre-start[737]: running bootstrap script ... ok worker2 # [ 10.885797] dhcpcd[691]: eth0: soliciting an IPv6 router worker2 # [ 10.888488] dhcpcd[691]: eth0: Router Advertisement from fe80::2 worker2 # [ 10.890578] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 10.892725] dhcpcd[691]: eth0: adding route to fec0::/64 worker2 # [ 10.894478] dhcpcd[691]: eth0: adding default route via fe80::2 lb # [ 11.183493] postgresql-pre-start[737]: performing post-bootstrap initialization ... ok lb # [ 11.336457] postgresql-pre-start[737]: syncing data to disk ... ok lb # [ 11.338281] postgresql-pre-start[737]: initdb: warning: enabling "trust" authentication for local connections lb # [ 11.339517] postgresql-pre-start[737]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 11.341361] postgresql-pre-start[737]: Success. You can now start the database server using: lb # [ 11.342345] postgresql-pre-start[737]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 11.411542] postgres[781]: [781] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 11.413996] postgres[781]: [781] LOG: listening on IPv6 address "::1", port 5432 lb # [ 11.415246] postgres[781]: [781] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 11.417852] postgres[781]: [781] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 11.429113] postgres[790]: [790] LOG: database system was shut down at 2026-09-21 14:43:22 GMT lb # [ 11.434631] postgres[781]: [781] LOG: database system is ready to accept connections lb # [ 11.440146] systemd[1]: Started PostgreSQL Server. lb # [ 11.446146] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 11.585317] postgresql-setup-start[801]: CREATE DATABASE lb # [ 11.628394] postgresql-setup-start[814]: CREATE ROLE lb # [ 11.639780] postgresql-setup-start[817]: ALTER DATABASE lb # [ 11.643948] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 11.645758] systemd[1]: Reached target PostgreSQL. lb # [ 11.949113] dhcpcd[722]: eth0: soliciting an IPv6 router lb # [ 11.951931] dhcpcd[722]: eth0: Router Advertisement from fe80::2 lb # [ 11.954127] dhcpcd[722]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.956370] dhcpcd[722]: eth0: adding route to fec0::/64 lb # [ 11.958320] dhcpcd[722]: eth0: adding default route via fe80::2 worker2 # [ 13.560680] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 13.564571] dhcpcd[691]: eth0: adding route to 10.0.2.0/24 worker2 # [ 13.566854] dhcpcd[691]: eth0: adding default route via 10.0.2.2 worker2 # [ 13.648947] systemd[1]: Started DHCP Client. worker2 # [ 13.651104] systemd[1]: Reached target Multi-User System. worker2 # [ 13.651895] systemd[1]: Startup finished in 852ms (kernel) + 3.613s (initrd) + 9.185s (userspace) = 13.650s. client # [ 14.033186] dhcpcd[559]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 14.036258] dhcpcd[559]: eth0: adding route to 10.0.2.0/24 client # [ 14.038476] dhcpcd[559]: eth0: adding default route via 10.0.2.2 client # [ 14.121927] systemd[1]: Started DHCP Client. client # [ 14.123973] systemd[1]: Reached target Multi-User System. client # [ 14.124820] systemd[1]: Startup finished in 868ms (kernel) + 3.657s (initrd) + 9.599s (userspace) = 14.124s. worker1 # [ 14.746284] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 14.749540] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 worker1 # [ 14.751882] dhcpcd[688]: eth0: adding default route via 10.0.2.2 worker1 # [ 14.835541] systemd[1]: Started DHCP Client. worker1 # [ 14.837293] systemd[1]: Reached target Multi-User System. worker1 # [ 14.838196] systemd[1]: Startup finished in 855ms (kernel) + 3.590s (initrd) + 10.390s (userspace) = 14.837s. lb # [ 15.751885] dhcpcd[722]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 15.754860] dhcpcd[722]: eth0: adding route to 10.0.2.0/24 lb # [ 15.757677] dhcpcd[722]: eth0: adding default route via 10.0.2.2 lb # [ 15.873338] systemd[1]: Started DHCP Client. lb # [ 15.874913] systemd[1]: Reached target Network is Online. lb # [ 15.878389] systemd[1]: Started Envoy reverse proxy. lb # [ 15.880887] systemd[1]: Started mock-oidc.service. lb # [ 15.926457] mock-oidc-server[918]: Mock OIDC Server running lb # [ 15.927424] mock-oidc-server[918]: OIDC Address: 192.168.1.2:8080 lb # [ 15.929113] mock-oidc-server[918]: Issue Address: 0.0.0.0:8081 lb # [ 15.929925] mock-oidc-server[918]: Issuer: http://192.168.1.2:8080/oidc lb # [ 15.931050] mock-oidc-server[918]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 15.932084] mock-oidc-server[918]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 15.933269] mock-oidc-server[918]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 16.211452] envoy[917]: [2026-09-21 14:43:27.634][917][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 16.214060] envoy[917]: [2026-09-21 14:43:27.636][917][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 16.215545] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 16.217945] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 16.219647] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 16.222377] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 16.225139] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 16.226913] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 16.230784] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 16.232755] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 16.234599] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 16.237040] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 16.241480] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 16.244069] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 16.245792] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 16.248061] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 16.250154] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 16.253090] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 16.254864] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 16.257752] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 16.259346] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 16.263447] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 16.277066] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 16.280061] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 16.283044] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 16.285341] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 16.287914] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 16.289452] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 16.291968] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 16.295527] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 16.297554] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 16.300282] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 16.304124] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 16.306109] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.307985] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 16.310748] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 16.313521] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 16.315361] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 16.321252] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 16.324050] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 16.326472] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 16.328771] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 16.333129] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 16.334922] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 16.339137] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 16.340853] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 16.342359] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 16.344723] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 16.347915] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 16.351084] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 16.353315] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 16.359417] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 16.370695] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 16.372572] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 16.374384] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 16.383451] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 16.388883] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 16.391161] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.393535] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 16.395608] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 16.398465] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 16.400214] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 16.402689] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 16.404224] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 16.405960] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 16.412988] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 16.416154] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 16.417764] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 16.423058] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 16.427478] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 16.429544] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 16.431336] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 16.433527] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 16.435043] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 16.437043] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 16.438448] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 16.439964] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 16.444037] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 16.445535] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 16.448140] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 16.450325] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 16.452087] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 16.477987] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 16.480343] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 16.482121] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 16.483877] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 16.485949] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 16.489083] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 16.490658] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 16.492728] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 16.494878] envoy[917]: [2026-09-21 14:43:27.637][917][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 16.496818] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 16.498471] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 16.500116] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.502434] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 16.504598] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.506497] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 16.510085] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 16.512483] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 16.514980] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 16.516669] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 16.519867] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 16.525819] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 16.528650] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 16.531358] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 16.536081] envoy[917]: [2026-09-21 14:43:27.641][917][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 16.537967] envoy[917]: [2026-09-21 14:43:27.696][917][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 16.539261] envoy[917]: [2026-09-21 14:43:27.697][917][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 16.552670] envoy[917]: [2026-09-21 14:43:27.697][917][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 16.554063] envoy[917]: [2026-09-21 14:43:27.697][917][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 16.561613] envoy[917]: [2026-09-21 14:43:27.697][917][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 16.565196] envoy[917]: [2026-09-21 14:43:27.988][917][info][main] [source/server/server.cc:968] runtime: {} lb # [ 16.568421] envoy[917]: [2026-09-21 14:43:27.992][917][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 16.570187] envoy[917]: [2026-09-21 14:43:27.993][917][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 16.572046] envoy[917]: [2026-09-21 14:43:27.995][917][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 16.574088] envoy[917]: [2026-09-21 14:43:27.997][917][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 16.575827] envoy[917]: [2026-09-21 14:43:27.999][917][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 16.577247] envoy[917]: [2026-09-21 14:43:27.999][917][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 16.596326] envoy[917]: [2026-09-21 14:43:28.019][917][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 16.597868] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 16.600618] envoy[917]: [2026-09-21 14:43:28.024][917][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 16.596733] systemd[1]: Reached target Network is Online. lb # [ 16.602629] envoy[917]: [2026-09-21 14:43:28.026][917][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 16.605467] envoy[917]: [2026-09-21 14:43:28.028][917][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 16.602940] systemd[1]: Starting scheduler-token.service... worker2 # [ 16.668645] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 16.671639] systemd[1]: Finished scheduler-token.service. worker2 # [ 16.674342] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 68ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 16.680520] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 16.693463] nix-grpc-daemon[780]: ts=2026-09-21T14:43:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 16.704660] nix-grpc-daemon[780]: ts=2026-09-21T14:43:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 16.707148] nix-grpc-daemon[780]: ts=2026-09-21T14:43:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 16.715058] nix-grpc-daemon[780]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 16.716450] nix-grpc-daemon[780]: E0000 00:00:1790001808.882043 780 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 16.722413] nix-grpc-daemon[780]: E0000 00:00:1790001808.889580 780 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 16.726269] nix-grpc-daemon[780]: ts=2026-09-21T14:43:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 16.729442] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 16.743171] nix-grpc-daemon[780]: E0000 00:00:1790001808.909664 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 16.757173] envoy[917]: [2026-09-21 14:43:28.180][917][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 16.760804] nix-grpc-daemon[780]: E0000 00:00:1790001808.928101 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 16.760981] envoy[917]: [2026-09-21 14:43:28.180][917][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 16.765060] nix-grpc-daemon[780]: E0000 00:00:1790001808.930379 822 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 16.764933] envoy[917]: [2026-09-21 14:43:28.180][917][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 16.771817] envoy[917]: [2026-09-21 14:43:28.195][917][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 16.771767] nix-grpc-daemon[782]: ts=2026-09-21T14:43:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 16.776190] nix-grpc-daemon[780]: E0000 00:00:1790001808.943491 822 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.782121] nix-grpc-daemon[782]: ts=2026-09-21T14:43:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 16.787389] nix-grpc-daemon[780]: ts=2026-09-21T14:43:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.785311] nix-grpc-daemon[782]: ts=2026-09-21T14:43:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 16.790637] nix-grpc-daemon[780]: ts=2026-09-21T14:43:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.795886] nix-grpc-daemon[782]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 16.797441] nix-grpc-daemon[782]: E0000 00:00:1790001808.941099 782 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.803235] nix-grpc-daemon[782]: E0000 00:00:1790001808.948775 782 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.806855] nix-grpc-daemon[782]: ts=2026-09-21T14:43:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 16.810939] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 16.823079] nix-grpc-daemon[782]: E0000 00:00:1790001808.968112 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.841305] nix-grpc-daemon[782]: E0000 00:00:1790001808.986782 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.846078] nix-grpc-daemon[782]: E0000 00:00:1790001808.989021 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 16.856603] nix-grpc-daemon[782]: E0000 00:00:1790001809.002022 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 16.869779] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.871575] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.991751] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.995662] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.072992] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.077256] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.195972] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.197862] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.278777] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.282613] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.398946] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.402791] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.483701] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.487541] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.603677] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.607552] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.688871] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.692736] nix-grpc-daemon[782]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.808344] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.810127] nix-grpc-daemon[780]: ts=2026-09-21T14:43:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.894947] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.898221] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.010831] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.014735] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.096179] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.099972] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.215524] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.218584] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.301097] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.304922] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.419544] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.423462] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.506309] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.510325] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.624495] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.628509] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.711432] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.715338] nix-grpc-daemon[782]: ts=2026-09-21T14:43:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.830071] nix-grpc-daemon[780]: ts=2026-09-21T14:43:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.833851] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.917657] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.920760] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.035085] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.038987] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.118881] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.122836] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.239503] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.243415] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.323909] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.328109] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.443831] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.445583] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.529119] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.532958] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.646579] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.650612] nix-grpc-daemon[780]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.733345] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.735239] nix-grpc-daemon[782]: ts=2026-09-21T14:43:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.852821] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.856110] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.937368] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.941130] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.053772] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.057905] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.141676] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.144219] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.258414] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.261216] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.319703] rustfs-bucket-start[972]: mb s3://farm lb # [ 20.330793] systemd[1]: Finished rustfs-bucket.service. lb # [ 20.336989] systemd[1]: Starting niks3 server... worker2 # [ 20.345268] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.349125] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.461481] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.463338] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.477508] postgres[987]: [987] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 20.478725] postgres[987]: [987] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 20.503375] niks3-server[982]: 2026/09/21 14:43:31 OK 20241026095416_initial_model.sql (13.03ms) lb # [ 20.507127] niks3-server[982]: 2026/09/21 14:43:31 OK 20251210153512_drop_unused_gin_index.sql (3.95ms) lb # [ 20.512174] niks3-server[982]: 2026/09/21 14:43:31 OK 20251218171726_add_pins.sql (5.15ms) lb # [ 20.516835] niks3-server[982]: 2026/09/21 14:43:31 OK 20260628120000_add_object_size_and_stats.sql (3.48ms) lb # [ 20.521695] niks3-server[982]: 2026/09/21 14:43:31 OK 20260905000000_add_claims.sql (3.48ms) lb # [ 20.525672] niks3-server[982]: 2026/09/21 14:43:31 OK 20260920000000_drop_claims.sql (2.73ms) lb # [ 20.527022] niks3-server[982]: 2026/09/21 14:43:31 goose: successfully migrated database to version: 20260920000000 lb # [ 20.531306] niks3-server[982]: 2026/09/21 14:43:31 OK 1_commit_pending_closure.sql (4.1ms) lb # [ 20.534207] niks3-server[982]: 2026/09/21 14:43:31 OK 2_object_stats_trigger.sql (2.81ms) lb # [ 20.535264] niks3-server[982]: 2026/09/21 14:43:31 goose: up to current file version: 2 lb # [ 20.538363] niks3-server[982]: 2026/09/21 14:43:31 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key worker2 # [ 20.550643] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.554384] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 20.571665] niks3-server[982]: 2026/09/21 14:43:31 INFO Read proxy enabled — serving cache objects from S3 lb # [ 20.573284] niks3-server[982]: 2026/09/21 14:43:31 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 20.578297] niks3-server[982]: 2026/09/21 14:43:32 INFO systemd watchdog enabled interval=15s lb # [ 20.579507] systemd[1]: Started niks3 server. lb # [ 20.580164] systemd[1]: Reached target Multi-User System. lb # [ 20.582476] niks3-server[982]: 2026/09/21 14:43:32 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 20.584826] systemd[1]: Startup finished in 861ms (kernel) + 4.548s (initrd) + 15.174s (userspace) = 20.583s. worker1 # [ 20.663940] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.665835] nix-grpc-daemon[780]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.752701] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.756952] nix-grpc-daemon[782]: ts=2026-09-21T14:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.866853] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.868620] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.959706] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.963215] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.069607] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.073589] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.160956] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.165165] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 10.70 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 21.274898] envoy[917]: conn peer=[::1]:52246 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker1 # [ 21.274429] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.279408] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.366434] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.370896] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.398413] systemd[1]: Starting scheduler-token.service... worker2 # [ 21.456539] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 21.458207] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.460163] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 63ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 21.479455] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.483604] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 21.571101] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.574912] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.684490] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.688620] nix-grpc-daemon[780]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.775939] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.779762] nix-grpc-daemon[782]: ts=2026-09-21T14:43:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.890883] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.893955] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.981661] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.985425] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.091842] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.095584] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.186478] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.190318] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.296584] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.300524] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.391318] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.394996] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.501470] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.505388] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 22.596203] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.599783] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.706710] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.711148] nix-grpc-daemon[780]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.797993] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.801957] nix-grpc-daemon[782]: ts=2026-09-21T14:43:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.913322] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.916505] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.004441] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.007784] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.114542] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.118543] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.208626] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.212452] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.319456] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.323458] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.413471] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.417273] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.524491] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.528602] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 23.618180] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.621996] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 23.729380] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.733758] nix-grpc-daemon[780]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.822837] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.825882] nix-grpc-daemon[782]: ts=2026-09-21T14:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.935613] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.939168] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.028334] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.031482] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.139957] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.143893] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.229564] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.231753] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.344815] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.348934] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.432963] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.436846] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.549656] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.554318] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 24.637852] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.641803] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 24.753901] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.755608] nix-grpc-daemon[780]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.842955] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.846806] nix-grpc-daemon[782]: ts=2026-09-21T14:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.957434] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.961182] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.049200] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.052321] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.162183] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.166130] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.249772] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.251487] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.367076] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.371162] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.452661] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.456484] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.572124] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.576333] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.657442] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.661255] nix-grpc-daemon[782]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 25.776763] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.780433] nix-grpc-daemon[780]: ts=2026-09-21T14:43:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.861997] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.865921] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.982498] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.985941] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.067943] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.071737] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.186917] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.191159] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.270196] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.274291] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.392101] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.396192] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.475365] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.479279] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.596919] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.600881] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.680236] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.683960] nix-grpc-daemon[782]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 26.801597] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.805555] nix-grpc-daemon[780]: ts=2026-09-21T14:43:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.884923] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.888594] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.007313] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.011137] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.091379] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.094498] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.212159] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.216345] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.292786] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.296589] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.417177] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.421187] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.497560] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.501390] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.622070] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.626373] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.702422] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.706432] nix-grpc-daemon[782]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 27.827142] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.831122] nix-grpc-daemon[780]: ts=2026-09-21T14:43:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 27.906995] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.910854] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.031947] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.033637] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.113290] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.116422] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.234293] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.238265] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.314371] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.318219] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.438992] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.443169] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.519307] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.523216] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.643896] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.647832] nix-grpc-daemon[780]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.724293] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.728137] nix-grpc-daemon[782]: ts=2026-09-21T14:43:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 28.848645] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.852414] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 28.928958] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.932894] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.054570] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.058455] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.132276] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.135441] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.259452] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.263295] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.333641] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.337449] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.464123] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.468120] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.538559] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.542306] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.669058] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.673418] nix-grpc-daemon[780]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.743350] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.747174] nix-grpc-daemon[782]: ts=2026-09-21T14:43:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.873925] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.877722] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 29.948230] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.951997] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.079354] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.083844] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.153787] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.157488] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.283970] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.287909] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.355864] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.359741] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.488709] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.492476] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.561146] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.564984] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.591355] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_take_over lb # [ 30.592520] niks3-server[982]: 2026/09/21 14:43:42 INFO lead: acquired remote=192.168.1.3:48730 worker1 # [ 30.693382] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.697241] nix-grpc-daemon[780]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.765838] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.769651] nix-grpc-daemon[782]: ts=2026-09-21T14:43:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.898208] nix-grpc-daemon[780]: ts=2026-09-21T14:43:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.910498] nix-grpc-daemon[780]: ts=2026-09-21T14:43:43Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48506 worker1 # [ 30.914072] nix-grpc-daemon[780]: ts=2026-09-21T14:43:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 30.970426] nix-grpc-daemon[782]: ts=2026-09-21T14:43:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.985557] nix-grpc-daemon[780]: ts=2026-09-21T14:43:43Z level=info event=oidc_jwks provider=mock keys=1 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 30.988476] nix-grpc-daemon[780]: ts=2026-09-21T14:43:43Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48506 worker1 # [ 30.992823] nix-grpc-daemon[780]: ts=2026-09-21T14:43:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 9.88 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 31.591569] nix-grpc-daemon[782]: ts=2026-09-21T14:43:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 31.600936] systemd[1]: Started Nix Daemon. worker2 # [ 31.708862] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 31.724177] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5) worker2 # [ 31.759436] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 2/5) worker2 # [ 31.878643] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 245 ms (attempt 3/5) worker2 # [ 32.125338] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 332 ms (attempt 4/5) worker2 # [ 32.464682] nix-grpc-daemon[782]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 32.466233] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 32.495426] nix-grpc-daemon[780]: ts=2026-09-21T14:43:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 32.500710] systemd[1]: Started Nix Daemon. worker1 # [ 32.594806] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 32.613648] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker1 # [ 32.702601] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 2/5) worker1 # [ 32.865615] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 3/5) worker1 # [ 33.023816] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 302 ms (attempt 4/5) worker1 # [ 33.329245] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 33.332644] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 33.345343] nix-grpc-daemon[780]: ts=2026-09-21T14:43:45Z level=debug event=path_info_miss path=p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test error="error: path '/nix/store/p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 33.360868] nix-grpc-daemon[780]: ts=2026-09-21T14:43:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 33.370418] nix-grpc-daemon[780]: ts=2026-09-21T14:43:45Z level=debug event=path_info_miss path=p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test error="error: path '/nix/store/p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker2 # [ 33.598810] nix-grpc-daemon[782]: ts=2026-09-21T14:43:45Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 33.603304] nix-grpc-daemon[782]: ts=2026-09-21T14:43:45Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:37302 worker2 # [ 33.615213] nix-grpc-daemon[782]: ts=2026-09-21T14:43:45Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:37302 worker2 # [ 33.625922] nix-grpc-daemon[782]: ts=2026-09-21T14:43:45Z level=debug event=path_info_miss path=p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test error="error: path '/nix/store/p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 33.632906] nix-grpc-daemon[780]: ts=2026-09-21T14:43:45Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48522 worker1 # [ 33.642380] nix-grpc-daemon[780]: ts=2026-09-21T14:43:45Z level=debug event=path_info_miss path=p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test error="error: path '/nix/store/p6lhqb373376nh9xdab84lh6d9781g76-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker1 # [ 33.783844] nix-grpc-daemon[780]: ts=2026-09-21T14:43:45Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 33.921994] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.55 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 34.074162] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48522 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 34.081911] nix-grpc-daemon[782]: ts=2026-09-21T14:43:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37302 worker1 # [ 34.115126] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker1 # [ 34.120938] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 34.164529] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 34.181774] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 client # copying 1 paths to 'lb:50051'... worker1 # [ 34.195721] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 34.214780] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 34.238477] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=info event=niks3_push_started pid=876 worker1 # [ 34.389825] nix-grpc-daemon[876]: time=2026-09-21T14:43:46.556Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 34.482816] nix-daemon[862]: accepted connection from pid 889, user nix-grpc-daemon (trusted) worker1 # [ 34.496191] nix-daemon[862]: reaped child process 892, status = succeeded worker1 # [ 34.579230] nix-daemon[862]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker1 # [ 34.592587] nix-daemon[862]: reaped child process 897, status = succeeded lb # [ 34.599552] niks3-server[982]: 2026/09/21 14:43:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 34.614161] nix-grpc-daemon[876]: time=2026-09-21T14:43:46.781Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 34.615554] nix-grpc-daemon[876]: time=2026-09-21T14:43:46.781Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 34.651334] niks3-server[982]: 2026/09/21 14:43:46 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 34.658734] niks3-server[982]: 2026/09/21 14:43:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 34.674301] niks3-server[982]: 2026/09/21 14:43:46 INFO Signed narinfos id=1 count=1 worker1 # [ 34.675642] nix-grpc-daemon[876]: time=2026-09-21T14:43:46.842Z level=INFO msg="Uploading 1 narinfos" lb # [ 34.685038] niks3-server[982]: 2026/09/21 14:43:46 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 34.692559] niks3-server[982]: 2026/09/21 14:43:46 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 34.705785] niks3-server[982]: 2026/09/21 14:43:46 INFO Completed upload id=1 worker1 # [ 34.705359] nix-grpc-daemon[876]: time=2026-09-21T14:43:46.872Z level=INFO msg="Upload complete. (311ms)" lb # [ 34.715223] niks3-server[982]: 2026/09/21 14:43:46 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker1 # [ 34.710648] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 34.718796] nix-grpc-daemon[780]: ts=2026-09-21T14:43:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 34.728673] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 34.737885] nix-daemon[862]: reaped child process 874, status = succeeded worker1 # [ 34.746419] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 35.760681] nix-daemon[862]: reaped child process 901, status = succeeded worker1 # [ 35.837588] nix-daemon[862]: accepted connection from pid 917, user nix-grpc-daemon (trusted) worker1 # [ 35.849311] nix-daemon[862]: reaped child process 920, status = succeeded lb # [ 35.857770] niks3-server[982]: 2026/09/21 14:43:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.868888] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.036Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 35.871051] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.037Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 35.899125] niks3-server[982]: 2026/09/21 14:43:47 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 35.911971] niks3-server[982]: 2026/09/21 14:43:47 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 35.919159] niks3-server[982]: 2026/09/21 14:43:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker1 # [ 35.924428] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.091Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.924892] niks3-server[982]: 2026/09/21 14:43:47 INFO Signed narinfos id=2 count=1 lb # [ 35.931520] niks3-server[982]: 2026/09/21 14:43:47 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 35.938057] niks3-server[982]: 2026/09/21 14:43:47 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 35.945189] niks3-server[982]: 2026/09/21 14:43:47 INFO Completed upload id=2 worker1 # [ 35.944470] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.111Z level=INFO msg="Upload complete. (191ms)" lb # [ 35.947510] niks3-server[982]: 2026/09/21 14:43:47 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker1 # [ 35.953599] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 35.965730] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker1 # [ 35.969178] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 35.978314] nix-daemon[862]: reaped child process 899, status = succeeded worker1 # [ 36.008638] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 36.021131] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 36.035423] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.202Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 36.043737] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 36.060784] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 36.166086] nix-daemon[862]: accepted connection from pid 926, user nix-grpc-daemon (trusted) worker1 # [ 36.180236] nix-daemon[862]: reaped child process 929, status = succeeded worker1 # [ 36.263313] nix-daemon[862]: accepted connection from pid 931, user nix-grpc-daemon (trusted) worker1 # [ 36.276670] nix-daemon[862]: reaped child process 934, status = succeeded lb # [ 36.282679] niks3-server[982]: 2026/09/21 14:43:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 36.297987] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.465Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 36.300097] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.466Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 36.318829] niks3-server[982]: 2026/09/21 14:43:47 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 36.331300] niks3-server[982]: 2026/09/21 14:43:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 36.338142] niks3-server[982]: 2026/09/21 14:43:47 INFO Signed narinfos id=3 count=1 worker1 # [ 36.340432] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.507Z level=INFO msg="Uploading 1 narinfos" lb # [ 36.343142] niks3-server[982]: 2026/09/21 14:43:47 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 36.355533] niks3-server[982]: 2026/09/21 14:43:47 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 36.363794] niks3-server[982]: 2026/09/21 14:43:47 INFO Completed upload id=3 worker1 # [ 36.363069] nix-grpc-daemon[876]: time=2026-09-21T14:43:48.530Z level=INFO msg="Upload complete. (288ms)" lb # [ 36.369908] niks3-server[982]: 2026/09/21 14:43:47 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 36.367325] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 36.373377] nix-grpc-daemon[780]: ts=2026-09-21T14:43:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 36.385110] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 36.394834] nix-daemon[862]: reaped child process 924, status = succeeded worker1 # [ 36.398932] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 36.599417] envoy[917]: conn peer=[2001:db8:1::1]:55968 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=1802 lb # [ 36.603054] envoy[917]: conn peer=[2001:db8:1::1]:53872 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=60 lb # [ 36.606970] envoy[917]: conn peer=[2001:db8:1::1]:53878 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=8 lb # [ 36.610469] envoy[917]: conn peer=[2001:db8:1::1]:53890 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 37.233679] nix-daemon[862]: reaped child process 938, status = succeeded worker1 # [ 37.309076] nix-daemon[862]: accepted connection from pid 954, user nix-grpc-daemon (trusted) worker1 # [ 37.322343] nix-daemon[862]: reaped child process 957, status = succeeded lb # [ 37.330474] niks3-server[982]: 2026/09/21 14:43:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.338120] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.505Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 37.339680] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.506Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 37.366358] niks3-server[982]: 2026/09/21 14:43:48 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 37.375779] niks3-server[982]: 2026/09/21 14:43:48 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 37.388893] niks3-server[982]: 2026/09/21 14:43:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 37.394937] niks3-server[982]: 2026/09/21 14:43:48 INFO Signed narinfos id=4 count=1 worker1 # [ 37.396460] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.563Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.399227] niks3-server[982]: 2026/09/21 14:43:48 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 37.408392] niks3-server[982]: 2026/09/21 14:43:48 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 37.410809] niks3-server[982]: 2026/09/21 14:43:48 INFO Completed upload id=4 worker1 # [ 37.410879] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.578Z level=INFO msg="Upload complete. (204ms)" worker1 # [ 37.413687] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.580Z level=WARN msg="Failed to register uploaded object" key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 37.418443] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 37.425983] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker1 # [ 37.428405] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 37.432234] nix-daemon[862]: reaped child process 936, status = succeeded worker1 # [ 37.469141] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 37.477549] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 37.487698] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.654Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 37.495131] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 37.508271] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 37.595431] nix-daemon[862]: accepted connection from pid 964, user nix-grpc-daemon (trusted) worker1 # [ 37.608444] nix-daemon[862]: reaped child process 967, status = succeeded worker1 # [ 37.691922] nix-daemon[862]: accepted connection from pid 969, user nix-grpc-daemon (trusted) worker1 # [ 37.705103] nix-daemon[862]: reaped child process 972, status = succeeded lb # [ 37.712282] niks3-server[982]: 2026/09/21 14:43:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.719915] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.886Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 37.721380] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.886Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 37.739544] niks3-server[982]: 2026/09/21 14:43:49 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 37.750518] niks3-server[982]: 2026/09/21 14:43:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 37.755443] niks3-server[982]: 2026/09/21 14:43:49 INFO Signed narinfos id=5 count=1 worker1 # [ 37.757875] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.924Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.764803] niks3-server[982]: 2026/09/21 14:43:49 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 37.777112] niks3-server[982]: 2026/09/21 14:43:49 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 37.785936] niks3-server[982]: 2026/09/21 14:43:49 INFO Completed upload id=5 worker1 # [ 37.785091] nix-grpc-daemon[876]: time=2026-09-21T14:43:49.952Z level=INFO msg="Upload complete. (268ms)" lb # [ 37.791516] niks3-server[982]: 2026/09/21 14:43:49 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 37.788929] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 37.796297] nix-grpc-daemon[780]: ts=2026-09-21T14:43:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 37.805140] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 37.814384] nix-daemon[862]: reaped child process 962, status = succeeded worker1 # [ 37.817266] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 38.430902] nix-daemon[862]: reaped child process 976, status = succeeded worker1 # [ 38.505561] nix-daemon[862]: accepted connection from pid 992, user nix-grpc-daemon (trusted) worker1 # [ 38.518754] nix-daemon[862]: reaped child process 995, status = succeeded lb # [ 38.529875] niks3-server[982]: 2026/09/21 14:43:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.542327] nix-grpc-daemon[876]: time=2026-09-21T14:43:50.708Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 38.543685] nix-grpc-daemon[876]: time=2026-09-21T14:43:50.708Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 38.570872] niks3-server[982]: 2026/09/21 14:43:49 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 38.582282] niks3-server[982]: 2026/09/21 14:43:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 38.583770] niks3-server[982]: 2026/09/21 14:43:50 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 38.585741] nix-grpc-daemon[876]: time=2026-09-21T14:43:50.752Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.586610] niks3-server[982]: 2026/09/21 14:43:50 INFO Signed narinfos id=6 count=1 lb # [ 38.591033] niks3-server[982]: 2026/09/21 14:43:50 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 38.599352] niks3-server[982]: 2026/09/21 14:43:50 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 38.601619] niks3-server[982]: 2026/09/21 14:43:50 INFO Completed upload id=6 worker1 # [ 38.600828] nix-grpc-daemon[876]: time=2026-09-21T14:43:50.768Z level=INFO msg="Upload complete. (177ms)" lb # [ 38.607288] niks3-server[982]: 2026/09/21 14:43:50 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 38.606358] nix-grpc-daemon[780]: ts=2026-09-21T14:43:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 38.618865] nix-daemon[862]: reaped child process 974, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 4.69 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 5.04 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 39.460669] nix-grpc-daemon[782]: ts=2026-09-21T14:43:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37302 worker1 # [ 39.467783] nix-grpc-daemon[780]: ts=2026-09-21T14:43:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 39.478935] nix-grpc-daemon[876]: time=2026-09-21T14:43:51.646Z level=INFO msg="All 2 paths already cached" worker1 # [ 39.493181] nix-grpc-daemon[780]: ts=2026-09-21T14:43:51Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.19 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.81 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 40.036123] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 40.042300] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 40.050234] nix-grpc-daemon[876]: time=2026-09-21T14:43:52.217Z level=INFO msg="All 2 paths already cached" worker1 # [ 40.062225] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker1 # [ 40.067456] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 40.073520] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 40.085314] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 40.098201] nix-grpc-daemon[876]: time=2026-09-21T14:43:52.265Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 40.106823] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 40.123394] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 40.218965] nix-daemon[862]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker1 # [ 40.232495] nix-daemon[862]: reaped child process 1028, status = succeeded worker1 # [ 40.313805] nix-daemon[862]: accepted connection from pid 1030, user nix-grpc-daemon (trusted) worker1 # [ 40.326555] nix-daemon[862]: reaped child process 1033, status = succeeded lb # [ 40.334875] niks3-server[982]: 2026/09/21 14:43:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.342033] nix-grpc-daemon[876]: time=2026-09-21T14:43:52.509Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.343599] nix-grpc-daemon[876]: time=2026-09-21T14:43:52.510Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 40.365957] niks3-server[982]: 2026/09/21 14:43:51 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 40.383152] niks3-server[982]: 2026/09/21 14:43:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 40.389126] niks3-server[982]: 2026/09/21 14:43:51 INFO Signed narinfos id=7 count=1 worker1 # [ 40.391673] nix-grpc-daemon[876]: time=2026-09-21T14:43:52.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.397869] niks3-server[982]: 2026/09/21 14:43:51 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 40.411936] niks3-server[982]: 2026/09/21 14:43:51 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 40.417331] niks3-server[982]: 2026/09/21 14:43:51 INFO Completed upload id=7 worker1 # [ 40.416513] nix-grpc-daemon[876]: time=2026-09-21T14:43:52.583Z level=INFO msg="Upload complete. (282ms)" lb # [ 40.419790] niks3-server[982]: 2026/09/21 14:43:51 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 40.421211] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 40.427599] nix-grpc-daemon[780]: ts=2026-09-21T14:43:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 40.439249] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 40.448272] nix-daemon[862]: reaped child process 1023, status = succeeded worker1 # [ 40.452589] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 41.488930] nix-daemon[862]: reaped child process 1037, status = succeeded worker1 # [ 41.567539] nix-daemon[862]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker1 # [ 41.581210] nix-daemon[862]: reaped child process 1057, status = succeeded lb # [ 41.589334] niks3-server[982]: 2026/09/21 14:43:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.597054] nix-grpc-daemon[876]: time=2026-09-21T14:43:53.764Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 41.599243] nix-grpc-daemon[876]: time=2026-09-21T14:43:53.765Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 41.631156] niks3-server[982]: 2026/09/21 14:43:53 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 41.644768] niks3-server[982]: 2026/09/21 14:43:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 41.656100] niks3-server[982]: 2026/09/21 14:43:53 INFO Signed narinfos id=8 count=1 worker1 # [ 41.658209] nix-grpc-daemon[876]: time=2026-09-21T14:43:53.825Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.659254] niks3-server[982]: 2026/09/21 14:43:53 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 41.665604] niks3-server[982]: 2026/09/21 14:43:53 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 41.674966] niks3-server[982]: 2026/09/21 14:43:53 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 41.677698] niks3-server[982]: 2026/09/21 14:43:53 INFO Completed upload id=8 worker1 # [ 41.676895] nix-grpc-daemon[876]: time=2026-09-21T14:43:53.844Z level=INFO msg="Upload complete. (215ms)" lb # [ 41.680028] niks3-server[982]: 2026/09/21 14:43:53 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 41.684521] nix-grpc-daemon[780]: ts=2026-09-21T14:43:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 41.699400] nix-daemon[862]: reaped child process 1035, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.82 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.12 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.14 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 41.974747] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: fd8f9b94888641739497efa1395c07b0 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 42.113351] nix[888]: don't know how to build these paths: client # [ 42.114719] nix[888]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 42.122302] nix-grpc-daemon[780]: ts=2026-09-21T14:43:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 42.132904] nix-grpc-daemon[780]: ts=2026-09-21T14:43:54Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 42.134720] nix-grpc-daemon[782]: ts=2026-09-21T14:43:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 worker1 # [ 42.137727] nix-grpc-daemon[780]: ts=2026-09-21T14:43:54Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 42.147481] nix-grpc-daemon[782]: ts=2026-09-21T14:43:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37302 client # [ 42.149073] nix[888]: copying 1 paths to 'lb:50051'... client # [ 42.149873] nix[888]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 42.157482] nix-grpc-daemon[782]: ts=2026-09-21T14:43:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 42.168630] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 42.189958] nix-grpc-daemon[782]: ts=2026-09-21T14:43:54Z level=info event=niks3_push_started pid=878 worker2 # [ 42.327774] nix-grpc-daemon[878]: time=2026-09-21T14:43:54.472Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 42.422671] nix-daemon[850]: accepted connection from pid 891, user nix-grpc-daemon (trusted) worker2 # [ 42.435892] nix-daemon[850]: reaped child process 894, status = succeeded worker2 # [ 42.521861] nix-daemon[850]: accepted connection from pid 896, user nix-grpc-daemon (trusted) worker2 # [ 42.535263] nix-daemon[850]: reaped child process 899, status = succeeded lb # [ 42.545075] niks3-server[982]: 2026/09/21 14:43:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.549728] nix-grpc-daemon[878]: time=2026-09-21T14:43:54.695Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 42.552703] nix-grpc-daemon[878]: time=2026-09-21T14:43:54.696Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 42.586258] niks3-server[982]: 2026/09/21 14:43:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 42.592875] niks3-server[982]: 2026/09/21 14:43:54 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 42.599297] niks3-server[982]: 2026/09/21 14:43:54 INFO Signed narinfos id=9 count=1 worker2 # [ 42.599272] nix-grpc-daemon[878]: time=2026-09-21T14:43:54.744Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.604129] niks3-server[982]: 2026/09/21 14:43:54 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 42.619222] niks3-server[982]: 2026/09/21 14:43:54 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 42.628204] niks3-server[982]: 2026/09/21 14:43:54 INFO Completed upload id=9 worker2 # [ 42.627032] nix-grpc-daemon[878]: time=2026-09-21T14:43:54.772Z level=INFO msg="Upload complete. (295ms)" lb # [ 42.632674] niks3-server[982]: 2026/09/21 14:43:54 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 42.630699] nix-grpc-daemon[782]: ts=2026-09-21T14:43:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 42.635882] nix-grpc-daemon[782]: ts=2026-09-21T14:43:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 42.644528] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 42.652460] nix-daemon[850]: reaped child process 876, status = succeeded worker2 # [ 42.657170] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # [ 42.649751] nix[888]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 43.036823] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: bc15f20ec76747cc80748e80adf02096 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds) client # [ 43.208978] nix[904]: don't know how to build these paths: client # [ 43.209847] nix[904]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 43.218336] nix-grpc-daemon[780]: ts=2026-09-21T14:43:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 43.228645] nix-grpc-daemon[780]: ts=2026-09-21T14:43:55Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 43.228976] nix-grpc-daemon[782]: ts=2026-09-21T14:43:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 client # [ 43.224092] nix[904]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.04 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 46.476315] nix-daemon[850]: reaped child process 903, status = succeeded worker2 # [ 46.550655] nix-daemon[850]: accepted connection from pid 933, user nix-grpc-daemon (trusted) worker2 # [ 46.563637] nix-daemon[850]: reaped child process 936, status = succeeded lb # [ 46.576488] niks3-server[982]: 2026/09/21 14:43:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.579952] nix-grpc-daemon[878]: time=2026-09-21T14:43:58.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 46.581524] nix-grpc-daemon[878]: time=2026-09-21T14:43:58.726Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 46.601146] envoy[917]: conn peer=[2001:db8:1::1]:53904 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9451 tx=4036 ms=4553 lb # [ 46.606400] envoy[917]: conn peer=[2001:db8:1::1]:53920 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=45 lb # [ 46.609951] envoy[917]: conn peer=[2001:db8:1::1]:53932 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1783 ms=1657 lb # [ 46.630469] niks3-server[982]: 2026/09/21 14:43:58 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 46.642107] niks3-server[982]: 2026/09/21 14:43:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker2 # [ 46.646416] nix-grpc-daemon[878]: time=2026-09-21T14:43:58.791Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.649209] niks3-server[982]: 2026/09/21 14:43:58 INFO Signed narinfos id=10 count=1 lb # [ 46.654923] niks3-server[982]: 2026/09/21 14:43:58 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 46.657454] niks3-server[982]: 2026/09/21 14:43:58 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 46.661818] niks3-server[982]: 2026/09/21 14:43:58 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 46.665640] niks3-server[982]: 2026/09/21 14:43:58 INFO Completed upload id=10 lb # [ 46.667139] niks3-server[982]: 2026/09/21 14:43:58 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 46.662599] nix-grpc-daemon[878]: time=2026-09-21T14:43:58.808Z level=INFO msg="Upload complete. (195ms)" worker2 # [ 46.669089] nix-grpc-daemon[782]: ts=2026-09-21T14:43:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 46.675799] nix-grpc-daemon[782]: ts=2026-09-21T14:43:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 46.688196] nix-daemon[850]: reaped child process 901, status = succeeded client # [ 46.692428] systemd[1]: dedup2.service: Deactivated successfully. client # [ 46.696120] systemd[1]: dedup2.service: Consumed 145ms CPU time over 3.658s wall clock time, 35.4M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic. client # [ 46.730824] systemd[1]: dedup1.service: Deactivated successfully. client # [ 46.733619] systemd[1]: dedup1.service: Consumed 119ms CPU time over 4.758s wall clock time, 43.5M memory peak, 7.2K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.77 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 47.821502] systemd[1]: Started Nix Daemon. client # [ 47.912037] nix-daemon[946]: accepted connection from pid 943, user root (trusted) worker1 # [ 48.039981] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 48.046120] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 48.057901] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 48.063876] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 48.101709] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 48.115965] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 48.129074] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 48.138682] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 48.241205] nix-daemon[862]: accepted connection from pid 1093, user nix-grpc-daemon (trusted) worker1 # [ 48.256237] nix-daemon[862]: reaped child process 1096, status = succeeded worker1 # [ 48.335470] nix-daemon[862]: accepted connection from pid 1098, user nix-grpc-daemon (trusted) worker1 # [ 48.349961] nix-daemon[862]: reaped child process 1101, status = succeeded lb # [ 48.355681] niks3-server[982]: 2026/09/21 14:43:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.363303] nix-grpc-daemon[876]: time=2026-09-21T14:44:00.530Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.364984] nix-grpc-daemon[876]: time=2026-09-21T14:44:00.530Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 48.380548] niks3-server[982]: 2026/09/21 14:43:59 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 48.391661] niks3-server[982]: 2026/09/21 14:43:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 48.397121] niks3-server[982]: 2026/09/21 14:43:59 INFO Signed narinfos id=11 count=1 worker1 # [ 48.398959] nix-grpc-daemon[876]: time=2026-09-21T14:44:00.566Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.407070] niks3-server[982]: 2026/09/21 14:43:59 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 48.417287] niks3-server[982]: 2026/09/21 14:43:59 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker1 # [ 48.422203] nix-grpc-daemon[876]: time=2026-09-21T14:44:00.589Z level=INFO msg="Upload complete. (269ms)" lb # [ 48.423160] niks3-server[982]: 2026/09/21 14:43:59 INFO Completed upload id=11 worker1 # [ 48.424312] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 48.429537] niks3-server[982]: 2026/09/21 14:43:59 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 48.429139] nix-grpc-daemon[780]: ts=2026-09-21T14:44:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 48.438059] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 48.442503] nix-daemon[862]: reaped child process 1091, status = succeeded worker1 # [ 48.447440] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 49.464121] nix-daemon[862]: reaped child process 1105, status = succeeded worker1 # [ 49.538580] nix-daemon[862]: accepted connection from pid 1121, user nix-grpc-daemon (trusted) worker1 # [ 49.552170] nix-daemon[862]: reaped child process 1124, status = succeeded lb # [ 49.559761] niks3-server[982]: 2026/09/21 14:44:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.567421] nix-grpc-daemon[876]: time=2026-09-21T14:44:01.734Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 49.568916] nix-grpc-daemon[876]: time=2026-09-21T14:44:01.736Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 49.598833] niks3-server[982]: 2026/09/21 14:44:01 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 49.616273] niks3-server[982]: 2026/09/21 14:44:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 49.621704] niks3-server[982]: 2026/09/21 14:44:01 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker1 # [ 49.629394] nix-grpc-daemon[876]: time=2026-09-21T14:44:01.796Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.630287] niks3-server[982]: 2026/09/21 14:44:01 INFO Signed narinfos id=12 count=1 lb # [ 49.635601] niks3-server[982]: 2026/09/21 14:44:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 49.645980] niks3-server[982]: 2026/09/21 14:44:01 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 49.648519] niks3-server[982]: 2026/09/21 14:44:01 INFO Completed upload id=12 worker1 # [ 49.649143] nix-grpc-daemon[876]: time=2026-09-21T14:44:01.816Z level=INFO msg="Upload complete. (194ms)" lb # [ 49.651934] niks3-server[982]: 2026/09/21 14:44:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 49.657441] nix-grpc-daemon[780]: ts=2026-09-21T14:44:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=1 worker1 # [ 49.665350] nix-grpc-daemon[780]: ts=2026-09-21T14:44:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 49.675172] nix-daemon[862]: reaped child process 1103, status = succeeded worker2 # [ 49.674771] nix-grpc-daemon[782]: ts=2026-09-21T14:44:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 49.685536] nix-grpc-daemon[782]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 49.700853] nix-grpc-daemon[782]: ts=2026-09-21T14:44:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 49.910395] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48522 worker2 # [ 49.910707] nix-grpc-daemon[782]: ts=2026-09-21T14:44:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 49.920979] nix-grpc-daemon[878]: time=2026-09-21T14:44:02.065Z level=INFO msg="All 1 paths already cached" worker1 # [ 49.938196] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 49.944326] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.949972] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 49.961669] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 49.974206] nix-grpc-daemon[876]: time=2026-09-21T14:44:02.141Z level=INFO msg="All 1 paths already cached" worker1 # [ 49.981666] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 49.989978] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 50.093684] nix-daemon[862]: accepted connection from pid 1130, user nix-grpc-daemon (trusted) worker1 # [ 50.108969] nix-daemon[862]: reaped child process 1133, status = succeeded worker1 # [ 50.193308] nix-daemon[862]: accepted connection from pid 1135, user nix-grpc-daemon (trusted) worker1 # [ 50.206840] nix-daemon[862]: reaped child process 1138, status = succeeded lb # [ 50.214100] niks3-server[982]: 2026/09/21 14:44:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.221295] nix-grpc-daemon[876]: time=2026-09-21T14:44:02.388Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 50.223355] nix-grpc-daemon[876]: time=2026-09-21T14:44:02.390Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 50.247107] niks3-server[982]: 2026/09/21 14:44:01 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 50.255096] niks3-server[982]: 2026/09/21 14:44:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 50.259606] niks3-server[982]: 2026/09/21 14:44:01 INFO Signed narinfos id=13 count=1 worker1 # [ 50.262307] nix-grpc-daemon[876]: time=2026-09-21T14:44:02.429Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.266908] niks3-server[982]: 2026/09/21 14:44:01 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 50.278177] niks3-server[982]: 2026/09/21 14:44:01 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 50.284222] niks3-server[982]: 2026/09/21 14:44:01 INFO Completed upload id=13 worker1 # [ 50.286101] nix-grpc-daemon[876]: time=2026-09-21T14:44:02.453Z level=INFO msg="Upload complete. (282ms)" worker1 # [ 50.288587] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 50.293356] niks3-server[982]: 2026/09/21 14:44:01 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 50.294494] nix-grpc-daemon[780]: ts=2026-09-21T14:44:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 50.305332] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 50.309762] nix-daemon[862]: reaped child process 1128, status = succeeded worker1 # [ 50.314057] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 51.760945] nix-daemon[862]: reaped child process 1142, status = succeeded worker1 # [ 51.836260] nix-daemon[862]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker1 # [ 51.849254] nix-daemon[862]: reaped child process 1162, status = succeeded lb # [ 51.857885] niks3-server[982]: 2026/09/21 14:44:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.865937] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 51.867652] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.034Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 51.894793] niks3-server[982]: 2026/09/21 14:44:03 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 51.906068] niks3-server[982]: 2026/09/21 14:44:03 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 51.917690] niks3-server[982]: 2026/09/21 14:44:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 51.922135] niks3-server[982]: 2026/09/21 14:44:03 INFO Signed narinfos id=14 count=1 worker1 # [ 51.921348] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.927461] niks3-server[982]: 2026/09/21 14:44:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 51.936253] niks3-server[982]: 2026/09/21 14:44:03 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 51.942261] niks3-server[982]: 2026/09/21 14:44:03 INFO Completed upload id=14 lb # [ 51.944740] niks3-server[982]: 2026/09/21 14:44:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 51.942973] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.110Z level=INFO msg="Upload complete. (220ms)" worker1 # [ 51.949733] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=1 worker1 # [ 51.958774] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 51.969372] nix-daemon[862]: reaped child process 1140, status = succeeded worker1 # [ 51.976106] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 51.979150] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 52.187222] nix-grpc-daemon[782]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 52.193133] nix-grpc-daemon[782]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 52.203831] nix-grpc-daemon[878]: time=2026-09-21T14:44:04.348Z level=INFO msg="All 1 paths already cached" worker1 # [ 52.220558] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 52.225952] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.231523] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 52.243174] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 52.254843] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.422Z level=INFO msg="All 2 paths already cached" worker1 # [ 52.262187] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 52.267072] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 52.353760] nix-daemon[862]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker1 # [ 52.366961] nix-daemon[862]: reaped child process 1171, status = succeeded worker1 # [ 52.450590] nix-daemon[862]: accepted connection from pid 1173, user nix-grpc-daemon (trusted) worker1 # [ 52.464378] nix-daemon[862]: reaped child process 1176, status = succeeded lb # [ 52.471882] niks3-server[982]: 2026/09/21 14:44:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.479948] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.646Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 52.481320] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.647Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 52.502508] niks3-server[982]: 2026/09/21 14:44:03 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 52.512986] niks3-server[982]: 2026/09/21 14:44:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker1 # [ 52.518295] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.685Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.519111] niks3-server[982]: 2026/09/21 14:44:03 INFO Signed narinfos id=15 count=1 lb # [ 52.529751] niks3-server[982]: 2026/09/21 14:44:03 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 52.539339] niks3-server[982]: 2026/09/21 14:44:03 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 52.542202] niks3-server[982]: 2026/09/21 14:44:03 INFO Completed upload id=15 worker1 # [ 52.541245] nix-grpc-daemon[876]: time=2026-09-21T14:44:04.708Z level=INFO msg="Upload complete. (268ms)" lb # [ 52.544557] niks3-server[982]: 2026/09/21 14:44:03 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 52.544976] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 52.549904] nix-grpc-daemon[780]: ts=2026-09-21T14:44:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 52.558992] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 52.565576] nix-daemon[862]: reaped child process 1166, status = succeeded worker1 # [ 52.569326] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 53.600469] nix-daemon[862]: reaped child process 1180, status = succeeded worker1 # [ 53.680405] nix-daemon[862]: accepted connection from pid 1196, user nix-grpc-daemon (trusted) worker1 # [ 53.692899] nix-daemon[862]: reaped child process 1199, status = succeeded lb # [ 53.703620] niks3-server[982]: 2026/09/21 14:44:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.758181] nix-grpc-daemon[876]: time=2026-09-21T14:44:05.925Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 53.763939] nix-grpc-daemon[876]: time=2026-09-21T14:44:05.928Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 53.797441] niks3-server[982]: 2026/09/21 14:44:05 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 53.813461] niks3-server[982]: 2026/09/21 14:44:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 53.818370] niks3-server[982]: 2026/09/21 14:44:05 INFO Signed narinfos id=16 count=1 worker1 # [ 53.820772] nix-grpc-daemon[876]: time=2026-09-21T14:44:05.987Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.824059] niks3-server[982]: 2026/09/21 14:44:05 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 53.837894] niks3-server[982]: 2026/09/21 14:44:05 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 53.843501] niks3-server[982]: 2026/09/21 14:44:05 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 53.850850] niks3-server[982]: 2026/09/21 14:44:05 INFO Completed upload id=16 worker1 # [ 53.850365] nix-grpc-daemon[876]: time=2026-09-21T14:44:06.017Z level=INFO msg="Upload complete. (273ms)" lb # [ 53.854582] niks3-server[982]: 2026/09/21 14:44:05 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 53.859268] nix-grpc-daemon[780]: ts=2026-09-21T14:44:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=1 worker1 # [ 53.865593] nix-grpc-daemon[780]: ts=2026-09-21T14:44:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 53.877215] nix-daemon[862]: reaped child process 1178, status = succeeded worker2 # [ 53.880471] nix-grpc-daemon[782]: ts=2026-09-21T14:44:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 53.891836] nix-grpc-daemon[782]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 53.905111] nix-grpc-daemon[782]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 53.918305] nix-grpc-daemon[782]: ts=2026-09-21T14:44:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 paths=1 nar_bytes_out=232 client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.32 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client # [ 54.028349] nix-daemon[946]: reaped child process 948, status = succeeded client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.38 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.26 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 54.698151] nix-daemon[946]: accepted connection from pid 1029, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 54.828904] nix-grpc-daemon[780]: ts=2026-09-21T14:44:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 54.834515] nix-grpc-daemon[780]: ts=2026-09-21T14:44:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 54.939527] nix-daemon[862]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 54.950678] nix-daemon[862]: reaped child process 1209, status = succeeded lb # [ 54.959377] niks3-server[982]: 2026/09/21 14:44:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.963424] nix-grpc-daemon[876]: time=2026-09-21T14:44:07.130Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 54.965201] nix-grpc-daemon[876]: time=2026-09-21T14:44:07.132Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 54.975442] niks3-server[982]: 2026/09/21 14:44:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 54.977524] niks3-server[982]: 2026/09/21 14:44:06 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 54.980249] niks3-server[982]: 2026/09/21 14:44:06 INFO Signed narinfos id=17 count=1 worker1 # [ 54.979480] nix-grpc-daemon[876]: time=2026-09-21T14:44:07.146Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.986187] niks3-server[982]: 2026/09/21 14:44:06 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 54.988257] niks3-server[982]: 2026/09/21 14:44:06 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 54.992870] niks3-server[982]: 2026/09/21 14:44:06 INFO Completed upload id=17 worker1 # [ 54.991912] nix-grpc-daemon[876]: time=2026-09-21T14:44:07.159Z level=INFO msg="Upload complete. (153ms)" lb # [ 54.994226] niks3-server[982]: 2026/09/21 14:44:06 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker1 # [ 55.006568] nix-grpc-daemon[780]: ts=2026-09-21T14:44:07Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker1 # [ 55.008559] nix-grpc-daemon[780]: ts=2026-09-21T14:44:07Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 55.009409] nix-grpc-daemon[782]: ts=2026-09-21T14:44:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 55.020238] nix-grpc-daemon[782]: ts=2026-09-21T14:44:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37302 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 55.031088] nix-grpc-daemon[782]: ts=2026-09-21T14:44:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37302 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 55.043981] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 55.150591] nix-daemon[850]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker2 # [ 55.165412] nix-daemon[850]: reaped child process 958, status = succeeded worker2 # [ 55.249254] nix-daemon[850]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker2 # [ 55.265333] nix-daemon[850]: reaped child process 963, status = succeeded lb # [ 55.275529] niks3-server[982]: 2026/09/21 14:44:06 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 55.284204] niks3-server[982]: 2026/09/21 14:44:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 55.289331] nix-grpc-daemon[878]: time=2026-09-21T14:44:07.434Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 55.290686] nix-grpc-daemon[878]: time=2026-09-21T14:44:07.434Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker2 # [ 55.292540] nix-grpc-daemon[878]: time=2026-09-21T14:44:07.434Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 55.331878] niks3-server[982]: 2026/09/21 14:44:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 55.559521] niks3-server[982]: 2026/09/21 14:44:06 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 55.563178] niks3-server[982]: 2026/09/21 14:44:06 INFO Signed narinfos id=18 count=1 lb # [ 55.565092] niks3-server[982]: 2026/09/21 14:44:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 55.567135] niks3-server[982]: 2026/09/21 14:44:06 INFO Signed narinfos id=19 count=2 lb # [ 55.569482] niks3-server[982]: 2026/09/21 14:44:06 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst worker2 # [ 55.566284] nix-grpc-daemon[878]: time=2026-09-21T14:44:07.710Z level=INFO msg="Uploading 3 narinfos" lb # [ 55.572056] niks3-server[982]: 2026/09/21 14:44:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 55.580549] niks3-server[982]: 2026/09/21 14:44:07 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 55.587191] niks3-server[982]: 2026/09/21 14:44:07 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 55.599946] niks3-server[982]: 2026/09/21 14:44:07 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 55.607144] niks3-server[982]: 2026/09/21 14:44:07 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 55.620564] niks3-server[982]: 2026/09/21 14:44:07 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 55.624057] niks3-server[982]: 2026/09/21 14:44:07 INFO Completed upload id=18 lb # [ 55.625492] niks3-server[982]: 2026/09/21 14:44:07 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 55.632803] niks3-server[982]: 2026/09/21 14:44:07 INFO Completed upload id=19 worker2 # [ 55.629784] nix-grpc-daemon[878]: time=2026-09-21T14:44:07.775Z level=INFO msg="Upload complete. (572ms)" worker2 # [ 55.634665] nix-grpc-daemon[782]: ts=2026-09-21T14:44:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 55.641350] nix-grpc-daemon[782]: ts=2026-09-21T14:44:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 55.651643] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 55.663461] nix-daemon[850]: reaped child process 953, status = succeeded worker2 # [ 55.675263] nix-grpc-daemon[782]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 55.690218] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 56.305849] nix-daemon[850]: reaped child process 968, status = succeeded worker2 # [ 56.382323] nix-daemon[850]: accepted connection from pid 984, user nix-grpc-daemon (trusted) worker2 # [ 56.394950] nix-daemon[850]: reaped child process 987, status = succeeded lb # [ 56.406912] niks3-server[982]: 2026/09/21 14:44:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 56.411435] nix-grpc-daemon[878]: time=2026-09-21T14:44:08.556Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 56.437265] niks3-server[982]: 2026/09/21 14:44:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 56.447256] niks3-server[982]: 2026/09/21 14:44:07 INFO Signed narinfos id=20 count=1 worker2 # [ 56.447151] nix-grpc-daemon[878]: time=2026-09-21T14:44:08.592Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.453301] niks3-server[982]: 2026/09/21 14:44:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 56.458064] niks3-server[982]: 2026/09/21 14:44:07 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 56.470891] niks3-server[982]: 2026/09/21 14:44:07 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete worker2 # [ 56.473806] nix-grpc-daemon[878]: time=2026-09-21T14:44:08.619Z level=INFO msg="Upload complete. (173ms)" lb # [ 56.477274] niks3-server[982]: 2026/09/21 14:44:07 INFO Completed upload id=20 client # copying 1 paths... worker2 # [ 56.478240] nix-grpc-daemon[782]: ts=2026-09-21T14:44:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=1 worker1 # [ 56.485481] nix-grpc-daemon[780]: ts=2026-09-21T14:44:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 lb # [ 56.486081] niks3-server[982]: 2026/09/21 14:44:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker1 # [ 56.491282] nix-grpc-daemon[780]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... worker2 # [ 56.489731] nix-daemon[850]: reaped child process 965, status = succeeded client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 56.510121] nix-grpc-daemon[782]: ts=2026-09-21T14:44:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 56.514211] nix-grpc-daemon[782]: ts=2026-09-21T14:44:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 paths=1 nar_bytes_out=120 lb # [ 56.601652] envoy[917]: conn peer=[2001:db8:1::1]:56030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=3472 lb # [ 56.605404] envoy[917]: conn peer=[2001:db8:1::1]:53942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3011 tx=1451 ms=4601 lb # [ 56.609070] envoy[917]: conn peer=[2001:db8:1::1]:56046 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3423 tx=1716 ms=1717 lb # [ 56.612576] envoy[917]: conn peer=[2001:db8:1::1]:56048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=79 lb # [ 56.616067] envoy[917]: conn peer=[2001:db8:1::1]:56070 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=51 lb # [ 56.620235] envoy[917]: conn peer=[2001:db8:1::1]:56062 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3893 tx=1933 ms=2118 lb # [ 56.623809] envoy[917]: conn peer=[2001:db8:1::1]:56084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2160 ms=1784 client # [ 56.617331] nix-daemon[946]: reaped child process 1032, status = succeeded lb # [ 56.627310] envoy[917]: conn peer=[2001:db8:1::1]:32982 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=90 lb # [ 56.630912] envoy[917]: conn peer=[2001:db8:1::1]:32996 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1934 ms=1741 client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.04 seconds) lb # [ 56.634372] envoy[917]: conn peer=[2001:db8:1::1]:33008 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=56 client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 56.724624] nix-daemon[946]: accepted connection from pid 1050, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 56.848425] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48522 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 56.849154] nix-grpc-daemon[782]: ts=2026-09-21T14:44:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 56.857484] nix-grpc-daemon[878]: time=2026-09-21T14:44:09.002Z level=INFO msg="All 1 paths already cached" worker1 # [ 56.870031] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 56.872390] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 56.874927] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 56.880685] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 56.888320] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 56.893458] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 56.900434] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5) worker1 # [ 56.946708] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 2/5) worker1 # [ 57.140175] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 3/5) worker1 # [ 57.266062] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 4/5) worker1 # [ 57.524959] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 57.528941] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 57.534319] nix-grpc-daemon[780]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 57.655089] nix-daemon[862]: accepted connection from pid 1223, user nix-grpc-daemon (trusted) worker1 # [ 57.671108] nix-daemon[862]: reaped child process 1226, status = succeeded worker1 # [ 57.751955] nix-daemon[862]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 57.768102] nix-daemon[862]: reaped child process 1231, status = succeeded lb # [ 57.774605] niks3-server[982]: 2026/09/21 14:44:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.778868] nix-grpc-daemon[876]: time=2026-09-21T14:44:09.945Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 57.780622] nix-grpc-daemon[876]: time=2026-09-21T14:44:09.947Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 57.791756] niks3-server[982]: 2026/09/21 14:44:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 57.793869] niks3-server[982]: 2026/09/21 14:44:09 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 57.796811] niks3-server[982]: 2026/09/21 14:44:09 INFO Signed narinfos id=21 count=1 worker1 # [ 57.795644] nix-grpc-daemon[876]: time=2026-09-21T14:44:09.962Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.801064] niks3-server[982]: 2026/09/21 14:44:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 57.803484] niks3-server[982]: 2026/09/21 14:44:09 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 57.808311] niks3-server[982]: 2026/09/21 14:44:09 INFO Completed upload id=21 worker1 # [ 57.807377] nix-grpc-daemon[876]: time=2026-09-21T14:44:09.974Z level=INFO msg="Upload complete. (255ms)" lb # [ 57.810355] niks3-server[982]: 2026/09/21 14:44:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 57.809270] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_in=560 worker1 # [ 57.814149] nix-grpc-daemon[780]: ts=2026-09-21T14:44:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 57.819397] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 57.821608] nix-daemon[862]: reaped child process 1216, status = succeeded worker1 # [ 57.826792] nix-daemon[862]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 59.267942] nix-daemon[862]: reaped child process 1235, status = succeeded worker1 # [ 59.343699] nix-daemon[862]: accepted connection from pid 1251, user nix-grpc-daemon (trusted) worker1 # [ 59.354869] nix-daemon[862]: reaped child process 1254, status = succeeded lb # [ 59.364072] niks3-server[982]: 2026/09/21 14:44:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.371315] nix-grpc-daemon[876]: time=2026-09-21T14:44:11.538Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 59.396107] niks3-server[982]: 2026/09/21 14:44:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 59.401521] niks3-server[982]: 2026/09/21 14:44:10 INFO Signed narinfos id=22 count=1 worker1 # [ 59.403853] nix-grpc-daemon[876]: time=2026-09-21T14:44:11.571Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.408862] niks3-server[982]: 2026/09/21 14:44:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 59.414120] niks3-server[982]: 2026/09/21 14:44:10 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 59.429216] niks3-server[982]: 2026/09/21 14:44:10 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 59.435356] niks3-server[982]: 2026/09/21 14:44:10 INFO Completed upload id=22 worker1 # [ 59.436389] nix-grpc-daemon[876]: time=2026-09-21T14:44:11.603Z level=INFO msg="Upload complete. (201ms)" lb # [ 59.438083] niks3-server[982]: 2026/09/21 14:44:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker1 # [ 59.438939] nix-grpc-daemon[780]: ts=2026-09-21T14:44:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=1 client # copying 1 paths... worker1 # [ 59.447357] nix-grpc-daemon[780]: ts=2026-09-21T14:44:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 59.450438] nix-daemon[862]: reaped child process 1233, status = succeeded worker1 # [ 59.461597] nix-grpc-daemon[780]: ts=2026-09-21T14:44:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 59.463862] nix-grpc-daemon[780]: ts=2026-09-21T14:44:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48522 duration_s=0 paths=1 nar_bytes_out=120 client # [ 59.563690] nix-daemon[946]: reaped child process 1053, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.94 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 59.667896] nix-daemon[946]: accepted connection from pid 1072, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 59.795702] nix-grpc-daemon[782]: ts=2026-09-21T14:44:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37302 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 59.805167] nix-grpc-daemon[780]: ts=2026-09-21T14:44:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 59.814830] nix-grpc-daemon[876]: time=2026-09-21T14:44:11.982Z level=INFO msg="All 1 paths already cached" worker1 # [ 59.828237] nix-grpc-daemon[780]: ts=2026-09-21T14:44:11Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker1 # [ 59.832427] nix-grpc-daemon[780]: ts=2026-09-21T14:44:11Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 59.838112] nix-grpc-daemon[782]: ts=2026-09-21T14:44:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 59.849698] nix-grpc-daemon[782]: ts=2026-09-21T14:44:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 59.862564] nix-grpc-daemon[878]: time=2026-09-21T14:44:12.007Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 59.870713] nix-grpc-daemon[782]: ts=2026-09-21T14:44:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 59.879736] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 59.981617] nix-daemon[850]: accepted connection from pid 991, user nix-grpc-daemon (trusted) worker2 # [ 59.995179] nix-daemon[850]: reaped child process 994, status = succeeded worker2 # [ 60.077380] nix-daemon[850]: accepted connection from pid 996, user nix-grpc-daemon (trusted) worker2 # [ 60.090758] nix-daemon[850]: reaped child process 999, status = succeeded lb # [ 60.100326] niks3-server[982]: 2026/09/21 14:44:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.105431] nix-grpc-daemon[878]: time=2026-09-21T14:44:12.250Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 60.106830] nix-grpc-daemon[878]: time=2026-09-21T14:44:12.250Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 60.131991] niks3-server[982]: 2026/09/21 14:44:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 60.138312] niks3-server[982]: 2026/09/21 14:44:11 INFO Signed narinfos id=23 count=1 worker2 # [ 60.138108] nix-grpc-daemon[878]: time=2026-09-21T14:44:12.283Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.143654] niks3-server[982]: 2026/09/21 14:44:11 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 60.157467] niks3-server[982]: 2026/09/21 14:44:11 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 60.164356] niks3-server[982]: 2026/09/21 14:44:11 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 60.169646] niks3-server[982]: 2026/09/21 14:44:11 INFO Completed upload id=23 worker2 # [ 60.168618] nix-grpc-daemon[878]: time=2026-09-21T14:44:12.314Z level=INFO msg="Upload complete. (274ms)" lb # [ 60.175331] niks3-server[982]: 2026/09/21 14:44:11 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 60.172414] nix-grpc-daemon[782]: ts=2026-09-21T14:44:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 paths=1 nar_bytes_in=560 worker2 # [ 60.178705] nix-grpc-daemon[782]: ts=2026-09-21T14:44:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 60.189578] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 60.192403] nix-daemon[850]: reaped child process 989, status = succeeded worker2 # [ 60.198540] nix-daemon[850]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 61.038147] nix-daemon[850]: reaped child process 1003, status = succeeded worker2 # [ 61.121401] nix-daemon[850]: accepted connection from pid 1019, user nix-grpc-daemon (trusted) worker2 # [ 61.133526] nix-daemon[850]: reaped child process 1022, status = succeeded lb # [ 61.144402] niks3-server[982]: 2026/09/21 14:44:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.148830] nix-grpc-daemon[878]: time=2026-09-21T14:44:13.294Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 61.174121] niks3-server[982]: 2026/09/21 14:44:12 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 61.181308] niks3-server[982]: 2026/09/21 14:44:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 61.188663] niks3-server[982]: 2026/09/21 14:44:12 INFO Signed narinfos id=24 count=1 worker2 # [ 61.188331] nix-grpc-daemon[878]: time=2026-09-21T14:44:13.333Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.196389] niks3-server[982]: 2026/09/21 14:44:12 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 61.208734] niks3-server[982]: 2026/09/21 14:44:12 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 61.214509] niks3-server[982]: 2026/09/21 14:44:12 INFO Completed upload id=24 worker2 # [ 61.211151] nix-grpc-daemon[878]: time=2026-09-21T14:44:13.356Z level=INFO msg="Upload complete. (205ms)" lb # [ 61.221771] niks3-server[982]: 2026/09/21 14:44:12 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 61.215983] nix-grpc-daemon[782]: ts=2026-09-21T14:44:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 61.229666] nix-daemon[850]: reaped child process 1001, status = succeeded client # copying 1 paths... worker1 # [ 61.266984] nix-grpc-daemon[780]: ts=2026-09-21T14:44:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 worker1 # [ 61.274377] nix-grpc-daemon[780]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 61.305291] nix-grpc-daemon[782]: ts=2026-09-21T14:44:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 worker2 # [ 61.309788] nix-grpc-daemon[782]: ts=2026-09-21T14:44:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37302 duration_s=0 paths=1 nar_bytes_out=120 client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.80 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.29 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # [ 61.415507] nix-daemon[946]: reaped child process 1075, status = succeeded client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.26 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.12 seconds) worker2 # [ 62.147858] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 62.828824] nix-grpc-daemon[782]: ts=2026-09-21T14:44:14Z level=info event=signal_exit worker1 # [ 64.599747] nix-grpc-daemon[780]: ts=2026-09-21T14:44:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48506 worker1 # [ 64.603864] nix-grpc-daemon[780]: ts=2026-09-21T14:44:16Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 64.596781] nix-grpc-daemon[782]: ts=2026-09-21T14:44:16Z level=info event=scheduler_restarting worker2 # [ 64.612416] nix-grpc-daemon[782]: ts=2026-09-21T14:44:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 64.632269] nix-daemon[850]: reaped child process 852, status = succeeded worker2 # [ 64.919606] nix-grpc-daemon[782]: E0000 00:00:1790001857.064724 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 64.924493] nix-grpc-daemon[782]: E0000 00:00:1790001857.065044 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 65.751568] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 65.755389] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 65.759549] systemd[1]: nix-grpc-daemon.service: Consumed 1.295s CPU time over 49.073s wall clock time, 56.3M memory peak, 52K incoming IP traffic, 141.6K outgoing IP traffic. worker2 # [ 65.771190] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 65.775420] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 65.779270] systemd[1]: nix-grpc-daemon.socket: Consumed 304us CPU time over 58.153s wall clock time, 256K memory peak, 52.1K incoming IP traffic, 44K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 65.984444] nix-grpc-daemon[780]: ts=2026-09-21T14:44:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48522 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 65.987581] nix-grpc-daemon[780]: ts=2026-09-21T14:44:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48522 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 66.063777] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 66.109564] systemd[1]: Stopping Nix worker-protocol over gRPC... lb # [ 66.602171] envoy[917]: conn peer=[2001:db8:1::1]:33024 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3741 tx=1895 ms=2666 lb # [ 66.605743] envoy[917]: conn peer=[2001:db8:1::1]:33034 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=52 lb # [ 66.609126] envoy[917]: conn peer=[2001:db8:1::1]:33036 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3755 tx=1990 ms=1526 lb # [ 66.612846] envoy[917]: conn peer=[2001:db8:1::1]:33050 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=19 lb # [ 66.616500] envoy[917]: conn peer=[2001:db8:1::4]:59562 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=58688 tx=2730 ms=47739 lb # [ 66.620145] envoy[917]: conn peer=[2001:db8:1::1]:36956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=11 worker1 # [ 66.749146] nix-grpc-daemon[780]: ts=2026-09-21T14:44:18Z level=info event=signal_exit worker2 # [ 66.748682] systemd[1]: Starting scheduler-token.service... worker2 # [ 66.809210] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 66.812462] systemd[1]: Finished scheduler-token.service. worker2 # [ 66.815329] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 63ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 66.824138] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 66.898672] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 66.900608] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 66.903677] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 66.907695] nix-grpc-daemon[1046]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 66.910196] nix-grpc-daemon[1046]: E0000 00:00:1790001859.053231 1046 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 66.915075] nix-grpc-daemon[1046]: E0000 00:00:1790001859.058585 1046 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 66.919192] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 66.922554] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 66.926122] nix-grpc-daemon[1046]: E0000 00:00:1790001859.070783 1088 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 66.939841] nix-grpc-daemon[1046]: E0000 00:00:1790001859.085293 1088 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 66.944056] nix-grpc-daemon[1046]: E0000 00:00:1790001859.087677 1088 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 66.953794] nix-grpc-daemon[1046]: E0000 00:00:1790001859.099285 1088 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 66.962420] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 66.963873] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 67.165224] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 67.169184] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 67.370233] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 67.374265] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 67.575414] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 67.579263] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 67.594797] niks3-server[982]: 2026/09/21 14:44:19 INFO lead: released remote=192.168.1.3:48730 worker2 # [ 67.780331] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 67.784201] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 67.986316] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 67.989529] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 68.187537] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.191404] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 68.392324] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.396192] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 68.598951] nix-grpc-daemon[780]: ts=2026-09-21T14:44:20Z level=info event=scheduler_restarting worker2 # [ 68.597172] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 68.603501] nix-grpc-daemon[780]: ts=2026-09-21T14:44:20Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 68.601174] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 68.607266] nix-grpc-daemon[780]: ts=2026-09-21T14:44:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48506 worker1 # [ 68.611433] nix-grpc-daemon[780]: ts=2026-09-21T14:44:20Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 68.633275] nix-daemon[862]: reaped child process 864, status = succeeded worker2 # [ 68.802386] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.806511] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 68.810836] nix-grpc-daemon[780]: ts=2026-09-21T14:44:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 68.857242] nix-grpc-daemon[780]: E0000 00:00:1790001861.024192 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 68.862092] nix-grpc-daemon[780]: E0000 00:00:1790001861.024520 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 69.008806] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 69.011925] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 69.209783] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 69.213667] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 69.414611] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 69.418529] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 69.619785] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 69.623606] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 69.711132] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 69.714963] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 69.718523] systemd[1]: nix-grpc-daemon.service: Consumed 2.623s CPU time over 53.116s wall clock time, 69.6M memory peak, 98.7K incoming IP traffic, 222.1K outgoing IP traffic. worker1 # [ 69.730585] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 69.734850] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 69.737933] systemd[1]: nix-grpc-daemon.socket: Consumed 317us CPU time over 1min 2.156s wall clock time, 256K memory peak, 92.3K incoming IP traffic, 76.9K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 69.824644] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 69.828574] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 69.916984] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 69.928404] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 69.946888] nix-grpc-daemon[1046]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5) worker2 # [ 70.004374] nix-grpc-daemon[1046]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5) worker2 # [ 70.030089] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 70.033640] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 70.040831] nix-grpc-daemon[1046]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 3/5) worker2 # [ 70.068983] nix-grpc-daemon[1046]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 563 ms (attempt 4/5) worker2 # [ 70.234921] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 70.238848] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 70.439761] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 70.443780] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 70.634658] nix-grpc-daemon[1046]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 70.637993] nix-grpc-daemon[1046]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 70.644513] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 70.648284] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 70.663474] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 70.673737] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 70.700765] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=niks3_push_started pid=1106 worker2 # [ 70.795410] nix-grpc-daemon[1106]: time=2026-09-21T14:44:22.940Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 70.849474] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 70.853172] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 70.881085] nix-daemon[850]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 70.893218] nix-daemon[850]: reaped child process 1122, status = succeeded lb # [ 70.902808] niks3-server[982]: 2026/09/21 14:44:22 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 70.910225] niks3-server[982]: 2026/09/21 14:44:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.910108] nix-grpc-daemon[1106]: time=2026-09-21T14:44:23.055Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 70.911710] nix-grpc-daemon[1106]: time=2026-09-21T14:44:23.057Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 70.913919] nix-grpc-daemon[1106]: time=2026-09-21T14:44:23.059Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 70.939112] niks3-server[982]: 2026/09/21 14:44:22 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 70.946459] niks3-server[982]: 2026/09/21 14:44:22 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 70.949122] niks3-server[982]: 2026/09/21 14:44:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 70.950745] niks3-server[982]: 2026/09/21 14:44:22 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 70.953513] niks3-server[982]: 2026/09/21 14:44:22 INFO Signed narinfos id=25 count=1 lb # [ 70.955234] niks3-server[982]: 2026/09/21 14:44:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 70.957257] niks3-server[982]: 2026/09/21 14:44:22 INFO Signed narinfos id=26 count=2 worker2 # [ 70.955670] nix-grpc-daemon[1106]: time=2026-09-21T14:44:23.100Z level=INFO msg="Uploading 3 narinfos" lb # [ 70.960531] niks3-server[982]: 2026/09/21 14:44:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 70.970556] niks3-server[982]: 2026/09/21 14:44:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 70.976260] niks3-server[982]: 2026/09/21 14:44:22 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 70.979584] niks3-server[982]: 2026/09/21 14:44:22 INFO Completed upload id=25 lb # [ 70.981101] niks3-server[982]: 2026/09/21 14:44:22 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 70.982747] niks3-server[982]: 2026/09/21 14:44:22 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 70.986222] niks3-server[982]: 2026/09/21 14:44:22 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 70.988462] niks3-server[982]: 2026/09/21 14:44:22 INFO Completed upload id=26 worker2 # [ 70.986209] nix-grpc-daemon[1106]: time=2026-09-21T14:44:23.131Z level=INFO msg="Upload complete. (187ms)" worker2 # [ 70.989946] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 70.999667] nix-daemon[850]: reaped child process 1104, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.25 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.01 seconds) worker2 # [ 71.052324] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 71.054068] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 71.059200] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 71.063067] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 71.138862] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 71.140931] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 71.144489] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 71.149062] nix-grpc-daemon[1280]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 71.150405] nix-grpc-daemon[1280]: E0000 00:00:1790001863.315521 1280 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 71.155787] nix-grpc-daemon[1280]: E0000 00:00:1790001863.320929 1280 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 71.159822] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 71.162344] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 71.165292] niks3-server[982]: 2026/09/21 14:44:22 INFO lead: acquired remote=192.168.1.3:38980 worker1 # [ 71.164531] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_take_over worker1 # [ 71.167077] nix-grpc-daemon[1280]: E0000 00:00:1790001863.333543 1319 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 71.179881] nix-grpc-daemon[1280]: E0000 00:00:1790001863.347172 1319 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 71.183171] nix-grpc-daemon[1280]: E0000 00:00:1790001863.349341 1319 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 71.194056] nix-grpc-daemon[1280]: E0000 00:00:1790001863.361337 1319 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 71.202401] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 71.204095] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 71.255917] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 71.259191] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 71.404970] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 71.409138] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 71.456690] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 71.460667] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 71.609791] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 71.613796] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 71.661137] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 71.663069] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 71.814785] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 71.822102] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37758 worker1 # [ 71.826198] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 71.863689] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 71.870055] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:24Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 71.871390] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37758 worker1 # [ 71.873168] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.08 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.87 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 72.324585] niks3-server[982]: 2026/09/21 14:44:23 INFO Shutdown signal received, draining in-flight requests timeout=10s worker1 # [ 72.324371] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:24Z level=info event=scheduler_lock_lost status=200 lb # [ 72.328284] niks3-server[982]: 2026/09/21 14:44:23 INFO lead: released remote=192.168.1.3:38980 worker2 # [ 72.322877] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:24Z level=info event=scheduler_lock_lost status=200 lb # [ 72.329518] systemd[1]: Stopping niks3 server... lb # [ 72.339262] systemd[1]: niks3.service: Deactivated successfully. lb # [ 72.340818] systemd[1]: Stopped niks3 server. lb # [ 72.341605] systemd[1]: niks3.service: Consumed 552ms CPU time over 52.003s wall clock time, 26.3M memory peak, 69.5K incoming IP traffic, 99.4K outgoing IP traffic. lb # [ 72.348903] systemd[1]: Starting niks3 server... lb # [ 72.396937] niks3-server[1117]: 2026/09/21 14:44:23 goose: no migrations to run. current version: 20260920000000 lb # [ 72.403224] niks3-server[1117]: 2026/09/21 14:44:23 OK 1_commit_pending_closure.sql (4.32ms) lb # [ 72.406651] niks3-server[1117]: 2026/09/21 14:44:23 OK 2_object_stats_trigger.sql (3.11ms) lb # [ 72.407752] niks3-server[1117]: 2026/09/21 14:44:23 goose: up to current file version: 2 lb # [ 72.409026] niks3-server[1117]: 2026/09/21 14:44:23 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 72.419732] niks3-server[1117]: 2026/09/21 14:44:23 INFO Read proxy enabled — serving cache objects from S3 lb # [ 72.420950] niks3-server[1117]: 2026/09/21 14:44:23 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 72.423189] systemd[1]: Started niks3 server. lb # [ 72.423858] niks3-server[1117]: 2026/09/21 14:44:23 INFO systemd watchdog enabled interval=15s lb # [ 72.426100] niks3-server[1117]: 2026/09/21 14:44:23 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 72.743555] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39590 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 72.752960] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39590 worker1 # [ 72.781419] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:24Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 72.786333] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:24Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 72.832092] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 72.835964] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) worker1 # [ 72.844459] nix-grpc-daemon[1280]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5) worker1 # [ 72.880786] nix-grpc-daemon[1280]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 149 ms (attempt 2/5) worker1 # [ 73.032486] nix-grpc-daemon[1280]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 3/5) worker1 # [ 73.117418] nix-grpc-daemon[1280]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 253 ms (attempt 4/5) lb # [ 73.332394] niks3-server[1117]: 2026/09/21 14:44:24 INFO lead: acquired remote=192.168.1.3:54620 worker1 # [ 73.378899] nix-grpc-daemon[1280]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 73.383190] nix-grpc-daemon[1280]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 73.399333] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60596 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker1 # [ 73.413176] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 73.423165] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) worker1 # [ 73.444882] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:25Z level=info event=niks3_push_started pid=1352 worker1 # [ 73.547367] nix-grpc-daemon[1352]: time=2026-09-21T14:44:25.714Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 73.644463] nix-daemon[862]: accepted connection from pid 1365, user nix-grpc-daemon (trusted) worker1 # [ 73.656455] nix-daemon[862]: reaped child process 1368, status = succeeded worker1 # [ 73.739858] nix-daemon[862]: accepted connection from pid 1370, user nix-grpc-daemon (trusted) worker1 # [ 73.753933] nix-daemon[862]: reaped child process 1373, status = succeeded lb # [ 73.759911] niks3-server[1117]: 2026/09/21 14:44:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.771253] nix-grpc-daemon[1352]: time=2026-09-21T14:44:25.938Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 73.774376] nix-grpc-daemon[1352]: time=2026-09-21T14:44:25.940Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 73.804826] niks3-server[1117]: 2026/09/21 14:44:25 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 73.811120] niks3-server[1117]: 2026/09/21 14:44:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 73.830701] niks3-server[1117]: 2026/09/21 14:44:25 INFO Signed narinfos id=27 count=1 worker1 # [ 73.834510] nix-grpc-daemon[1352]: time=2026-09-21T14:44:26.001Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.844293] niks3-server[1117]: 2026/09/21 14:44:25 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 73.850335] niks3-server[1117]: 2026/09/21 14:44:25 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 73.856174] niks3-server[1117]: 2026/09/21 14:44:25 INFO Completed upload id=27 worker1 # [ 73.854863] nix-grpc-daemon[1352]: time=2026-09-21T14:44:26.022Z level=INFO msg="Upload complete. (304ms)" worker1 # [ 73.859934] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60596 duration_s=0 paths=1 nar_bytes_in=536 worker1 # [ 73.867347] nix-grpc-daemon[1352]: time=2026-09-21T14:44:26.026Z level=WARN msg="Failed to register uploaded object" key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 73.871920] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 73.885392] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) worker1 # [ 73.886750] nix-daemon[862]: reaped child process 1350, status = succeeded worker1 # [ 73.892043] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 74.728889] nix-daemon[862]: reaped child process 1377, status = succeeded worker1 # [ 74.813349] nix-daemon[862]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker1 # [ 74.825925] nix-daemon[862]: reaped child process 1396, status = succeeded lb # [ 74.834544] niks3-server[1117]: 2026/09/21 14:44:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.845459] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.012Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 74.846938] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.014Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 74.882342] niks3-server[1117]: 2026/09/21 14:44:26 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 74.893985] niks3-server[1117]: 2026/09/21 14:44:26 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 74.900296] niks3-server[1117]: 2026/09/21 14:44:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 74.904688] niks3-server[1117]: 2026/09/21 14:44:26 INFO Signed narinfos id=28 count=1 worker1 # [ 74.907138] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.073Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.913035] niks3-server[1117]: 2026/09/21 14:44:26 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 74.918320] niks3-server[1117]: 2026/09/21 14:44:26 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 74.923896] niks3-server[1117]: 2026/09/21 14:44:26 INFO Completed upload id=28 worker1 # [ 74.923251] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.090Z level=INFO msg="Upload complete. (224ms)" lb # [ 74.926431] niks3-server[1117]: 2026/09/21 14:44:26 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker1 # [ 74.932650] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker1 # [ 74.944194] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 74.947349] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 74.957715] nix-daemon[862]: reaped child process 1375, status = succeeded worker1 # [ 74.987597] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 74.999793] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 75.013827] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.181Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker1 # [ 75.022219] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 75.030543] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) worker1 # [ 75.127174] nix-daemon[862]: accepted connection from pid 1402, user nix-grpc-daemon (trusted) worker1 # [ 75.139774] nix-daemon[862]: reaped child process 1405, status = succeeded worker1 # [ 75.221810] nix-daemon[862]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 75.234819] nix-daemon[862]: reaped child process 1410, status = succeeded lb # [ 75.241852] niks3-server[1117]: 2026/09/21 14:44:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.249791] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.417Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 75.251765] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.418Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 75.274343] niks3-server[1117]: 2026/09/21 14:44:26 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 75.283376] niks3-server[1117]: 2026/09/21 14:44:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 75.289584] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.456Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.290299] niks3-server[1117]: 2026/09/21 14:44:26 INFO Signed narinfos id=29 count=1 lb # [ 75.301573] niks3-server[1117]: 2026/09/21 14:44:26 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 75.310333] niks3-server[1117]: 2026/09/21 14:44:26 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 75.318580] niks3-server[1117]: 2026/09/21 14:44:26 INFO Completed upload id=29 worker1 # [ 75.317873] nix-grpc-daemon[1352]: time=2026-09-21T14:44:27.485Z level=INFO msg="Upload complete. (274ms)" lb # [ 75.321296] niks3-server[1117]: 2026/09/21 14:44:26 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker1 # [ 75.321684] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60596 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 75.327274] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 75.336490] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) worker1 # [ 75.344533] nix-daemon[862]: reaped child process 1400, status = succeeded worker1 # [ 75.348859] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 76.574174] nix-daemon[862]: reaped child process 1414, status = succeeded lb # [ 76.602485] envoy[917]: conn peer=[2001:db8:1::3]:47536 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=15847 tx=3165 ms=52018 lb # [ 76.607154] envoy[917]: conn peer=[2001:db8:1::1]:36970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=281 ms=1086 worker1 # [ 76.652214] nix-daemon[862]: accepted connection from pid 1430, user nix-grpc-daemon (trusted) worker1 # [ 76.665342] nix-daemon[862]: reaped child process 1433, status = succeeded lb # [ 76.673196] niks3-server[1117]: 2026/09/21 14:44:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.681236] nix-grpc-daemon[1352]: time=2026-09-21T14:44:28.848Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 76.682946] nix-grpc-daemon[1352]: time=2026-09-21T14:44:28.850Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 76.711145] niks3-server[1117]: 2026/09/21 14:44:28 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 76.718764] niks3-server[1117]: 2026/09/21 14:44:28 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 76.727435] niks3-server[1117]: 2026/09/21 14:44:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 76.731550] niks3-server[1117]: 2026/09/21 14:44:28 INFO Signed narinfos id=30 count=1 worker1 # [ 76.733191] nix-grpc-daemon[1352]: time=2026-09-21T14:44:28.900Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.738438] niks3-server[1117]: 2026/09/21 14:44:28 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 76.743145] niks3-server[1117]: 2026/09/21 14:44:28 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 76.747392] niks3-server[1117]: 2026/09/21 14:44:28 INFO Completed upload id=30 worker1 # [ 76.746336] nix-grpc-daemon[1352]: time=2026-09-21T14:44:28.913Z level=INFO msg="Upload complete. (189ms)" lb # [ 76.749306] niks3-server[1117]: 2026/09/21 14:44:28 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker1 # [ 76.751789] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker1 # [ 76.761951] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:28Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 76.765958] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:28Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 76.773575] nix-daemon[862]: reaped child process 1412, status = succeeded worker1 # [ 76.806410] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 76.818814] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 76.832310] nix-grpc-daemon[1352]: time=2026-09-21T14:44:28.999Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker1 # [ 76.841225] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 76.851170] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) worker1 # [ 76.943615] nix-daemon[862]: accepted connection from pid 1439, user nix-grpc-daemon (trusted) worker1 # [ 76.956857] nix-daemon[862]: reaped child process 1442, status = succeeded worker1 # [ 77.037407] nix-daemon[862]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) worker1 # [ 77.049907] nix-daemon[862]: reaped child process 1447, status = succeeded lb # [ 77.058815] niks3-server[1117]: 2026/09/21 14:44:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 77.067094] nix-grpc-daemon[1352]: time=2026-09-21T14:44:29.234Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 77.069084] nix-grpc-daemon[1352]: time=2026-09-21T14:44:29.236Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 77.089464] niks3-server[1117]: 2026/09/21 14:44:28 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 77.099814] niks3-server[1117]: 2026/09/21 14:44:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 77.104538] niks3-server[1117]: 2026/09/21 14:44:28 INFO Signed narinfos id=31 count=1 worker1 # [ 77.106232] nix-grpc-daemon[1352]: time=2026-09-21T14:44:29.273Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.109359] niks3-server[1117]: 2026/09/21 14:44:28 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 77.119941] niks3-server[1117]: 2026/09/21 14:44:28 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 77.125886] niks3-server[1117]: 2026/09/21 14:44:28 INFO Completed upload id=31 worker1 # [ 77.124993] nix-grpc-daemon[1352]: time=2026-09-21T14:44:29.292Z level=INFO msg="Upload complete. (263ms)" lb # [ 77.127192] niks3-server[1117]: 2026/09/21 14:44:28 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker1 # [ 77.127247] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60596 duration_s=0 paths=1 nar_bytes_in=784 worker1 # [ 77.130748] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 worker1 # [ 77.139563] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) worker1 # [ 77.145708] nix-daemon[862]: reaped child process 1437, status = succeeded worker1 # [ 77.148638] nix-daemon[862]: accepted connection from pid 1280, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 78.187292] nix-daemon[862]: reaped child process 1451, status = succeeded worker1 # [ 78.257238] nix-daemon[862]: accepted connection from pid 1467, user nix-grpc-daemon (trusted) worker1 # [ 78.269745] nix-daemon[862]: reaped child process 1470, status = succeeded lb # [ 78.279379] niks3-server[1117]: 2026/09/21 14:44:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.287049] nix-grpc-daemon[1352]: time=2026-09-21T14:44:30.454Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 78.288605] nix-grpc-daemon[1352]: time=2026-09-21T14:44:30.455Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 78.319598] niks3-server[1117]: 2026/09/21 14:44:29 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 78.331131] niks3-server[1117]: 2026/09/21 14:44:29 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 78.345850] niks3-server[1117]: 2026/09/21 14:44:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 78.349138] nix-grpc-daemon[1352]: time=2026-09-21T14:44:30.516Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.350186] niks3-server[1117]: 2026/09/21 14:44:29 INFO Signed narinfos id=32 count=1 lb # [ 78.359593] niks3-server[1117]: 2026/09/21 14:44:29 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 78.362663] niks3-server[1117]: 2026/09/21 14:44:29 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 78.366937] niks3-server[1117]: 2026/09/21 14:44:29 INFO Completed upload id=32 lb # [ 78.369126] niks3-server[1117]: 2026/09/21 14:44:29 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker1 # [ 78.367612] nix-grpc-daemon[1352]: time=2026-09-21T14:44:30.534Z level=INFO msg="Upload complete. (211ms)" worker1 # [ 78.374762] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60596 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker1 # [ 78.389711] nix-daemon[862]: reaped child process 1449, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.81 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.28 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 78.699183] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 79.157729] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:31Z level=info event=signal_exit lb # [ 79.335960] niks3-server[1117]: 2026/09/21 14:44:30 INFO lead: released remote=192.168.1.3:54620 worker2 # [ 80.333445] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:32Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 80.339729] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:32Z level=info event=scheduler_restarting worker1 # [ 80.342994] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:32Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 80.346503] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37758 worker1 # [ 80.350287] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:32Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 80.353403] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37758 worker1 # [ 80.356863] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:32Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 80.377710] nix-daemon[862]: reaped child process 1342, status = succeeded worker2 # [ 80.533745] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.537927] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.546772] nix-grpc-daemon[1280]: ts=2026-09-21T14:44:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 80.734642] nix-grpc-daemon[1280]: E0000 00:00:1790001872.901596 1325 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 80.738945] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.739992] nix-grpc-daemon[1280]: E0000 00:00:1790001872.906945 1325 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 80.743204] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.944169] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.948281] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.149232] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.153322] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.355495] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.358793] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.560148] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.564166] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.765365] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.769391] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.970142] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.974150] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.174967] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.179159] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.381400] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.384997] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.543119] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 82.546188] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 82.550482] systemd[1]: nix-grpc-daemon.service: Consumed 970ms CPU time over 11.479s wall clock time, 38.5M memory peak, 36.6K incoming IP traffic, 59.3K outgoing IP traffic. worker1 # [ 82.561161] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 82.565595] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 82.569444] systemd[1]: nix-grpc-daemon.socket: Consumed 295us CPU time over 11.509s wall clock time, 256K memory peak, 33K incoming IP traffic, 23.8K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 82.586330] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.591172] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.791976] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.796247] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.997139] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.001355] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.202256] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.206384] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.330578] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_take_over lb # [ 83.334439] niks3-server[1117]: 2026/09/21 14:44:34 INFO lead: acquired remote=192.168.1.4:41298 worker2 # [ 83.408438] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.412220] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.613499] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.617545] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.12 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 83.818691] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.822774] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.023799] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.040159] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:36Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 84.044178] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:36Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:59622 worker2 # [ 84.048314] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 84.904255] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 84.909753] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 84.931244] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 84.935825] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 84.980257] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 84.992418] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39590 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 85.004919] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 85.016112] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 85.116570] nix-daemon[850]: accepted connection from pid 1151, user nix-grpc-daemon (trusted) worker2 # [ 85.129692] nix-daemon[850]: reaped child process 1154, status = succeeded worker2 # [ 85.213154] nix-daemon[850]: accepted connection from pid 1156, user nix-grpc-daemon (trusted) worker2 # [ 85.226881] nix-daemon[850]: reaped child process 1159, status = succeeded lb # [ 85.237635] niks3-server[1117]: 2026/09/21 14:44:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.243860] nix-grpc-daemon[1106]: time=2026-09-21T14:44:37.389Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 85.245762] nix-grpc-daemon[1106]: time=2026-09-21T14:44:37.390Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 85.272925] niks3-server[1117]: 2026/09/21 14:44:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 85.285823] niks3-server[1117]: 2026/09/21 14:44:36 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst worker2 # [ 85.287546] nix-grpc-daemon[1106]: time=2026-09-21T14:44:37.432Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.291144] niks3-server[1117]: 2026/09/21 14:44:36 INFO Signed narinfos id=33 count=1 lb # [ 85.314345] niks3-server[1117]: 2026/09/21 14:44:36 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 85.320611] niks3-server[1117]: 2026/09/21 14:44:36 INFO Completed upload id=33 worker2 # [ 85.317110] nix-grpc-daemon[1106]: time=2026-09-21T14:44:37.462Z level=INFO msg="Upload complete. (289ms)" lb # [ 85.323162] niks3-server[1117]: 2026/09/21 14:44:36 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo lb # [ 85.326679] niks3-server[1117]: 2026/09/21 14:44:36 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls worker2 # [ 85.321493] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 85.328346] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 85.339134] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 85.350854] nix-daemon[850]: reaped child process 1149, status = succeeded worker2 # [ 85.354614] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 86.570403] nix-daemon[850]: reaped child process 1163, status = succeeded lb # [ 86.603101] envoy[917]: conn peer=[2001:db8:1::1]:36978 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9696 tx=4083 ms=5644 lb # [ 86.606774] envoy[917]: conn peer=[2001:db8:1::3]:57362 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1726 tx=569 ms=9339 worker2 # [ 86.652628] nix-daemon[850]: accepted connection from pid 1179, user nix-grpc-daemon (trusted) worker2 # [ 86.664870] nix-daemon[850]: reaped child process 1182, status = succeeded lb # [ 86.677230] niks3-server[1117]: 2026/09/21 14:44:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.693031] nix-grpc-daemon[1106]: time=2026-09-21T14:44:38.838Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 86.694592] nix-grpc-daemon[1106]: time=2026-09-21T14:44:38.840Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 86.732536] niks3-server[1117]: 2026/09/21 14:44:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 86.738228] niks3-server[1117]: 2026/09/21 14:44:38 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker2 # [ 86.742181] nix-grpc-daemon[1106]: time=2026-09-21T14:44:38.887Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.745624] niks3-server[1117]: 2026/09/21 14:44:38 INFO Signed narinfos id=34 count=1 lb # [ 86.751833] niks3-server[1117]: 2026/09/21 14:44:38 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 86.759237] niks3-server[1117]: 2026/09/21 14:44:38 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 86.769167] niks3-server[1117]: 2026/09/21 14:44:38 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 86.776315] niks3-server[1117]: 2026/09/21 14:44:38 INFO Completed upload id=34 worker2 # [ 86.773089] nix-grpc-daemon[1106]: time=2026-09-21T14:44:38.918Z level=INFO msg="Upload complete. (210ms)" lb # [ 86.779229] niks3-server[1117]: 2026/09/21 14:44:38 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker2 # [ 86.786856] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker2 # [ 86.793477] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:38Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 86.796568] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:38Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 86.806415] nix-daemon[850]: reaped child process 1161, status = succeeded worker2 # [ 86.836177] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 86.848764] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 86.862489] nix-grpc-daemon[1106]: time=2026-09-21T14:44:39.007Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 86.870668] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 86.878962] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 86.980128] nix-daemon[850]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker2 # [ 86.992771] nix-daemon[850]: reaped child process 1191, status = succeeded worker2 # [ 87.080463] nix-daemon[850]: accepted connection from pid 1193, user nix-grpc-daemon (trusted) worker2 # [ 87.093329] nix-daemon[850]: reaped child process 1196, status = succeeded lb # [ 87.104870] niks3-server[1117]: 2026/09/21 14:44:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.109502] nix-grpc-daemon[1106]: time=2026-09-21T14:44:39.255Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 87.111130] nix-grpc-daemon[1106]: time=2026-09-21T14:44:39.256Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 87.134985] niks3-server[1117]: 2026/09/21 14:44:38 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 87.143623] niks3-server[1117]: 2026/09/21 14:44:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 87.151436] niks3-server[1117]: 2026/09/21 14:44:38 INFO Signed narinfos id=35 count=1 worker2 # [ 87.151223] nix-grpc-daemon[1106]: time=2026-09-21T14:44:39.296Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.157691] niks3-server[1117]: 2026/09/21 14:44:38 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 87.169702] niks3-server[1117]: 2026/09/21 14:44:38 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker2 # [ 87.176035] nix-grpc-daemon[1106]: time=2026-09-21T14:44:39.321Z level=INFO msg="Upload complete. (284ms)" lb # [ 87.179854] niks3-server[1117]: 2026/09/21 14:44:38 INFO Completed upload id=35 worker2 # [ 87.178785] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 87.185571] niks3-server[1117]: 2026/09/21 14:44:38 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 87.184273] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 87.192484] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 87.201486] nix-daemon[850]: reaped child process 1186, status = succeeded worker2 # [ 87.206296] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 88.442655] nix-daemon[850]: reaped child process 1200, status = succeeded worker2 # [ 88.529042] nix-daemon[850]: accepted connection from pid 1216, user nix-grpc-daemon (trusted) worker2 # [ 88.540991] nix-daemon[850]: reaped child process 1219, status = succeeded lb # [ 88.552575] niks3-server[1117]: 2026/09/21 14:44:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.557700] nix-grpc-daemon[1106]: time=2026-09-21T14:44:40.703Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 88.560033] nix-grpc-daemon[1106]: time=2026-09-21T14:44:40.704Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 88.598470] niks3-server[1117]: 2026/09/21 14:44:40 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 88.603451] niks3-server[1117]: 2026/09/21 14:44:40 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 88.616306] niks3-server[1117]: 2026/09/21 14:44:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 88.622238] niks3-server[1117]: 2026/09/21 14:44:40 INFO Signed narinfos id=36 count=1 worker2 # [ 88.619229] nix-grpc-daemon[1106]: time=2026-09-21T14:44:40.764Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.629764] niks3-server[1117]: 2026/09/21 14:44:40 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 88.634053] niks3-server[1117]: 2026/09/21 14:44:40 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 88.637024] niks3-server[1117]: 2026/09/21 14:44:40 INFO Completed upload id=36 worker2 # [ 88.633775] nix-grpc-daemon[1106]: time=2026-09-21T14:44:40.779Z level=INFO msg="Upload complete. (219ms)" lb # [ 88.639859] niks3-server[1117]: 2026/09/21 14:44:40 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 88.641919] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker2 # [ 88.652301] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:40Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 88.656219] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:40Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 88.665671] nix-daemon[850]: reaped child process 1198, status = succeeded worker2 # [ 88.695278] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 88.707568] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 88.720491] nix-grpc-daemon[1106]: time=2026-09-21T14:44:40.865Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 88.729241] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 88.737683] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 88.837096] nix-daemon[850]: accepted connection from pid 1225, user nix-grpc-daemon (trusted) worker2 # [ 88.851124] nix-daemon[850]: reaped child process 1228, status = succeeded worker2 # [ 88.935380] nix-daemon[850]: accepted connection from pid 1230, user nix-grpc-daemon (trusted) worker2 # [ 88.948648] nix-daemon[850]: reaped child process 1233, status = succeeded lb # [ 88.959356] niks3-server[1117]: 2026/09/21 14:44:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.965107] nix-grpc-daemon[1106]: time=2026-09-21T14:44:41.110Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 88.967039] nix-grpc-daemon[1106]: time=2026-09-21T14:44:41.112Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 88.992347] niks3-server[1117]: 2026/09/21 14:44:40 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 89.002690] niks3-server[1117]: 2026/09/21 14:44:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker2 # [ 89.007280] nix-grpc-daemon[1106]: time=2026-09-21T14:44:41.152Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.010437] niks3-server[1117]: 2026/09/21 14:44:40 INFO Signed narinfos id=37 count=1 lb # [ 89.014767] niks3-server[1117]: 2026/09/21 14:44:40 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 89.026100] niks3-server[1117]: 2026/09/21 14:44:40 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 89.029769] niks3-server[1117]: 2026/09/21 14:44:40 INFO Completed upload id=37 worker2 # [ 89.026284] nix-grpc-daemon[1106]: time=2026-09-21T14:44:41.171Z level=INFO msg="Upload complete. (275ms)" lb # [ 89.033084] niks3-server[1117]: 2026/09/21 14:44:40 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 89.029813] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 89.034905] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 89.044860] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 89.049152] nix-daemon[850]: reaped child process 1223, status = succeeded worker2 # [ 89.053861] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 90.068319] nix-daemon[850]: reaped child process 1237, status = succeeded worker2 # [ 90.147556] nix-daemon[850]: accepted connection from pid 1253, user nix-grpc-daemon (trusted) worker2 # [ 90.159423] nix-daemon[850]: reaped child process 1256, status = succeeded lb # [ 90.171721] niks3-server[1117]: 2026/09/21 14:44:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.176385] nix-grpc-daemon[1106]: time=2026-09-21T14:44:42.321Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 90.178147] nix-grpc-daemon[1106]: time=2026-09-21T14:44:42.323Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 90.212305] niks3-server[1117]: 2026/09/21 14:44:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 90.219188] niks3-server[1117]: 2026/09/21 14:44:41 INFO Signed narinfos id=38 count=1 worker2 # [ 90.219602] nix-grpc-daemon[1106]: time=2026-09-21T14:44:42.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.227415] niks3-server[1117]: 2026/09/21 14:44:41 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 90.232500] niks3-server[1117]: 2026/09/21 14:44:41 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 90.243859] niks3-server[1117]: 2026/09/21 14:44:41 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 90.248076] niks3-server[1117]: 2026/09/21 14:44:41 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 90.251530] niks3-server[1117]: 2026/09/21 14:44:41 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo lb # [ 90.254800] niks3-server[1117]: 2026/09/21 14:44:41 INFO Completed upload id=38 worker2 # [ 90.251571] nix-grpc-daemon[1106]: time=2026-09-21T14:44:42.396Z level=INFO msg="Upload complete. (189ms)" worker2 # [ 90.259340] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker2 # [ 90.272365] nix-daemon[850]: reaped child process 1235, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.53 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.12 seconds) worker1 # [ 90.462976] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 90.474105] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 90.559657] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:42Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 90.561661] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 90.564811] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 90.569053] nix-grpc-daemon[1488]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 90.571152] nix-grpc-daemon[1488]: E0000 00:00:1790001882.736252 1488 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 90.576776] nix-grpc-daemon[1488]: E0000 00:00:1790001882.741717 1488 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 90.580523] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 90.584084] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 90.590103] nix-grpc-daemon[1488]: E0000 00:00:1790001882.756392 1530 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 90.604110] nix-grpc-daemon[1488]: E0000 00:00:1790001882.771382 1530 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 90.609055] nix-grpc-daemon[1488]: E0000 00:00:1790001882.773643 1530 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 90.617983] nix-grpc-daemon[1488]: E0000 00:00:1790001882.785287 1530 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 90.627879] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.627117] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:42Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:59622 worker2 # [ 90.631288] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.26 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 90.836537] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: adb5112fec3e4a05b8b1baf3a49221b0 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) worker2 # [ 90.981277] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39590 client # [ 90.980648] nix[1199]: don't know how to build these paths: client # [ 90.981628] nix[1199]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 90.995638] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 91.000822] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 91.040301] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 91.052287] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39590 client # [ 91.055217] nix[1199]: copying 1 paths to 'lb:50051'... worker2 # [ 91.063869] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 client # [ 91.058149] nix[1199]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 91.076807] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 91.180691] nix-daemon[850]: accepted connection from pid 1269, user nix-grpc-daemon (trusted) worker2 # [ 91.194239] nix-daemon[850]: reaped child process 1272, status = succeeded worker2 # [ 91.281211] nix-daemon[850]: accepted connection from pid 1274, user nix-grpc-daemon (trusted) worker2 # [ 91.296414] nix-daemon[850]: reaped child process 1277, status = succeeded lb # [ 91.305928] niks3-server[1117]: 2026/09/21 14:44:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.326106] nix-grpc-daemon[1106]: time=2026-09-21T14:44:43.471Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 91.327941] nix-grpc-daemon[1106]: time=2026-09-21T14:44:43.473Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 91.353410] niks3-server[1117]: 2026/09/21 14:44:42 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 91.363126] niks3-server[1117]: 2026/09/21 14:44:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 91.368464] niks3-server[1117]: 2026/09/21 14:44:42 INFO Signed narinfos id=39 count=1 worker2 # [ 91.368773] nix-grpc-daemon[1106]: time=2026-09-21T14:44:43.513Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.376297] niks3-server[1117]: 2026/09/21 14:44:42 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 91.390947] niks3-server[1117]: 2026/09/21 14:44:42 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 91.398066] niks3-server[1117]: 2026/09/21 14:44:42 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo lb # [ 91.400729] niks3-server[1117]: 2026/09/21 14:44:42 INFO Completed upload id=39 worker2 # [ 91.398621] nix-grpc-daemon[1106]: time=2026-09-21T14:44:43.544Z level=INFO msg="Upload complete. (310ms)" worker2 # [ 91.403717] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 91.409963] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 worker2 # [ 91.421581] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 91.431610] nix-daemon[850]: reaped child process 1267, status = succeeded client # [ 91.430776] nix[1199]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... worker2 # [ 91.439377] nix-daemon[850]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 93.494332] systemd-journald[283]: Received client request to rotate journal, rotating. worker1 # [ 93.514757] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/c6bff1b450e043bcb2fb427d125cbbfa. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 93.421230] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker2 # [ 93.925193] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:46Z level=info event=draining lb # [ 96.603128] envoy[917]: conn peer=[2001:db8:1::1]:58576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9534 tx=4022 ms=5365 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 98.662469] nix-daemon[850]: reaped child process 1281, status = succeeded worker2 # [ 98.737595] nix-daemon[850]: accepted connection from pid 1322, user nix-grpc-daemon (trusted) worker2 # [ 98.749839] nix-daemon[850]: reaped child process 1325, status = succeeded lb # [ 98.759882] niks3-server[1117]: 2026/09/21 14:44:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.766658] nix-grpc-daemon[1106]: time=2026-09-21T14:44:50.911Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 98.768165] nix-grpc-daemon[1106]: time=2026-09-21T14:44:50.913Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 98.810251] niks3-server[1117]: 2026/09/21 14:44:50 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 98.821080] niks3-server[1117]: 2026/09/21 14:44:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 98.821968] nix-grpc-daemon[1106]: time=2026-09-21T14:44:50.967Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.826132] niks3-server[1117]: 2026/09/21 14:44:50 INFO Signed narinfos id=40 count=1 lb # [ 98.833251] niks3-server[1117]: 2026/09/21 14:44:50 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 98.838395] niks3-server[1117]: 2026/09/21 14:44:50 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 98.846675] niks3-server[1117]: 2026/09/21 14:44:50 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 98.851932] niks3-server[1117]: 2026/09/21 14:44:50 INFO Completed upload id=40 worker2 # [ 98.848718] nix-grpc-daemon[1106]: time=2026-09-21T14:44:50.994Z level=INFO msg="Upload complete. (194ms)" lb # [ 98.854286] niks3-server[1117]: 2026/09/21 14:44:50 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 98.857451] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39590 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 98.871151] nix-daemon[850]: reaped child process 1279, status = succeeded client # [ 98.879526] systemd[1]: rs.service: Deactivated successfully. client # [ 98.883296] systemd[1]: rs.service: Consumed 130ms CPU time over 8.046s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 98.926299] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:51Z level=info event=signal_exit lb # [ 99.336248] niks3-server[1117]: 2026/09/21 14:44:50 INFO lead: released remote=192.168.1.4:41298 worker2 # [ 100.336526] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:52Z level=info event=scheduler_restarting worker1 # [ 100.338829] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:52Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 100.341904] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:52Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 100.345441] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59622 worker2 # [ 100.349168] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:52Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 100.352366] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59622 worker2 # [ 100.355978] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:52Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 100.372469] nix-daemon[850]: reaped child process 1098, status = succeeded worker1 # [ 100.538457] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.542912] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.548149] nix-grpc-daemon[1046]: ts=2026-09-21T14:44:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 100.589487] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:52Z level=info event=scheduler_take_over lb # [ 100.590776] niks3-server[1117]: 2026/09/21 14:44:52 INFO lead: acquired remote=192.168.1.3:44132 worker2 # [ 100.715343] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 100.719290] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 100.722774] systemd[1]: nix-grpc-daemon.service: Consumed 1.443s CPU time over 33.895s wall clock time, 40.1M memory peak, 63.2K incoming IP traffic, 158.5K outgoing IP traffic. worker2 # [ 100.737466] systemd[1]: Starting scheduler-token.service... worker1 # [ 100.744149] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.752560] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:58102 worker1 # [ 100.756324] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.15 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 100.781228] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 100.783482] systemd[1]: Finished scheduler-token.service. worker2 # [ 100.785198] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 45ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 100.788273] systemd[1]: Starting Nix worker-protocol over gRPC... client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker2 # [ 100.864834] nix-grpc-daemon[1335]: ts=2026-09-21T14:44:53Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 100.866822] nix-grpc-daemon[1335]: ts=2026-09-21T14:44:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 100.869950] nix-grpc-daemon[1335]: ts=2026-09-21T14:44:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 100.874053] nix-grpc-daemon[1335]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 100.877187] nix-grpc-daemon[1335]: E0000 00:00:1790001893.019448 1335 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 100.881889] nix-grpc-daemon[1335]: E0000 00:00:1790001893.022615 1335 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 100.885450] nix-grpc-daemon[1335]: ts=2026-09-21T14:44:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 100.888152] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 100.890076] nix-grpc-daemon[1335]: E0000 00:00:1790001893.035012 1377 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 100.901689] nix-grpc-daemon[1335]: E0000 00:00:1790001893.047166 1377 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 100.905577] nix-grpc-daemon[1335]: E0000 00:00:1790001893.049634 1377 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 100.917181] nix-grpc-daemon[1335]: E0000 00:00:1790001893.062667 1377 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 100.925610] nix-grpc-daemon[1335]: ts=2026-09-21T14:44:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.935819] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:53Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 100.940272] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:53Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:58102 worker1 # [ 100.944211] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.18 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 101.011859] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 2c6273b34f4e4fb1b87fad78e4d154bf client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker1 # [ 101.165169] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58106 worker1 # [ 101.176981] nix-daemon[862]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # [ 101.180180] nix[1235]: don't know how to build these paths: client # [ 101.181181] nix[1235]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 101.196753] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:53Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 101.202557] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:53Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 101.246490] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58106 worker1 # [ 101.257814] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5) worker1 # [ 101.302201] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 2/5) worker1 # [ 101.363167] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 350 ms (attempt 3/5) worker1 # [ 101.714585] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 575 ms (attempt 4/5) worker1 # [ 102.292182] nix-grpc-daemon[1488]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 102.295344] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 102.313928] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58106 client # [ 102.316447] nix[1235]: copying 1 paths to 'lb:50051'... worker1 # [ 102.327108] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58106 client # [ 102.318712] nix[1235]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 102.340307] nix-daemon[862]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker1 # [ 102.361289] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:54Z level=info event=niks3_push_started pid=1611 worker1 # [ 102.464252] nix-grpc-daemon[1611]: time=2026-09-21T14:44:54.630Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 102.548888] nix-daemon[862]: accepted connection from pid 1624, user nix-grpc-daemon (trusted) worker1 # [ 102.561260] nix-daemon[862]: reaped child process 1627, status = succeeded worker1 # [ 102.645510] nix-daemon[862]: accepted connection from pid 1629, user nix-grpc-daemon (trusted) worker1 # [ 102.658361] nix-daemon[862]: reaped child process 1632, status = succeeded lb # [ 102.666929] niks3-server[1117]: 2026/09/21 14:44:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 102.677085] nix-grpc-daemon[1611]: time=2026-09-21T14:44:54.844Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 102.680173] nix-grpc-daemon[1611]: time=2026-09-21T14:44:54.845Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 102.708101] niks3-server[1117]: 2026/09/21 14:44:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 102.714474] niks3-server[1117]: 2026/09/21 14:44:54 INFO Signed narinfos id=41 count=1 worker1 # [ 102.717051] nix-grpc-daemon[1611]: time=2026-09-21T14:44:54.884Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.725965] niks3-server[1117]: 2026/09/21 14:44:54 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 102.735654] niks3-server[1117]: 2026/09/21 14:44:54 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 102.744955] niks3-server[1117]: 2026/09/21 14:44:54 INFO Completed upload id=41 worker1 # [ 102.744116] nix-grpc-daemon[1611]: time=2026-09-21T14:44:54.911Z level=INFO msg="Upload complete. (280ms)" lb # [ 102.746634] niks3-server[1117]: 2026/09/21 14:44:54 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls worker1 # [ 102.746557] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58106 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 102.750384] nix-grpc-daemon[1488]: ts=2026-09-21T14:44:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58106 lb # [ 102.757492] niks3-server[1117]: 2026/09/21 14:44:54 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 102.756890] nix-daemon[862]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker1 # [ 102.759210] nix-daemon[862]: reaped child process 1609, status = succeeded worker1 # [ 102.764225] nix-daemon[862]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # [ 102.754365] nix[1235]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 104.602280] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1488 (nix-grpc-daemon) on client request. worker1 # [ 104.604884] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 104.608144] niks3-server[1117]: 2026/09/21 14:44:56 INFO lead: released remote=192.168.1.3:44132 client # [ 104.603264] nix[1235]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 104.610312] nix-grpc-daemon[1335]: ts=2026-09-21T14:44:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker1 # [ 104.618186] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 104.619651] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. client # [ 104.607258] nix[1235]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 104.622143] systemd[1]: nix-grpc-daemon.service: Consumed 422ms CPU time over 14.144s wall clock time, 35.7M memory peak, 15.1K incoming IP traffic, 22.2K outgoing IP traffic. worker1 # [ 104.627550] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 104.633080] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 104.667393] nix-daemon[862]: reaped child process 1634, status = succeeded worker1 # [ 104.668779] nix-daemon[862]: reaped child process 1597, status = succeeded worker1 # [ 104.674208] nix-daemon[1636]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 104.684223] nix-daemon[862]: reaped child process 1636, status = failed with exit code 1 worker1 # [ 104.725311] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 104.727431] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 104.730623] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 104.734994] nix-grpc-daemon[1673]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 104.736394] nix-grpc-daemon[1673]: E0000 00:00:1790001896.901912 1673 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 104.744084] nix-grpc-daemon[1673]: E0000 00:00:1790001896.907340 1673 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 104.747115] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 104.750753] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.18 seconds) client: must succeed: sleep 5.0 worker1 # [ 104.756157] nix-grpc-daemon[1673]: E0000 00:00:1790001896.922749 1712 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 104.760060] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=scheduler_take_over lb # [ 104.760946] niks3-server[1117]: 2026/09/21 14:44:56 INFO lead: acquired remote=192.168.1.3:51358 worker1 # [ 104.770738] nix-grpc-daemon[1673]: E0000 00:00:1790001896.938042 1712 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 104.775054] nix-grpc-daemon[1673]: E0000 00:00:1790001896.940299 1712 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 104.784939] nix-grpc-daemon[1673]: E0000 00:00:1790001896.952234 1712 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 104.793888] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.796921] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:55562 worker1 # [ 104.798689] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 104.811158] nix-grpc-daemon[1335]: ts=2026-09-21T14:44:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.818569] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 104.819918] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:55562 worker1 # [ 104.821602] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 105.123159] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:57Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 105.128821] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:57Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 105.171834] nix-grpc-daemon[1673]: ts=2026-09-21T14:44:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55578 worker1 # [ 105.182171] nix-daemon[862]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker1 # [ 105.195898] nix-daemon[862]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) client # [ 105.199480] nix[1235]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 105.210762] nix-daemon[862]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) lb # [ 106.603472] envoy[917]: conn peer=[2001:db8:1::1]:58586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2960 tx=1405 ms=7883 lb # [ 106.607273] envoy[917]: conn peer=[2001:db8:1::4]:52166 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=36673 tx=1995 ms=33579 lb # [ 106.611080] envoy[917]: conn peer=[2001:db8:1::3]:42368 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=993 tx=363 ms=13989 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 110.035551] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:02Z level=info event=niks3_push_started pid=1756 worker1 # [ 110.067439] nix-daemon[862]: reaped child process 1731, status = succeeded worker1 # [ 110.143879] nix-grpc-daemon[1756]: time=2026-09-21T14:45:02.310Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 110.228907] nix-daemon[862]: accepted connection from pid 1768, user nix-grpc-daemon (trusted) worker1 # [ 110.241858] nix-daemon[862]: reaped child process 1771, status = succeeded lb # [ 110.251226] niks3-server[1117]: 2026/09/21 14:45:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.259650] nix-grpc-daemon[1756]: time=2026-09-21T14:45:02.426Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 110.261170] nix-grpc-daemon[1756]: time=2026-09-21T14:45:02.428Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 110.290816] niks3-server[1117]: 2026/09/21 14:45:01 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 110.304570] niks3-server[1117]: 2026/09/21 14:45:01 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 110.322760] niks3-server[1117]: 2026/09/21 14:45:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 110.330798] niks3-server[1117]: 2026/09/21 14:45:01 INFO Signed narinfos id=42 count=1 worker1 # [ 110.329960] nix-grpc-daemon[1756]: time=2026-09-21T14:45:02.497Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.337159] niks3-server[1117]: 2026/09/21 14:45:01 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 110.346096] niks3-server[1117]: 2026/09/21 14:45:01 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 110.351783] niks3-server[1117]: 2026/09/21 14:45:01 INFO Completed upload id=42 worker1 # [ 110.351257] nix-grpc-daemon[1756]: time=2026-09-21T14:45:02.518Z level=INFO msg="Upload complete. (204ms)" lb # [ 110.354100] niks3-server[1117]: 2026/09/21 14:45:01 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 110.359270] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55578 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 110.374171] nix-daemon[862]: reaped child process 1729, status = succeeded client # [ 110.388331] systemd[1]: mid.service: Deactivated successfully. client # [ 110.390858] systemd[1]: mid.service: Consumed 147ms CPU time over 9.375s wall clock time, 43.4M memory peak, 8.7K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.10 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 111.088986] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 77ff1daf9f084f7b893502429a334930 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) client # [ 111.214069] nix[1271]: don't know how to build these paths: client # [ 111.214994] nix[1271]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 111.222660] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55578 worker1 # [ 111.234237] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:03Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 111.238405] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:03Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 111.287903] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 111.300595] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 111.318403] nix-grpc-daemon[1335]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) worker2 # [ 111.395103] nix-grpc-daemon[1335]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5) worker2 # [ 111.457956] nix-grpc-daemon[1335]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 238 ms (attempt 3/5) worker2 # [ 111.698196] nix-grpc-daemon[1335]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 320 ms (attempt 4/5) worker2 # [ 112.020393] nix-grpc-daemon[1335]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 112.023921] nix-grpc-daemon[1335]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 112.039960] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 client # [ 112.042178] nix[1271]: copying 1 paths to 'lb:50051'... worker2 # [ 112.050340] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 client # [ 112.045156] nix[1271]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 112.060402] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 112.081698] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:04Z level=info event=niks3_push_started pid=1427 worker2 # [ 112.180160] nix-grpc-daemon[1427]: time=2026-09-21T14:45:04.325Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 112.267213] nix-daemon[850]: accepted connection from pid 1439, user nix-grpc-daemon (trusted) worker2 # [ 112.292638] nix-daemon[850]: reaped child process 1445, status = succeeded worker2 # [ 112.374549] nix-daemon[850]: accepted connection from pid 1448, user nix-grpc-daemon (trusted) worker2 # [ 112.386472] nix-daemon[850]: reaped child process 1451, status = succeeded lb # [ 112.396059] niks3-server[1117]: 2026/09/21 14:45:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 112.397097] nix-grpc-daemon[1427]: time=2026-09-21T14:45:04.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 112.398639] nix-grpc-daemon[1427]: time=2026-09-21T14:45:04.544Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 112.417381] niks3-server[1117]: 2026/09/21 14:45:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 112.421635] niks3-server[1117]: 2026/09/21 14:45:03 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 112.425289] niks3-server[1117]: 2026/09/21 14:45:03 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 112.429772] niks3-server[1117]: 2026/09/21 14:45:03 INFO Signed narinfos id=43 count=1 worker2 # [ 112.427350] nix-grpc-daemon[1427]: time=2026-09-21T14:45:04.572Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.435432] niks3-server[1117]: 2026/09/21 14:45:03 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 112.442856] niks3-server[1117]: 2026/09/21 14:45:03 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo lb # [ 112.447051] niks3-server[1117]: 2026/09/21 14:45:03 INFO Completed upload id=43 worker2 # [ 112.444834] nix-grpc-daemon[1427]: time=2026-09-21T14:45:04.590Z level=INFO msg="Upload complete. (261ms)" worker2 # [ 112.447193] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 112.449904] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 112.455383] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 112.460396] nix-daemon[850]: reaped child process 1425, status = succeeded worker2 # [ 112.465043] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) client # [ 112.458395] nix[1271]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 113.454252] systemd[1]: intr.service: Sent signal SIGINT to main process 1271 (nix) on client request. worker2 # [ 113.463907] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:05Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 113.461347] nix[1271]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds) client # [ 113.467156] nix[1271]: error: interrupted by the user worker2 # [ 113.481582] nix-daemon[1455]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 113.484312] nix-daemon[850]: reaped child process 1453, status = succeeded worker2 # [ 113.487717] nix-daemon[850]: reaped child process 1455, status = failed with exit code 1 client # [ 113.495447] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 113.498307] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 113.501871] systemd[1]: intr.service: Consumed 118ms CPU time over 2.411s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.4K outgoing IP traffic. (finished: subtest: interrupting the client stops the build on the worker, in 2.46 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 113.563870] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: b3e2c024a64f48bdbebd5ac68f42cc57 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.04 seconds) client # [ 113.686685] nix[1291]: don't know how to build these paths: client # [ 113.687637] nix[1291]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 113.694765] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55578 worker1 # [ 113.707968] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:05Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 113.713772] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:05Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.752747] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55578 worker1 # [ 113.763574] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5) worker1 # [ 113.829984] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5) worker1 # [ 114.029186] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 278 ms (attempt 3/5) worker1 # [ 114.309131] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 4/5) worker1 # [ 114.408499] nix-grpc-daemon[1673]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 114.412310] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 114.429185] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55578 client # [ 114.430081] nix[1291]: copying 1 paths to 'lb:50051'... client # [ 114.435136] nix[1291]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 114.445285] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55578 worker1 # [ 114.456107] nix-daemon[862]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker1 # [ 114.558036] nix-daemon[862]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 114.571233] nix-daemon[862]: reaped child process 1807, status = succeeded worker1 # [ 114.651446] nix-daemon[862]: accepted connection from pid 1809, user nix-grpc-daemon (trusted) worker1 # [ 114.665697] nix-daemon[862]: reaped child process 1812, status = succeeded lb # [ 114.671596] niks3-server[1117]: 2026/09/21 14:45:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.681949] nix-grpc-daemon[1756]: time=2026-09-21T14:45:06.848Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 114.683664] nix-grpc-daemon[1756]: time=2026-09-21T14:45:06.848Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 114.703411] niks3-server[1117]: 2026/09/21 14:45:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 114.709269] niks3-server[1117]: 2026/09/21 14:45:06 INFO Signed narinfos id=44 count=1 worker1 # [ 114.711707] nix-grpc-daemon[1756]: time=2026-09-21T14:45:06.878Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.720987] niks3-server[1117]: 2026/09/21 14:45:06 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 114.734803] niks3-server[1117]: 2026/09/21 14:45:06 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete worker1 # [ 114.742343] nix-grpc-daemon[1756]: time=2026-09-21T14:45:06.909Z level=INFO msg="Upload complete. (274ms)" lb # [ 114.743343] niks3-server[1117]: 2026/09/21 14:45:06 INFO Completed upload id=44 worker1 # [ 114.744647] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55578 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 114.746294] niks3-server[1117]: 2026/09/21 14:45:06 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo lb # [ 114.749068] niks3-server[1117]: 2026/09/21 14:45:06 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls worker1 # [ 114.748228] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55578 worker1 # [ 114.754828] nix-daemon[862]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker1 # [ 114.758151] nix-daemon[862]: reaped child process 1802, status = succeeded worker1 # [ 114.764145] nix-daemon[862]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) client # [ 114.754141] nix[1291]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 115.949804] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 115.976659] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 116.150750] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33788 worker1 # [ 116.156872] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55578 worker1 # [ 116.169528] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:08Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 116.171399] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:08Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 116.219354] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 116.225763] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 client # copying 1 paths to 'lb:50051'... worker2 # [ 116.232539] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 116.247443] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 116.333348] nix-daemon[850]: accepted connection from pid 1498, user nix-grpc-daemon (trusted) worker2 # [ 116.347205] nix-daemon[850]: reaped child process 1501, status = succeeded worker2 # [ 116.427233] nix-daemon[850]: accepted connection from pid 1503, user nix-grpc-daemon (trusted) worker2 # [ 116.440424] nix-daemon[850]: reaped child process 1506, status = succeeded lb # [ 116.449612] niks3-server[1117]: 2026/09/21 14:45:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 116.451672] nix-grpc-daemon[1427]: time=2026-09-21T14:45:08.596Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 116.453135] nix-grpc-daemon[1427]: time=2026-09-21T14:45:08.596Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 116.464201] niks3-server[1117]: 2026/09/21 14:45:07 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 116.468240] niks3-server[1117]: 2026/09/21 14:45:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 116.470682] niks3-server[1117]: 2026/09/21 14:45:07 INFO Signed narinfos id=45 count=1 worker2 # [ 116.467197] nix-grpc-daemon[1427]: time=2026-09-21T14:45:08.612Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.473799] niks3-server[1117]: 2026/09/21 14:45:07 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 116.479057] niks3-server[1117]: 2026/09/21 14:45:07 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 116.482681] niks3-server[1117]: 2026/09/21 14:45:07 INFO Completed upload id=45 worker2 # [ 116.480613] nix-grpc-daemon[1427]: time=2026-09-21T14:45:08.626Z level=INFO msg="Upload complete. (227ms)" lb # [ 116.484858] niks3-server[1117]: 2026/09/21 14:45:07 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 116.482659] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 116.485803] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 116.491793] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 116.496318] nix-daemon[850]: reaped child process 1496, status = succeeded worker2 # [ 116.500504] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 116.603700] envoy[917]: conn peer=[2001:db8:1::1]:51980 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3934 tx=1852 ms=9219 lb # [ 116.605252] envoy[917]: conn peer=[2001:db8:1::1]:46320 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2993 tx=828 ms=2268 worker1 # [ 116.750676] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:08Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 117.336239] nix-daemon[850]: reaped child process 1510, status = succeeded worker2 # [ 117.416611] nix-daemon[850]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker2 # [ 117.429210] nix-daemon[850]: reaped child process 1529, status = succeeded lb # [ 117.439375] niks3-server[1117]: 2026/09/21 14:45:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 117.440699] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.586Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 117.442240] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.587Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 117.459398] niks3-server[1117]: 2026/09/21 14:45:08 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 117.464564] niks3-server[1117]: 2026/09/21 14:45:08 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 117.468715] niks3-server[1117]: 2026/09/21 14:45:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 117.471652] niks3-server[1117]: 2026/09/21 14:45:08 INFO Signed narinfos id=46 count=1 worker2 # [ 117.468521] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.613Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.473153] niks3-server[1117]: 2026/09/21 14:45:08 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 117.478717] niks3-server[1117]: 2026/09/21 14:45:08 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 117.483193] niks3-server[1117]: 2026/09/21 14:45:08 INFO Completed upload id=46 worker2 # [ 117.479823] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.625Z level=INFO msg="Upload complete. (171ms)" lb # [ 117.486216] niks3-server[1117]: 2026/09/21 14:45:08 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 117.482567] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker2 # [ 117.489602] nix-daemon[850]: reaped child process 1508, status = succeeded worker1 # [ 117.491561] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:09Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 117.493354] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:09Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 117.532513] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 117.543181] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 117.553595] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.699Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 117.560940] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 117.580259] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 117.674905] nix-daemon[850]: accepted connection from pid 1533, user nix-grpc-daemon (trusted) worker2 # [ 117.688133] nix-daemon[850]: reaped child process 1536, status = succeeded worker2 # [ 117.768956] nix-daemon[850]: accepted connection from pid 1538, user nix-grpc-daemon (trusted) worker2 # [ 117.782141] nix-daemon[850]: reaped child process 1541, status = succeeded lb # [ 117.791267] niks3-server[1117]: 2026/09/21 14:45:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 117.792481] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.937Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 117.794561] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.939Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 117.830355] niks3-server[1117]: 2026/09/21 14:45:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 117.834507] niks3-server[1117]: 2026/09/21 14:45:09 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 117.840590] niks3-server[1117]: 2026/09/21 14:45:09 INFO Signed narinfos id=47 count=1 worker2 # [ 117.839997] nix-grpc-daemon[1427]: time=2026-09-21T14:45:09.985Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.851755] niks3-server[1117]: 2026/09/21 14:45:09 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 117.860984] niks3-server[1117]: 2026/09/21 14:45:09 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 117.868102] niks3-server[1117]: 2026/09/21 14:45:09 INFO Completed upload id=47 worker2 # [ 117.864534] nix-grpc-daemon[1427]: time=2026-09-21T14:45:10.010Z level=INFO msg="Upload complete. (272ms)" lb # [ 117.870168] niks3-server[1117]: 2026/09/21 14:45:09 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 117.867215] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 117.871718] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 117.880729] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 117.890397] nix-daemon[850]: reaped child process 1531, status = succeeded worker2 # [ 117.894668] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 118.709413] nix-daemon[850]: reaped child process 1545, status = succeeded worker2 # [ 118.783265] nix-daemon[850]: accepted connection from pid 1561, user nix-grpc-daemon (trusted) worker2 # [ 118.795949] nix-daemon[850]: reaped child process 1564, status = succeeded lb # [ 118.807537] niks3-server[1117]: 2026/09/21 14:45:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 118.811796] nix-grpc-daemon[1427]: time=2026-09-21T14:45:10.957Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 118.813318] nix-grpc-daemon[1427]: time=2026-09-21T14:45:10.958Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 118.843588] niks3-server[1117]: 2026/09/21 14:45:10 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 118.855171] niks3-server[1117]: 2026/09/21 14:45:10 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 118.862659] niks3-server[1117]: 2026/09/21 14:45:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker2 # [ 118.866554] nix-grpc-daemon[1427]: time=2026-09-21T14:45:11.011Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.870568] niks3-server[1117]: 2026/09/21 14:45:10 INFO Signed narinfos id=48 count=1 lb # [ 118.881954] niks3-server[1117]: 2026/09/21 14:45:10 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 118.885093] niks3-server[1117]: 2026/09/21 14:45:10 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 118.889332] niks3-server[1117]: 2026/09/21 14:45:10 INFO Completed upload id=48 worker2 # [ 118.885891] nix-grpc-daemon[1427]: time=2026-09-21T14:45:11.031Z level=INFO msg="Upload complete. (184ms)" lb # [ 118.891295] niks3-server[1117]: 2026/09/21 14:45:10 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 118.890587] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker1 # [ 118.897639] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:11Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 118.899705] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:11Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 118.903883] nix-daemon[850]: reaped child process 1543, status = succeeded worker2 # [ 118.942167] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 118.955318] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 118.969654] nix-grpc-daemon[1427]: time=2026-09-21T14:45:11.114Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 118.978368] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 118.995508] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 119.098860] nix-daemon[850]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker2 # [ 119.111779] nix-daemon[850]: reaped child process 1571, status = succeeded worker2 # [ 119.193210] nix-daemon[850]: accepted connection from pid 1574, user nix-grpc-daemon (trusted) worker2 # [ 119.206388] nix-daemon[850]: reaped child process 1577, status = succeeded lb # [ 119.215772] niks3-server[1117]: 2026/09/21 14:45:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 119.216879] nix-grpc-daemon[1427]: time=2026-09-21T14:45:11.362Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 119.218687] nix-grpc-daemon[1427]: time=2026-09-21T14:45:11.363Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 119.231714] niks3-server[1117]: 2026/09/21 14:45:10 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 119.234599] niks3-server[1117]: 2026/09/21 14:45:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 119.236647] niks3-server[1117]: 2026/09/21 14:45:10 INFO Signed narinfos id=49 count=1 worker2 # [ 119.234919] nix-grpc-daemon[1427]: time=2026-09-21T14:45:11.380Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.240829] niks3-server[1117]: 2026/09/21 14:45:10 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 119.245514] niks3-server[1117]: 2026/09/21 14:45:10 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 119.248832] niks3-server[1117]: 2026/09/21 14:45:10 INFO Completed upload id=49 worker2 # [ 119.245429] nix-grpc-daemon[1427]: time=2026-09-21T14:45:11.390Z level=INFO msg="Upload complete. (235ms)" worker2 # [ 119.247501] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 119.251732] niks3-server[1117]: 2026/09/21 14:45:10 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 119.250747] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 119.257924] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 119.260428] nix-daemon[850]: reaped child process 1566, status = succeeded worker2 # [ 119.265875] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 120.507490] nix-daemon[850]: reaped child process 1581, status = succeeded worker2 # [ 120.587904] nix-daemon[850]: accepted connection from pid 1597, user nix-grpc-daemon (trusted) worker2 # [ 120.602202] nix-daemon[850]: reaped child process 1600, status = succeeded lb # [ 120.610311] niks3-server[1117]: 2026/09/21 14:45:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.611526] nix-grpc-daemon[1427]: time=2026-09-21T14:45:12.756Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 120.613029] nix-grpc-daemon[1427]: time=2026-09-21T14:45:12.758Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 120.631891] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 120.635492] niks3-server[1117]: 2026/09/21 14:45:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 120.641083] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 120.644218] niks3-server[1117]: 2026/09/21 14:45:12 INFO Signed narinfos id=50 count=1 worker2 # [ 120.643609] nix-grpc-daemon[1427]: time=2026-09-21T14:45:12.788Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.648449] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 120.655224] niks3-server[1117]: 2026/09/21 14:45:12 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 120.658822] niks3-server[1117]: 2026/09/21 14:45:12 INFO Completed upload id=50 worker2 # [ 120.655373] nix-grpc-daemon[1427]: time=2026-09-21T14:45:12.800Z level=INFO msg="Upload complete. (181ms)" lb # [ 120.662266] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 120.659069] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 120.665333] nix-daemon[850]: reaped child process 1579, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.68 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 121.009616] nix-daemon[862]: reaped child process 1820, status = succeeded worker1 # [ 121.086295] nix-daemon[862]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker1 # [ 121.098899] nix-daemon[862]: reaped child process 1867, status = succeeded lb # [ 121.106639] niks3-server[1117]: 2026/09/21 14:45:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 121.114581] nix-grpc-daemon[1756]: time=2026-09-21T14:45:13.281Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 121.116098] nix-grpc-daemon[1756]: time=2026-09-21T14:45:13.283Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 121.149618] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 121.155448] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 121.163425] niks3-server[1117]: 2026/09/21 14:45:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 121.169098] niks3-server[1117]: 2026/09/21 14:45:12 INFO Signed narinfos id=51 count=1 worker1 # [ 121.172312] nix-grpc-daemon[1756]: time=2026-09-21T14:45:13.338Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.176556] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 121.186118] niks3-server[1117]: 2026/09/21 14:45:12 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 121.192062] niks3-server[1117]: 2026/09/21 14:45:12 INFO Completed upload id=51 worker1 # [ 121.191345] nix-grpc-daemon[1756]: time=2026-09-21T14:45:13.358Z level=INFO msg="Upload complete. (214ms)" lb # [ 121.194510] niks3-server[1117]: 2026/09/21 14:45:12 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 121.198811] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55578 duration_s=6 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 121.213270] nix-daemon[862]: reaped child process 1818, status = succeeded client # [ 121.217636] systemd[1]: sw.service: Deactivated successfully. client # [ 121.221822] systemd[1]: sw.service: Consumed 121ms CPU time over 7.655s wall clock time, 39.4M memory peak, 7.5K incoming IP traffic, 8.5K outgoing IP traffic. worker1 # [ 121.752508] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:13Z level=info event=signal_exit lb # [ 121.761812] niks3-server[1117]: 2026/09/21 14:45:13 INFO lead: released remote=192.168.1.3:51358 client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 122.760290] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:14Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.766594] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:14Z level=info event=scheduler_restarting worker1 # [ 122.770299] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55562 worker1 # [ 122.774286] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:14Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 122.777718] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:14Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.781072] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55562 worker1 # [ 122.784933] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:14Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 122.794446] nix-grpc-daemon[1673]: E0000 00:00:1790001914.961520 1718 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 122.799266] nix-grpc-daemon[1673]: E0000 00:00:1790001914.961712 1718 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 122.810309] nix-daemon[862]: reaped child process 1727, status = succeeded worker2 # [ 122.960593] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.964701] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 122.976564] nix-grpc-daemon[1673]: ts=2026-09-21T14:45:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 123.165767] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.169732] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.370807] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.374715] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.575782] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.579664] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.781477] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.785367] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.986542] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.990565] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.191433] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.195357] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.396291] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.400243] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 124.601227] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.605170] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 124.773448] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 124.776637] systemd[1]: nix-grpc-daemon.service: Consumed 649ms CPU time over 20.157s wall clock time, 36.3M memory peak, 25.1K incoming IP traffic, 31.5K outgoing IP traffic. worker1 # [ 124.793960] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 124.807344] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 124.810896] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 124.883697] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 124.888149] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 124.892203] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 124.898141] nix-grpc-daemon[1881]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 124.900654] nix-grpc-daemon[1881]: E0000 00:00:1790001917.057932 1881 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 124.904096] nix-grpc-daemon[1881]: E0000 00:00:1790001917.061805 1881 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 124.907192] niks3-server[1117]: 2026/09/21 14:45:16 INFO lead: acquired remote=192.168.1.3:37410 worker1 # [ 124.908194] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 124.911121] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 124.916081] nix-grpc-daemon[1881]: E0000 00:00:1790001917.074081 1923 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 124.919115] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_take_over worker1 # [ 124.924233] nix-grpc-daemon[1881]: E0000 00:00:1790001917.091577 1923 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.929126] nix-grpc-daemon[1881]: E0000 00:00:1790001917.093876 1923 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.99 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 124.939781] nix-grpc-daemon[1881]: E0000 00:00:1790001917.107120 1923 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 124.951069] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 124.952723] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 125.011972] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.015892] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 125.153810] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.158243] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.216965] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.221079] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 125.358844] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.363104] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.421839] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.425684] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 125.563889] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.567989] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.627114] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.631104] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 125.769117] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.778841] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 125.832717] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.845266] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 125.849254] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54218 worker1 # [ 125.853178] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 125.974804] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.979598] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54218 worker1 # [ 125.983283] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.57 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 126.245072] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 126.249944] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 worker1 # [ 126.298358] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker1 # [ 126.302408] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 126.307321] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker1 # [ 126.312616] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 126.356080] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 126.367474] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 126.396096] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5) worker1 # [ 126.453849] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 2/5) worker1 # [ 126.499678] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 289 ms (attempt 3/5) lb # [ 126.604305] envoy[917]: conn peer=[2001:db8:1::1]:36264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=4045 ms=4520 lb # [ 126.608127] envoy[917]: conn peer=[2001:db8:1::1]:36256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1447 ms=7517 lb # [ 126.611739] envoy[917]: conn peer=[2001:db8:1::3]:34688 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=958 tx=344 ms=18177 worker1 # [ 126.796773] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 446 ms (attempt 4/5) worker1 # [ 127.252257] nix-grpc-daemon[1881]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 127.255580] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 127.272142] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 127.285085] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 127.295247] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 127.317979] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:19Z level=info event=niks3_push_started pid=1946 worker1 # [ 127.418200] nix-grpc-daemon[1946]: time=2026-09-21T14:45:19.585Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 127.504580] nix-daemon[862]: accepted connection from pid 1959, user nix-grpc-daemon (trusted) worker1 # [ 127.516198] nix-daemon[862]: reaped child process 1962, status = succeeded worker1 # [ 127.599755] nix-daemon[862]: accepted connection from pid 1964, user nix-grpc-daemon (trusted) worker1 # [ 127.613287] nix-daemon[862]: reaped child process 1967, status = succeeded lb # [ 127.619945] niks3-server[1117]: 2026/09/21 14:45:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 127.629636] nix-grpc-daemon[1946]: time=2026-09-21T14:45:19.795Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 127.631027] nix-grpc-daemon[1946]: time=2026-09-21T14:45:19.795Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 127.655396] niks3-server[1117]: 2026/09/21 14:45:19 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 127.663163] niks3-server[1117]: 2026/09/21 14:45:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 127.667644] niks3-server[1117]: 2026/09/21 14:45:19 INFO Signed narinfos id=52 count=1 worker1 # [ 127.669241] nix-grpc-daemon[1946]: time=2026-09-21T14:45:19.836Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.680213] niks3-server[1117]: 2026/09/21 14:45:19 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 127.683897] niks3-server[1117]: 2026/09/21 14:45:19 INFO Completed upload id=52 worker1 # [ 127.684922] nix-grpc-daemon[1946]: time=2026-09-21T14:45:19.852Z level=INFO msg="Upload complete. (263ms)" worker1 # [ 127.687264] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 127.689279] nix-grpc-daemon[1946]: time=2026-09-21T14:45:19.854Z level=WARN msg="Failed to register uploaded object" key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 127.692435] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 lb # [ 127.696819] niks3-server[1117]: 2026/09/21 14:45:19 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls worker1 # [ 127.698838] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 127.702833] nix-daemon[862]: reaped child process 1944, status = succeeded worker1 # [ 127.707507] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 128.938974] nix-daemon[862]: reaped child process 1971, status = succeeded worker1 # [ 129.027660] nix-daemon[862]: accepted connection from pid 1987, user nix-grpc-daemon (trusted) worker1 # [ 129.038926] nix-daemon[862]: reaped child process 1990, status = succeeded lb # [ 129.048379] niks3-server[1117]: 2026/09/21 14:45:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 129.059548] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 129.061134] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.228Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 129.092289] niks3-server[1117]: 2026/09/21 14:45:20 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 129.099456] niks3-server[1117]: 2026/09/21 14:45:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 129.103937] niks3-server[1117]: 2026/09/21 14:45:20 INFO Signed narinfos id=53 count=1 worker1 # [ 129.107112] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.273Z level=INFO msg="Uploading 1 narinfos" lb # [ 129.111460] niks3-server[1117]: 2026/09/21 14:45:20 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 129.118498] niks3-server[1117]: 2026/09/21 14:45:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 129.122971] niks3-server[1117]: 2026/09/21 14:45:20 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 129.126359] niks3-server[1117]: 2026/09/21 14:45:20 INFO Completed upload id=53 lb # [ 129.129300] niks3-server[1117]: 2026/09/21 14:45:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 129.125548] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.292Z level=INFO msg="Upload complete. (210ms)" worker1 # [ 129.132760] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker1 # [ 129.143787] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 129.148223] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 129.155241] nix-daemon[862]: reaped child process 1969, status = succeeded worker1 # [ 129.185912] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 129.198462] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 129.210183] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 129.218432] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 129.311724] nix-daemon[862]: accepted connection from pid 1996, user nix-grpc-daemon (trusted) worker1 # [ 129.324912] nix-daemon[862]: reaped child process 1999, status = succeeded worker1 # [ 129.404871] nix-daemon[862]: accepted connection from pid 2001, user nix-grpc-daemon (trusted) worker1 # [ 129.418677] nix-daemon[862]: reaped child process 2004, status = succeeded lb # [ 129.424321] niks3-server[1117]: 2026/09/21 14:45:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 129.431367] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 129.433568] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.600Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 129.456201] niks3-server[1117]: 2026/09/21 14:45:20 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 129.465968] niks3-server[1117]: 2026/09/21 14:45:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 129.471544] niks3-server[1117]: 2026/09/21 14:45:20 INFO Signed narinfos id=54 count=1 worker1 # [ 129.473778] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.640Z level=INFO msg="Uploading 1 narinfos" lb # [ 129.485689] niks3-server[1117]: 2026/09/21 14:45:20 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 129.492464] niks3-server[1117]: 2026/09/21 14:45:20 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 129.498469] nix-grpc-daemon[1946]: time=2026-09-21T14:45:21.665Z level=INFO msg="Upload complete. (268ms)" lb # [ 129.499333] niks3-server[1117]: 2026/09/21 14:45:20 INFO Completed upload id=54 lb # [ 129.503934] niks3-server[1117]: 2026/09/21 14:45:20 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 129.501701] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 129.507355] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 129.516472] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 129.526090] nix-daemon[862]: reaped child process 1994, status = succeeded worker1 # [ 129.528772] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 130.970839] nix-daemon[862]: reaped child process 2008, status = succeeded worker1 # [ 131.051531] nix-daemon[862]: accepted connection from pid 2024, user nix-grpc-daemon (trusted) worker1 # [ 131.064770] nix-daemon[862]: reaped child process 2027, status = succeeded lb # [ 131.072214] niks3-server[1117]: 2026/09/21 14:45:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 131.079883] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 131.081438] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.248Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 131.110670] niks3-server[1117]: 2026/09/21 14:45:22 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 131.124448] niks3-server[1117]: 2026/09/21 14:45:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 131.131115] niks3-server[1117]: 2026/09/21 14:45:22 INFO Signed narinfos id=55 count=1 worker1 # [ 131.132991] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.300Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.135518] niks3-server[1117]: 2026/09/21 14:45:22 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 131.140222] niks3-server[1117]: 2026/09/21 14:45:22 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 131.150368] niks3-server[1117]: 2026/09/21 14:45:22 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 131.153365] niks3-server[1117]: 2026/09/21 14:45:22 INFO Completed upload id=55 lb # [ 131.156234] niks3-server[1117]: 2026/09/21 14:45:22 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 131.153895] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.321Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 131.161907] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker1 # [ 131.174240] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 131.177813] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 131.180881] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 131.189389] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 131.194301] nix-daemon[862]: reaped child process 2006, status = succeeded worker1 # [ 131.196283] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 131.200888] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 131.283589] nix-daemon[862]: accepted connection from pid 2033, user nix-grpc-daemon (trusted) worker1 # [ 131.296303] nix-daemon[862]: reaped child process 2036, status = succeeded worker1 # [ 131.378078] nix-daemon[862]: accepted connection from pid 2038, user nix-grpc-daemon (trusted) worker1 # [ 131.391549] nix-daemon[862]: reaped child process 2041, status = succeeded lb # [ 131.398353] niks3-server[1117]: 2026/09/21 14:45:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 131.405333] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.572Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 131.406823] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.574Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 131.426416] niks3-server[1117]: 2026/09/21 14:45:22 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 131.437287] niks3-server[1117]: 2026/09/21 14:45:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 131.442491] niks3-server[1117]: 2026/09/21 14:45:22 INFO Signed narinfos id=56 count=1 worker1 # [ 131.444361] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.611Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.450645] niks3-server[1117]: 2026/09/21 14:45:22 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 131.464444] niks3-server[1117]: 2026/09/21 14:45:22 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete worker1 # [ 131.469053] nix-grpc-daemon[1946]: time=2026-09-21T14:45:23.636Z level=INFO msg="Upload complete. (263ms)" lb # [ 131.469976] niks3-server[1117]: 2026/09/21 14:45:22 INFO Completed upload id=56 worker1 # [ 131.471968] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 131.475519] niks3-server[1117]: 2026/09/21 14:45:22 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 131.479073] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 131.488963] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 131.491289] nix-daemon[862]: reaped child process 2031, status = succeeded worker1 # [ 131.497401] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 132.337914] nix-daemon[862]: reaped child process 2045, status = succeeded worker1 # [ 132.417681] nix-daemon[862]: accepted connection from pid 2061, user nix-grpc-daemon (trusted) worker1 # [ 132.428990] nix-daemon[862]: reaped child process 2064, status = succeeded lb # [ 132.437551] niks3-server[1117]: 2026/09/21 14:45:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.444993] nix-grpc-daemon[1946]: time=2026-09-21T14:45:24.612Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 132.447726] nix-grpc-daemon[1946]: time=2026-09-21T14:45:24.613Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 132.475826] niks3-server[1117]: 2026/09/21 14:45:23 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 132.488132] niks3-server[1117]: 2026/09/21 14:45:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 132.491887] nix-grpc-daemon[1946]: time=2026-09-21T14:45:24.659Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.492481] niks3-server[1117]: 2026/09/21 14:45:23 INFO Signed narinfos id=57 count=1 lb # [ 132.500698] niks3-server[1117]: 2026/09/21 14:45:23 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 132.504618] niks3-server[1117]: 2026/09/21 14:45:23 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 132.514313] niks3-server[1117]: 2026/09/21 14:45:23 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 132.518155] niks3-server[1117]: 2026/09/21 14:45:23 INFO Completed upload id=57 worker1 # [ 132.517258] nix-grpc-daemon[1946]: time=2026-09-21T14:45:24.684Z level=INFO msg="Upload complete. (213ms)" lb # [ 132.519809] niks3-server[1117]: 2026/09/21 14:45:23 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 132.525694] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker1 # [ 132.535270] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:24Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 132.539233] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:24Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 132.548489] nix-daemon[862]: reaped child process 2043, status = succeeded worker1 # [ 132.568204] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 132.579717] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 132.593645] nix-grpc-daemon[1946]: time=2026-09-21T14:45:24.760Z level=INFO msg="All 1 paths already cached" worker1 # [ 132.600382] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 132.608134] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 132.700301] nix-daemon[862]: accepted connection from pid 2070, user nix-grpc-daemon (trusted) worker1 # [ 132.713035] nix-daemon[862]: reaped child process 2073, status = succeeded worker1 # [ 132.795384] nix-daemon[862]: accepted connection from pid 2075, user nix-grpc-daemon (trusted) worker1 # [ 132.808302] nix-daemon[862]: reaped child process 2078, status = succeeded lb # [ 132.815311] niks3-server[1117]: 2026/09/21 14:45:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.823602] nix-grpc-daemon[1946]: time=2026-09-21T14:45:24.990Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 132.825301] nix-grpc-daemon[1946]: time=2026-09-21T14:45:24.992Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 132.844701] niks3-server[1117]: 2026/09/21 14:45:24 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 132.857272] niks3-server[1117]: 2026/09/21 14:45:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 132.862241] niks3-server[1117]: 2026/09/21 14:45:24 INFO Signed narinfos id=58 count=1 worker1 # [ 132.865972] nix-grpc-daemon[1946]: time=2026-09-21T14:45:25.033Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.871153] niks3-server[1117]: 2026/09/21 14:45:24 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 132.884956] niks3-server[1117]: 2026/09/21 14:45:24 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 132.892484] niks3-server[1117]: 2026/09/21 14:45:24 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo lb # [ 132.896477] niks3-server[1117]: 2026/09/21 14:45:24 INFO Completed upload id=58 worker1 # [ 132.895699] nix-grpc-daemon[1946]: time=2026-09-21T14:45:25.062Z level=INFO msg="Upload complete. (276ms)" worker1 # [ 132.900579] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 132.907307] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 132.918235] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 132.926641] nix-daemon[862]: reaped child process 2068, status = succeeded worker1 # [ 132.934380] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 133.751355] nix-daemon[862]: reaped child process 2082, status = succeeded worker1 # [ 133.822890] nix-daemon[862]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 133.836824] nix-daemon[862]: reaped child process 2101, status = succeeded lb # [ 133.842867] niks3-server[1117]: 2026/09/21 14:45:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.849379] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.016Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 133.850910] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.018Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 133.868092] niks3-server[1117]: 2026/09/21 14:45:25 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 133.871705] niks3-server[1117]: 2026/09/21 14:45:25 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 133.875722] niks3-server[1117]: 2026/09/21 14:45:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 133.877745] niks3-server[1117]: 2026/09/21 14:45:25 INFO Signed narinfos id=59 count=1 worker1 # [ 133.877255] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.044Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.884104] niks3-server[1117]: 2026/09/21 14:45:25 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 133.886242] niks3-server[1117]: 2026/09/21 14:45:25 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 133.890188] niks3-server[1117]: 2026/09/21 14:45:25 INFO Completed upload id=59 worker1 # [ 133.889129] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.056Z level=INFO msg="Upload complete. (148ms)" lb # [ 133.892550] niks3-server[1117]: 2026/09/21 14:45:25 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 133.892147] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker1 # [ 133.896830] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.898834] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 133.902091] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 133.908606] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 133.910721] nix-daemon[862]: reaped child process 2080, status = succeeded worker1 # [ 133.914323] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.081Z level=INFO msg="All 1 paths already cached" worker1 # [ 133.918232] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 133.922834] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 134.005513] nix-daemon[862]: accepted connection from pid 2107, user nix-grpc-daemon (trusted) worker1 # [ 134.019629] nix-daemon[862]: reaped child process 2110, status = succeeded worker1 # [ 134.098697] nix-daemon[862]: accepted connection from pid 2112, user nix-grpc-daemon (trusted) worker1 # [ 134.111774] nix-daemon[862]: reaped child process 2115, status = succeeded lb # [ 134.118571] niks3-server[1117]: 2026/09/21 14:45:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 134.122365] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.289Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 134.123744] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.289Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 134.132822] niks3-server[1117]: 2026/09/21 14:45:25 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 134.134604] niks3-server[1117]: 2026/09/21 14:45:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 134.137067] niks3-server[1117]: 2026/09/21 14:45:25 INFO Signed narinfos id=60 count=1 worker1 # [ 134.137722] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.304Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.140145] niks3-server[1117]: 2026/09/21 14:45:25 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 134.145126] niks3-server[1117]: 2026/09/21 14:45:25 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 134.147792] niks3-server[1117]: 2026/09/21 14:45:25 INFO Completed upload id=60 worker1 # [ 134.146848] nix-grpc-daemon[1946]: time=2026-09-21T14:45:26.314Z level=INFO msg="Upload complete. (219ms)" worker1 # [ 134.148776] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 134.151760] niks3-server[1117]: 2026/09/21 14:45:25 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 134.152968] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 134.159088] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 134.162139] nix-daemon[862]: reaped child process 2105, status = succeeded worker1 # [ 134.165851] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 135.405619] nix-daemon[862]: reaped child process 2119, status = succeeded worker1 # [ 135.485924] nix-daemon[862]: accepted connection from pid 2135, user nix-grpc-daemon (trusted) worker1 # [ 135.499568] nix-daemon[862]: reaped child process 2138, status = succeeded lb # [ 135.505966] niks3-server[1117]: 2026/09/21 14:45:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.509836] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.676Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 135.511392] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.678Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 135.530082] niks3-server[1117]: 2026/09/21 14:45:26 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 135.533091] niks3-server[1117]: 2026/09/21 14:45:26 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 135.536848] niks3-server[1117]: 2026/09/21 14:45:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 135.538571] niks3-server[1117]: 2026/09/21 14:45:26 INFO Signed narinfos id=61 count=1 worker1 # [ 135.538985] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.706Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.542635] niks3-server[1117]: 2026/09/21 14:45:26 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 135.548061] niks3-server[1117]: 2026/09/21 14:45:26 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 135.550902] niks3-server[1117]: 2026/09/21 14:45:26 INFO Completed upload id=61 worker1 # [ 135.549880] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.717Z level=INFO msg="Upload complete. (176ms)" lb # [ 135.553620] niks3-server[1117]: 2026/09/21 14:45:26 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 135.554060] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker1 # [ 135.556734] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 135.560219] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 135.563230] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 135.568825] nix-daemon[862]: reaped child process 2117, status = succeeded worker1 # [ 135.570227] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 135.575488] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.742Z level=INFO msg="All 1 paths already cached" worker1 # [ 135.578593] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 135.583174] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 135.667132] nix-daemon[862]: accepted connection from pid 2144, user nix-grpc-daemon (trusted) worker1 # [ 135.679733] nix-daemon[862]: reaped child process 2147, status = succeeded worker1 # [ 135.761842] nix-daemon[862]: accepted connection from pid 2149, user nix-grpc-daemon (trusted) worker1 # [ 135.774780] nix-daemon[862]: reaped child process 2152, status = succeeded lb # [ 135.781672] niks3-server[1117]: 2026/09/21 14:45:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.785237] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.952Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 135.786772] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.954Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 135.799538] niks3-server[1117]: 2026/09/21 14:45:27 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 135.801836] niks3-server[1117]: 2026/09/21 14:45:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 135.803954] niks3-server[1117]: 2026/09/21 14:45:27 INFO Signed narinfos id=62 count=1 worker1 # [ 135.802983] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.970Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.807137] niks3-server[1117]: 2026/09/21 14:45:27 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 135.811884] niks3-server[1117]: 2026/09/21 14:45:27 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 135.814717] niks3-server[1117]: 2026/09/21 14:45:27 INFO Completed upload id=62 worker1 # [ 135.813742] nix-grpc-daemon[1946]: time=2026-09-21T14:45:27.981Z level=INFO msg="Upload complete. (225ms)" worker1 # [ 135.815602] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 135.818198] niks3-server[1117]: 2026/09/21 14:45:27 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 135.819660] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 135.825508] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 135.827807] nix-daemon[862]: reaped child process 2142, status = succeeded worker1 # [ 135.832975] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 136.870283] nix-daemon[862]: reaped child process 2156, status = succeeded worker1 # [ 136.934342] nix-daemon[862]: accepted connection from pid 2172, user nix-grpc-daemon (trusted) worker1 # [ 136.946736] nix-daemon[862]: reaped child process 2175, status = succeeded lb # [ 136.955413] niks3-server[1117]: 2026/09/21 14:45:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 136.959136] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.126Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 136.960795] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.128Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 136.976563] niks3-server[1117]: 2026/09/21 14:45:28 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 136.979839] niks3-server[1117]: 2026/09/21 14:45:28 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 136.985731] niks3-server[1117]: 2026/09/21 14:45:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 136.990941] niks3-server[1117]: 2026/09/21 14:45:28 INFO Signed narinfos id=63 count=1 worker1 # [ 136.992946] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.160Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.995418] niks3-server[1117]: 2026/09/21 14:45:28 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 137.000287] niks3-server[1117]: 2026/09/21 14:45:28 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 137.003692] niks3-server[1117]: 2026/09/21 14:45:28 INFO Completed upload id=63 worker1 # [ 137.002539] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.169Z level=INFO msg="Upload complete. (162ms)" lb # [ 137.006105] niks3-server[1117]: 2026/09/21 14:45:28 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 137.005241] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker1 # [ 137.009841] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 137.013393] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 137.018088] nix-daemon[862]: reaped child process 2154, status = succeeded worker1 # [ 137.052402] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 137.063086] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 137.074875] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.242Z level=INFO msg="All 2 paths already cached" worker1 # [ 137.080318] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 137.088132] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 137.175145] nix-daemon[862]: accepted connection from pid 2181, user nix-grpc-daemon (trusted) worker1 # [ 137.187881] nix-daemon[862]: reaped child process 2184, status = succeeded worker1 # [ 137.269418] nix-daemon[862]: accepted connection from pid 2186, user nix-grpc-daemon (trusted) worker1 # [ 137.282687] nix-daemon[862]: reaped child process 2189, status = succeeded lb # [ 137.289593] niks3-server[1117]: 2026/09/21 14:45:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.296735] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.464Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 137.298594] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.465Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 137.316585] niks3-server[1117]: 2026/09/21 14:45:28 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 137.330139] niks3-server[1117]: 2026/09/21 14:45:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 137.336802] niks3-server[1117]: 2026/09/21 14:45:28 INFO Signed narinfos id=64 count=1 worker1 # [ 137.338806] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.340647] niks3-server[1117]: 2026/09/21 14:45:28 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 137.354842] niks3-server[1117]: 2026/09/21 14:45:28 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 137.362136] niks3-server[1117]: 2026/09/21 14:45:28 INFO Completed upload id=64 worker1 # [ 137.361109] nix-grpc-daemon[1946]: time=2026-09-21T14:45:29.528Z level=INFO msg="Upload complete. (264ms)" worker1 # [ 137.364958] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 137.367162] niks3-server[1117]: 2026/09/21 14:45:28 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 137.372241] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 137.383230] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 137.385492] nix-daemon[862]: reaped child process 2179, status = succeeded worker1 # [ 137.390750] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 138.206732] nix-daemon[862]: reaped child process 2193, status = succeeded worker1 # [ 138.278356] nix-daemon[862]: accepted connection from pid 2209, user nix-grpc-daemon (trusted) worker1 # [ 138.291328] nix-daemon[862]: reaped child process 2212, status = succeeded lb # [ 138.299145] niks3-server[1117]: 2026/09/21 14:45:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.304279] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.469Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 138.305689] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.469Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 138.322821] niks3-server[1117]: 2026/09/21 14:45:29 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 138.325522] niks3-server[1117]: 2026/09/21 14:45:29 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 138.329526] niks3-server[1117]: 2026/09/21 14:45:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 138.331298] niks3-server[1117]: 2026/09/21 14:45:29 INFO Signed narinfos id=65 count=1 worker1 # [ 138.331728] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.498Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.335553] niks3-server[1117]: 2026/09/21 14:45:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 138.341333] niks3-server[1117]: 2026/09/21 14:45:29 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 138.343782] niks3-server[1117]: 2026/09/21 14:45:29 INFO Completed upload id=65 worker1 # [ 138.342868] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.510Z level=INFO msg="Upload complete. (146ms)" lb # [ 138.346657] niks3-server[1117]: 2026/09/21 14:45:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 138.346154] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 worker1 # [ 138.349191] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:30Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 138.352180] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 138.358293] nix-daemon[862]: reaped child process 2191, status = succeeded worker1 # [ 138.359615] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 138.364825] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.532Z level=INFO msg="All 2 paths already cached" worker1 # [ 138.368459] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 138.372978] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 138.455895] nix-daemon[862]: accepted connection from pid 2216, user nix-grpc-daemon (trusted) worker1 # [ 138.469910] nix-daemon[862]: reaped child process 2219, status = succeeded worker1 # [ 138.548941] nix-daemon[862]: accepted connection from pid 2221, user nix-grpc-daemon (trusted) worker1 # [ 138.562441] nix-daemon[862]: reaped child process 2224, status = succeeded lb # [ 138.568901] niks3-server[1117]: 2026/09/21 14:45:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.576217] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.743Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 138.577780] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.745Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 138.600471] niks3-server[1117]: 2026/09/21 14:45:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 138.608464] niks3-server[1117]: 2026/09/21 14:45:30 INFO Signed narinfos id=66 count=1 worker1 # [ 138.610805] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.778Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.618563] niks3-server[1117]: 2026/09/21 14:45:30 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 138.622996] niks3-server[1117]: 2026/09/21 14:45:30 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 138.637967] niks3-server[1117]: 2026/09/21 14:45:30 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker1 # [ 138.642556] nix-grpc-daemon[1946]: time=2026-09-21T14:45:30.809Z level=INFO msg="Upload complete. (265ms)" lb # [ 138.643843] niks3-server[1117]: 2026/09/21 14:45:30 INFO Completed upload id=66 lb # [ 138.647382] niks3-server[1117]: 2026/09/21 14:45:30 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 138.646286] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 138.651077] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 138.661134] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 138.667138] nix-daemon[862]: reaped child process 2214, status = succeeded worker1 # [ 138.670804] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 139.712466] nix-daemon[862]: reaped child process 2228, status = succeeded worker1 # [ 139.793749] nix-daemon[862]: accepted connection from pid 2244, user nix-grpc-daemon (trusted) worker1 # [ 139.808446] nix-daemon[862]: reaped child process 2247, status = succeeded lb # [ 139.815732] niks3-server[1117]: 2026/09/21 14:45:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.824977] nix-grpc-daemon[1946]: time=2026-09-21T14:45:31.992Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 139.826678] nix-grpc-daemon[1946]: time=2026-09-21T14:45:31.993Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 139.858448] niks3-server[1117]: 2026/09/21 14:45:31 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 139.866404] niks3-server[1117]: 2026/09/21 14:45:31 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 139.873825] niks3-server[1117]: 2026/09/21 14:45:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker1 # [ 139.879491] nix-grpc-daemon[1946]: time=2026-09-21T14:45:32.046Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.880906] niks3-server[1117]: 2026/09/21 14:45:31 INFO Signed narinfos id=67 count=1 lb # [ 139.885878] niks3-server[1117]: 2026/09/21 14:45:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 139.895748] niks3-server[1117]: 2026/09/21 14:45:31 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 139.898430] niks3-server[1117]: 2026/09/21 14:45:31 INFO Completed upload id=67 worker1 # [ 139.897809] nix-grpc-daemon[1946]: time=2026-09-21T14:45:32.065Z level=INFO msg="Upload complete. (217ms)" lb # [ 139.901062] niks3-server[1117]: 2026/09/21 14:45:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 139.906827] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker1 # [ 139.914262] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:32Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 139.925185] nix-daemon[862]: reaped child process 2226, status = succeeded worker1 # [ 139.948613] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 139.959653] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 139.972877] nix-grpc-daemon[1946]: time=2026-09-21T14:45:32.140Z level=INFO msg="All 2 paths already cached" worker1 # [ 139.980223] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 139.988468] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 140.081949] nix-daemon[862]: accepted connection from pid 2251, user nix-grpc-daemon (trusted) worker1 # [ 140.094775] nix-daemon[862]: reaped child process 2254, status = succeeded worker1 # [ 140.177047] nix-daemon[862]: accepted connection from pid 2256, user nix-grpc-daemon (trusted) worker1 # [ 140.189478] nix-daemon[862]: reaped child process 2259, status = succeeded lb # [ 140.197805] niks3-server[1117]: 2026/09/21 14:45:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.205078] nix-grpc-daemon[1946]: time=2026-09-21T14:45:32.372Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 140.206486] nix-grpc-daemon[1946]: time=2026-09-21T14:45:32.372Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 140.225123] niks3-server[1117]: 2026/09/21 14:45:31 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 140.233767] niks3-server[1117]: 2026/09/21 14:45:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 140.238295] niks3-server[1117]: 2026/09/21 14:45:31 INFO Signed narinfos id=68 count=1 worker1 # [ 140.240433] nix-grpc-daemon[1946]: time=2026-09-21T14:45:32.407Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.248473] niks3-server[1117]: 2026/09/21 14:45:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 140.258649] niks3-server[1117]: 2026/09/21 14:45:31 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 140.264176] niks3-server[1117]: 2026/09/21 14:45:31 INFO Completed upload id=68 worker1 # [ 140.266120] nix-grpc-daemon[1946]: time=2026-09-21T14:45:32.433Z level=INFO msg="Upload complete. (266ms)" lb # [ 140.270182] niks3-server[1117]: 2026/09/21 14:45:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 140.269227] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 140.274265] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 140.284065] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 140.289245] nix-daemon[862]: reaped child process 2249, status = succeeded worker1 # [ 140.293607] nix-daemon[862]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 141.538883] nix-daemon[862]: reaped child process 2263, status = succeeded worker1 # [ 141.609541] nix-daemon[862]: accepted connection from pid 2279, user nix-grpc-daemon (trusted) worker1 # [ 141.622431] nix-daemon[862]: reaped child process 2282, status = succeeded lb # [ 141.632559] niks3-server[1117]: 2026/09/21 14:45:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.638278] nix-grpc-daemon[1946]: time=2026-09-21T14:45:33.805Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 141.639792] nix-grpc-daemon[1946]: time=2026-09-21T14:45:33.807Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 141.672667] niks3-server[1117]: 2026/09/21 14:45:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker1 # [ 141.675903] nix-grpc-daemon[1946]: time=2026-09-21T14:45:33.842Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.677348] niks3-server[1117]: 2026/09/21 14:45:33 INFO Signed narinfos id=69 count=1 lb # [ 141.686240] niks3-server[1117]: 2026/09/21 14:45:33 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 141.692902] niks3-server[1117]: 2026/09/21 14:45:33 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 141.703072] niks3-server[1117]: 2026/09/21 14:45:33 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 141.705822] niks3-server[1117]: 2026/09/21 14:45:33 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 141.711858] niks3-server[1117]: 2026/09/21 14:45:33 INFO Completed upload id=69 worker1 # [ 141.711259] nix-grpc-daemon[1946]: time=2026-09-21T14:45:33.878Z level=INFO msg="Upload complete. (209ms)" lb # [ 141.716868] niks3-server[1117]: 2026/09/21 14:45:33 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 141.717334] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54230 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 worker1 # [ 141.731964] nix-daemon[862]: reaped child process 2261, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.66 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 141.846914] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 6889c06181434b6e94e105e001e26b79 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 141.987593] nix-grpc-daemon[1335]: ts=2026-09-21T14:45:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33788 client # [ 141.981430] nix[1371]: don't know how to build these paths: client # [ 141.982349] nix[1371]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 141.992512] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client # [ 142.004248] nix[1371]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker worker1 # [ 142.013352] nix-grpc-daemon[1881]: ts=2026-09-21T14:45:34Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 146.604721] envoy[917]: conn peer=[2001:db8:1::1]:33594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27085 tx=11349 ms=15488 client # [ 172.004996] nix[1371]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 172.010876] nix[1371]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 172.028297] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 172.030344] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 172.031771] systemd[1]: gpu.service: Consumed 141ms CPU time over 30.184s wall clock time, 35.6M memory peak, 5.1K incoming IP traffic, 5.1K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.37 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 46.53 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.98 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 173.917068] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:06Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 worker1 # [ 174.832497] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54230 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker1 # [ 174.840554] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54230 worker1 # [ 174.858212] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:07Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker1 # [ 174.862598] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:07Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 174.905257] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 174.917380] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 174.927246] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 174.938200] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 175.039606] nix-daemon[850]: accepted connection from pid 1604, user nix-grpc-daemon (trusted) worker2 # [ 175.052447] nix-daemon[850]: reaped child process 1607, status = succeeded worker2 # [ 175.134994] nix-daemon[850]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 175.152289] nix-daemon[850]: reaped child process 1612, status = succeeded lb # [ 175.160815] niks3-server[1117]: 2026/09/21 14:46:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 175.299471] nix-grpc-daemon[1427]: time=2026-09-21T14:46:07.443Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 175.303196] nix-grpc-daemon[1427]: time=2026-09-21T14:46:07.443Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 175.331291] niks3-server[1117]: 2026/09/21 14:46:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 175.339356] niks3-server[1117]: 2026/09/21 14:46:06 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 175.345570] niks3-server[1117]: 2026/09/21 14:46:06 INFO Signed narinfos id=70 count=1 worker2 # [ 175.342575] nix-grpc-daemon[1427]: time=2026-09-21T14:46:07.487Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.361041] niks3-server[1117]: 2026/09/21 14:46:06 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 175.371901] niks3-server[1117]: 2026/09/21 14:46:06 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 175.378803] niks3-server[1117]: 2026/09/21 14:46:06 INFO Completed upload id=70 worker2 # [ 175.375380] nix-grpc-daemon[1427]: time=2026-09-21T14:46:07.520Z level=INFO msg="Upload complete. (425ms)" lb # [ 175.381818] niks3-server[1117]: 2026/09/21 14:46:06 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 175.378995] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 175.383049] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 175.389707] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 175.391994] nix-daemon[850]: reaped child process 1602, status = succeeded client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... worker2 # [ 175.397228] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 176.606557] envoy[917]: conn peer=[2001:db8:1::1]:59846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=30039 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 176.812958] nix-daemon[850]: reaped child process 1616, status = succeeded worker2 # [ 176.889680] nix-daemon[850]: accepted connection from pid 1632, user nix-grpc-daemon (trusted) worker2 # [ 176.903338] nix-daemon[850]: reaped child process 1635, status = succeeded lb # [ 176.913805] niks3-server[1117]: 2026/09/21 14:46:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 176.919357] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.064Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 176.921350] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.066Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 176.947458] niks3-server[1117]: 2026/09/21 14:46:08 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 176.952573] niks3-server[1117]: 2026/09/21 14:46:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 176.955530] niks3-server[1117]: 2026/09/21 14:46:08 INFO Signed narinfos id=71 count=1 worker2 # [ 176.954052] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.099Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.958959] niks3-server[1117]: 2026/09/21 14:46:08 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 176.961791] niks3-server[1117]: 2026/09/21 14:46:08 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 176.967080] niks3-server[1117]: 2026/09/21 14:46:08 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 176.970477] niks3-server[1117]: 2026/09/21 14:46:08 INFO Completed upload id=71 worker2 # [ 176.968218] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.113Z level=INFO msg="Upload complete. (163ms)" lb # [ 176.972192] niks3-server[1117]: 2026/09/21 14:46:08 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 176.970875] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker2 # [ 176.978049] nix-daemon[850]: reaped child process 1614, status = succeeded worker1 # [ 176.980325] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:09Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker1 # [ 176.984831] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:09Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 177.020709] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 177.032249] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 177.044468] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.189Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 177.053703] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 177.061971] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 177.162345] nix-daemon[850]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) worker2 # [ 177.175362] nix-daemon[850]: reaped child process 1642, status = succeeded worker2 # [ 177.259036] nix-daemon[850]: accepted connection from pid 1644, user nix-grpc-daemon (trusted) worker2 # [ 177.271214] nix-daemon[850]: reaped child process 1647, status = succeeded lb # [ 177.282680] niks3-server[1117]: 2026/09/21 14:46:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 177.287737] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.433Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 177.289156] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.433Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 177.308111] niks3-server[1117]: 2026/09/21 14:46:08 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 177.323452] niks3-server[1117]: 2026/09/21 14:46:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign worker2 # [ 177.326337] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.471Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.329678] niks3-server[1117]: 2026/09/21 14:46:08 INFO Signed narinfos id=72 count=1 lb # [ 177.337911] niks3-server[1117]: 2026/09/21 14:46:08 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 177.347854] niks3-server[1117]: 2026/09/21 14:46:08 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 177.354877] niks3-server[1117]: 2026/09/21 14:46:08 INFO Completed upload id=72 worker2 # [ 177.351590] nix-grpc-daemon[1427]: time=2026-09-21T14:46:09.497Z level=INFO msg="Upload complete. (275ms)" lb # [ 177.356232] niks3-server[1117]: 2026/09/21 14:46:08 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 177.353869] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 177.359285] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 177.368496] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 177.375118] nix-daemon[850]: reaped child process 1637, status = succeeded worker2 # [ 177.378344] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 177.993903] nix-daemon[850]: reaped child process 1651, status = succeeded worker2 # [ 178.069784] nix-daemon[850]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 178.081405] nix-daemon[850]: reaped child process 1670, status = succeeded lb # [ 178.093243] niks3-server[1117]: 2026/09/21 14:46:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 178.104266] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.249Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 178.106048] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.251Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 178.141953] niks3-server[1117]: 2026/09/21 14:46:09 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 178.148526] niks3-server[1117]: 2026/09/21 14:46:09 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 178.160898] niks3-server[1117]: 2026/09/21 14:46:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 178.166312] niks3-server[1117]: 2026/09/21 14:46:09 INFO Signed narinfos id=73 count=1 worker2 # [ 178.162695] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.307Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.172253] niks3-server[1117]: 2026/09/21 14:46:09 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 178.181802] niks3-server[1117]: 2026/09/21 14:46:09 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 178.187026] niks3-server[1117]: 2026/09/21 14:46:09 INFO Completed upload id=73 lb # [ 178.188741] niks3-server[1117]: 2026/09/21 14:46:09 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 178.185142] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.330Z level=INFO msg="Upload complete. (200ms)" worker2 # [ 178.190980] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 worker1 # [ 178.200502] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:10Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 178.200252] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker1 # [ 178.205117] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:10Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 178.212544] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 178.218544] nix-daemon[850]: reaped child process 1649, status = succeeded worker2 # [ 178.224692] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.370Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 178.232055] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 178.238749] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 178.325097] nix-daemon[850]: accepted connection from pid 1674, user nix-grpc-daemon (trusted) worker2 # [ 178.339534] nix-daemon[850]: reaped child process 1677, status = succeeded worker2 # [ 178.423113] nix-daemon[850]: accepted connection from pid 1679, user nix-grpc-daemon (trusted) worker2 # [ 178.435521] nix-daemon[850]: reaped child process 1682, status = succeeded lb # [ 178.447612] niks3-server[1117]: 2026/09/21 14:46:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 178.457465] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.603Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 178.459036] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.604Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 178.485525] niks3-server[1117]: 2026/09/21 14:46:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker2 # [ 178.488301] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.633Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.491853] niks3-server[1117]: 2026/09/21 14:46:09 INFO Signed narinfos id=74 count=1 lb # [ 178.496797] niks3-server[1117]: 2026/09/21 14:46:09 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 178.506360] niks3-server[1117]: 2026/09/21 14:46:09 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 178.518054] niks3-server[1117]: 2026/09/21 14:46:09 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 178.524382] niks3-server[1117]: 2026/09/21 14:46:09 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo lb # [ 178.529398] niks3-server[1117]: 2026/09/21 14:46:09 INFO Completed upload id=74 worker2 # [ 178.527263] nix-grpc-daemon[1427]: time=2026-09-21T14:46:10.671Z level=INFO msg="Upload complete. (280ms)" worker2 # [ 178.529830] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 178.537239] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 worker2 # [ 178.545480] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 178.558563] nix-daemon[850]: reaped child process 1672, status = succeeded client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... worker2 # [ 178.561458] nix-daemon[850]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 179.599898] nix-daemon[850]: reaped child process 1686, status = succeeded worker2 # [ 179.679364] nix-daemon[850]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker2 # [ 179.690695] nix-daemon[850]: reaped child process 1705, status = succeeded lb # [ 179.703246] niks3-server[1117]: 2026/09/21 14:46:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 179.708971] nix-grpc-daemon[1427]: time=2026-09-21T14:46:11.854Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 179.710618] nix-grpc-daemon[1427]: time=2026-09-21T14:46:11.856Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 179.743894] niks3-server[1117]: 2026/09/21 14:46:11 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 179.753676] niks3-server[1117]: 2026/09/21 14:46:11 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 179.761363] niks3-server[1117]: 2026/09/21 14:46:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker2 # [ 179.765465] nix-grpc-daemon[1427]: time=2026-09-21T14:46:11.910Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.769169] niks3-server[1117]: 2026/09/21 14:46:11 INFO Signed narinfos id=75 count=1 lb # [ 179.776095] niks3-server[1117]: 2026/09/21 14:46:11 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 179.784596] niks3-server[1117]: 2026/09/21 14:46:11 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 179.787799] niks3-server[1117]: 2026/09/21 14:46:11 INFO Completed upload id=75 lb # [ 179.790601] niks3-server[1117]: 2026/09/21 14:46:11 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 179.785700] nix-grpc-daemon[1427]: time=2026-09-21T14:46:11.931Z level=INFO msg="Upload complete. (217ms)" worker2 # [ 179.792400] nix-grpc-daemon[1335]: ts=2026-09-21T14:46:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33788 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 worker2 # [ 179.805323] nix-daemon[850]: reaped child process 1684, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.17 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.09 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 180.920132] nix-grpc-daemon[1881]: ts=2026-09-21T14:46:13Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.06 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.57 seconds) (finished: run the VM test script, in 182.10 seconds) test script finished in 182.40s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-21T14:46:13Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-21T14:46:13Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-21T14:46:13Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-21T14:46:13Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-21T14:46:13Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-21T14:46:13Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-21T14:46:14Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-21T14:46:14Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-21T14:46:14Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-21T14:46:14Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-21T14:46:14Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-21T14:46:14Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.06 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh